2023-11-24T07:49:09.170 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T07:49:09.171 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} --archive /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583 --owner scheduled_rishabh@teuthology --name rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --verbose -- /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/orig.config.yaml 2023-11-24T07:49:09.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T07:49:09.303 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} email: null first_in_suite: false job_id: '7465583' kernel: flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-tests sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9764 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-tests suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNj/Q+XzPTzQh4YeOrpq7cp5fQgcIqmxw09S5DRAXHWKDHAJeGN2B62rS/F+NlvAjXihUPMgzxruiDaYYDBUu6s= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2jbnTgFWWyS3hgRkhI4wivbPVBPcBaeh1trxn73JT6JR2bGccc0/+77lrdqIoyBiIEbah/aUxaZR5TMFK6IMg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_07:31:48 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T07:49:09.303 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa; will attempt to use it 2023-11-24T07:49:09.304 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks 2023-11-24T07:49:09.304 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T07:49:09.306 INFO:teuthology.task.internal:Checking packages... 2023-11-24T07:49:09.329 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T07:49:09.329 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T07:49:09.329 INFO:teuthology.packaging:ref: None 2023-11-24T07:49:09.329 INFO:teuthology.packaging:tag: None 2023-11-24T07:49:09.329 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T07:49:09.329 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:49:09.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T07:49:09.472 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.ga13ea5ff 2023-11-24T07:49:09.472 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T07:49:09.478 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T07:49:09.478 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T07:49:09.502 INFO:teuthology.task.internal:Saving configuration 2023-11-24T07:49:09.518 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T07:49:09.524 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T07:49:09.547 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:44:08.032284', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNj/Q+XzPTzQh4YeOrpq7cp5fQgcIqmxw09S5DRAXHWKDHAJeGN2B62rS/F+NlvAjXihUPMgzxruiDaYYDBUu6s='} 2023-11-24T07:49:09.566 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:44:08.033762', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2jbnTgFWWyS3hgRkhI4wivbPVBPcBaeh1trxn73JT6JR2bGccc0/+77lrdqIoyBiIEbah/aUxaZR5TMFK6IMg='} 2023-11-24T07:49:09.566 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T07:49:09.574 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T07:49:09.574 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T07:49:09.574 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T07:49:09.649 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe188a15b80>, signals=[15]) 2023-11-24T07:49:09.649 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T07:49:09.655 INFO:teuthology.task.internal:Opening connections... 2023-11-24T07:49:09.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T07:49:09.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:49:09.741 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T07:49:09.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:49:09.826 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T07:49:09.833 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-11-24T07:49:09.851 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-11-24T07:49:09.851 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-11-24T07:49:09.907 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-11-24T07:49:09.907 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T07:49:09.908 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T07:49:09.909 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T07:49:09.909 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-11-24T07:49:09.927 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-11-24T07:49:09.944 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-11-24T07:49:09.945 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-11-24T07:49:10.001 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T07:49:10.002 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-11-24T07:49:10.002 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T07:49:10.002 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T07:49:10.002 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T07:49:10.002 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-11-24T07:49:10.027 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T07:49:10.037 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T07:49:10.043 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T07:49:10.044 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:49:10.046 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:49:10.062 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T07:49:10.068 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T07:49:10.068 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:49:10.103 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:49:10.130 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T07:49:10.187 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T07:49:10.204 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T07:49:10.204 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, timeout 300 2023-11-24T07:49:10.204 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:49:10.205 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:49:10.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:49:10.221 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:10.221 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:49:10.221 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-11-24T07:49:10.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:49:10.222 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:10.222 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:49:10.222 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-11-24T07:49:10.277 INFO:teuthology.orchestra.run.smithi097.stdout:5.14.0-361.el9.x86_64 2023-11-24T07:49:10.277 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:10.277 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:49:10.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:10.281 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-361.el9.x86_64 2023-11-24T07:49:10.282 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:10.282 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:49:10.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:10.427 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum upgrade -y linux-firmware 2023-11-24T07:49:10.429 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum upgrade -y linux-firmware 2023-11-24T07:49:12.512 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-11-24T07:49:12.587 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-11-24T07:49:13.937 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2023-11-24T07:49:13.963 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2023-11-24T07:49:15.136 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-11-24T07:49:15.603 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 7.9 MB 00:01 2023-11-24T07:49:17.370 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 16 MB/s | 18 MB 00:01 2023-11-24T07:49:19.404 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 18 MB 00:02 2023-11-24T07:49:22.579 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.8 MB 00:01 2023-11-24T07:49:24.055 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 5.8 MB 00:01 2023-11-24T07:49:24.163 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2023-11-24T07:49:25.414 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2023-11-24T07:49:26.448 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 20 MB 00:02 2023-11-24T07:49:26.582 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-11-24T07:49:31.198 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-24T07:49:31.373 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-11-24T07:49:33.713 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-11-24T07:49:33.724 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-11-24T07:49:33.724 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-11-24T07:49:33.724 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-11-24T07:49:33.724 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-11-24T07:49:33.724 INFO:teuthology.orchestra.run.smithi183.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T07:49:33.725 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T07:49:33.725 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-11-24T07:49:33.725 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-11-24T07:49:33.725 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 1 Package 2023-11-24T07:49:33.725 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T07:49:33.726 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 328 M 2023-11-24T07:49:33.726 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-11-24T07:49:33.750 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2023-11-24T07:49:33.760 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2023-11-24T07:49:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2023-11-24T07:49:33.760 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2023-11-24T07:49:33.760 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2023-11-24T07:49:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T07:49:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T07:49:33.761 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2023-11-24T07:49:33.761 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2023-11-24T07:49:33.761 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 1 Package 2023-11-24T07:49:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T07:49:33.761 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 328 M 2023-11-24T07:49:33.762 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2023-11-24T07:49:38.550 INFO:teuthology.orchestra.run.smithi097.stdout:linux-firmware-20231030-141.el9.noarch.rpm 69 MB/s | 328 MB 00:04 2023-11-24T07:49:38.551 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2023-11-24T07:49:38.551 INFO:teuthology.orchestra.run.smithi097.stdout:Total 69 MB/s | 328 MB 00:04 2023-11-24T07:49:38.551 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2023-11-24T07:49:38.623 INFO:teuthology.orchestra.run.smithi183.stdout:linux-firmware-20231030-141.el9.noarch.rpm 67 MB/s | 328 MB 00:04 2023-11-24T07:49:38.624 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-11-24T07:49:38.625 INFO:teuthology.orchestra.run.smithi183.stdout:Total 67 MB/s | 328 MB 00:04 2023-11-24T07:49:38.625 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-11-24T07:49:38.636 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2023-11-24T07:49:38.637 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2023-11-24T07:49:38.710 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-11-24T07:49:38.710 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-11-24T07:49:40.810 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2023-11-24T07:49:40.810 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2023-11-24T07:49:40.813 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-11-24T07:49:40.813 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-11-24T07:49:46.255 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2023-11-24T07:49:46.282 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-11-24T07:49:46.759 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:49:46.838 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:49:46.861 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:49:46.947 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:49:47.950 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:49:47.950 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:49:48.020 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:49:48.020 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:49:48.324 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:49:48.325 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T07:49:48.325 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-11-24T07:49:48.325 INFO:teuthology.orchestra.run.smithi183.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T07:49:48.325 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T07:49:48.325 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-11-24T07:49:48.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:49:48.422 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T07:49:48.422 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2023-11-24T07:49:48.422 INFO:teuthology.orchestra.run.smithi097.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T07:49:48.422 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T07:49:48.422 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2023-11-24T07:49:48.599 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-24T07:49:48.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:48.706 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-24T07:49:48.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:49:48.748 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T07:49:48.748 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T07:49:48.758 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi183.front.sepia.ceph.com to complete... 2023-11-24T07:49:48.930 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T07:49:48.931 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T07:49:48.933 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi097.front.sepia.ceph.com to complete... 2023-11-24T07:50:05.710 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24 07:50:05 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T07:50:05.710 INFO:teuthology.orchestra.run.smithi183.stderr:FINISHED --2023-11-24 07:50:05-- 2023-11-24T07:50:05.710 INFO:teuthology.orchestra.run.smithi183.stderr:Total wall clock time: 17s 2023-11-24T07:50:05.711 INFO:teuthology.orchestra.run.smithi183.stderr:Downloaded: 1 files, 306M in 17s (18.5 MB/s) 2023-11-24T07:50:05.712 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-24T07:50:05.712 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T07:50:07.561 INFO:teuthology.orchestra.run.smithi183.stdout:Verifying... ######################################## 2023-11-24T07:50:07.612 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing... ######################################## 2023-11-24T07:50:07.692 INFO:teuthology.orchestra.run.smithi183.stdout:Updating / installing... 2023-11-24T07:50:14.772 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T07:50:21.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24 07:50:21 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T07:50:21.495 INFO:teuthology.orchestra.run.smithi097.stderr:FINISHED --2023-11-24 07:50:21-- 2023-11-24T07:50:21.496 INFO:teuthology.orchestra.run.smithi097.stderr:Total wall clock time: 33s 2023-11-24T07:50:21.496 INFO:teuthology.orchestra.run.smithi097.stderr:Downloaded: 1 files, 306M in 32s (9.50 MB/s) 2023-11-24T07:50:21.497 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-24T07:50:21.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T07:50:23.341 INFO:teuthology.orchestra.run.smithi097.stdout:Verifying... ######################################## 2023-11-24T07:50:23.398 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing... ######################################## 2023-11-24T07:50:23.477 INFO:teuthology.orchestra.run.smithi097.stdout:Updating / installing... 2023-11-24T07:50:30.000 INFO:teuthology.orchestra.run.smithi183.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T07:50:30.561 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T07:50:44.046 INFO:teuthology.orchestra.run.smithi097.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T07:50:51.128 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T07:50:51.128 DEBUG:teuthology.orchestra.run.smithi183:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T07:50:51.201 INFO:teuthology.orchestra.run.smithi183.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:50:51.201 INFO:teuthology.orchestra.run.smithi183.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:50:51.201 INFO:teuthology.orchestra.run.smithi183.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:50:51.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T07:50:51.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T07:50:51.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T07:50:51.201 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:50:51.202 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T07:50:51.203 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T07:50:51.204 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:50:51.205 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:50:51.206 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:50:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:50:51.208 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:50:51.209 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:50:51.210 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:50:51.211 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:50:51.212 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:50:51.213 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T07:50:51.214 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T07:50:51.215 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T07:50:51.216 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:50:51.217 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T07:50:51.218 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:50:51.219 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:50:51.220 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T07:50:51.221 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:50:51.222 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:50:51.223 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:50:51.224 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:50:51.225 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:50:51.226 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:50:51.227 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:50:51.228 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:50:51.229 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:50:51.230 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:50:51.231 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:50:51.232 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:50:51.233 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:50:51.234 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:50:51.235 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:50:51.236 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:50:51.237 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:50:51.238 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:50:51.239 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:50:51.240 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:50:51.241 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:50:51.242 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:50:51.243 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:50:51.244 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T07:50:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T07:50:51.246 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:50:51.247 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:50:51.248 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:50:51.249 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T07:50:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:50:51.251 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:50:51.252 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T07:50:51.253 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:50:51.254 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:50:51.255 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T07:50:51.256 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T07:50:51.257 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T07:50:51.258 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T07:50:51.259 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:50:51.260 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T07:50:51.261 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:50:51.262 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T07:50:51.263 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:50:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:50:51.265 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T07:50:51.266 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:50:51.267 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:50:51.268 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T07:50:51.269 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T07:50:51.270 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T07:50:51.271 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:50:51.272 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:50:51.273 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:50:51.274 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:50:51.275 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:50:51.276 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:50:51.277 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:50:51.278 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:50:51.279 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:50:51.280 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:50:51.281 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:50:51.282 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:50:51.283 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T07:50:51.284 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:50:51.285 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:50:51.286 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:50:51.287 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T07:50:51.288 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T07:50:51.289 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:50:51.290 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T07:50:51.291 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:50:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T07:50:51.293 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T07:50:51.294 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T07:50:51.295 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:50:51.296 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:50:51.297 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:50:51.298 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:50:51.299 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:50:51.300 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:50:51.301 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:50:51.302 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:50:51.303 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:50:51.304 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:50:51.305 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:50:51.306 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:50:51.307 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:50:51.308 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:50:51.309 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:50:51.310 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:50:51.311 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:50:51.312 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:50:51.313 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T07:50:51.314 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:50:51.315 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:50:51.316 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T07:50:51.317 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T07:50:51.318 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T07:50:51.319 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:50:51.320 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:50:51.321 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:50:51.322 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:50:51.323 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:50:51.324 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:50:51.325 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T07:50:51.326 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:50:51.327 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:50:51.328 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:50:51.329 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:50:51.330 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:50:51.331 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:50:51.332 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T07:50:51.333 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:50:51.334 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:50:51.335 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:50:51.336 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:50:51.337 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:50:51.338 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:50:51.339 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:50:51.340 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:50:51.341 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:50:51.342 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:50:51.343 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:50:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:50:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:50:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:50:51.347 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:50:51.348 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:50:51.349 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:50:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:50:51.351 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:50:51.352 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:50:51.353 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:50:51.354 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:50:51.355 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:50:51.356 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:50:51.357 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:50:51.358 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:50:51.359 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:50:51.360 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:50:51.361 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:50:51.362 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:50:51.363 INFO:teuthology.orchestra.run.smithi183.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:50:51.364 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:50:51.364 DEBUG:teuthology.orchestra.run.smithi183:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T07:50:51.386 INFO:teuthology.orchestra.run.smithi183.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:fi 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T07:50:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T07:50:51.388 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T07:50:51.388 INFO:teuthology.orchestra.run.smithi183.stdout:fi 2023-11-24T07:50:51.388 INFO:teuthology.orchestra.run.smithi183.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T07:50:51.388 INFO:teuthology.orchestra.run.smithi183.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T07:50:51.388 INFO:teuthology.orchestra.run.smithi183.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T07:50:51.388 INFO:teuthology.orchestra.run.smithi183.stdout:fi 2023-11-24T07:50:51.389 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2023-11-24T07:50:51.464 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2023-11-24T07:50:51.464 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.06 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 68.el9 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Group : Unspecified 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 8264254 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T07:50:51.465 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : builder@centos.org 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : CentOS 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T07:50:51.466 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T07:50:51.468 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T07:50:51.468 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 6.6.0-g8247bbb5b470 2023-11-24T07:50:51.468 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T07:50:52.042 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2023-11-24T07:50:53.544 INFO:teuthology.orchestra.run.smithi183.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T07:50:53.576 INFO:teuthology.orchestra.run.smithi183.stderr:done 2023-11-24T07:50:53.579 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-24T07:50:53.595 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.oFMvy8p9iY 2023-11-24T07:50:53.595 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oFMvy8p9iY 2023-11-24T07:50:53.663 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.oFMvy8p9iY 2023-11-24T07:50:53.811 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.oFMvy8p9iY is 6KB 2023-11-24T07:50:53.861 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.oFMvy8p9iY 2023-11-24T07:50:53.875 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T07:50:53.939 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T07:50:53.940 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T07:50:53.940 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T07:50:53.940 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T07:50:53.941 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T07:50:54.100 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2023-11-24T07:51:05.135 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T07:51:05.136 DEBUG:teuthology.orchestra.run.smithi097:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T07:51:05.228 INFO:teuthology.orchestra.run.smithi097.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:51:05.228 INFO:teuthology.orchestra.run.smithi097.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:51:05.228 INFO:teuthology.orchestra.run.smithi097.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:51:05.228 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T07:51:05.228 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T07:51:05.228 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:51:05.229 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:51:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:51:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:51:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:51:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:51:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:51:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:51:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T07:51:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:51:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:51:05.233 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:51:05.234 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:51:05.235 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:51:05.236 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:51:05.237 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:51:05.238 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:51:05.239 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:51:05.240 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:51:05.241 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:51:05.242 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T07:51:05.243 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:51:05.244 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:51:05.245 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T07:51:05.246 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:51:05.247 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T07:51:05.248 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T07:51:05.249 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:51:05.250 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:51:05.251 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:51:05.251 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:51:05.251 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:51:05.251 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:51:05.251 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:51:05.251 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:51:05.252 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:51:05.253 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:51:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:51:05.255 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:51:05.256 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:51:05.256 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:51:05.256 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:51:05.256 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:51:05.256 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:51:05.256 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:51:05.257 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:51:05.258 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:51:05.259 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:51:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:51:05.261 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:51:05.262 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:51:05.263 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:51:05.264 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:51:05.265 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:51:05.266 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:51:05.267 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:51:05.268 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:51:05.269 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:51:05.270 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:51:05.271 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:51:05.272 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:51:05.273 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T07:51:05.274 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:51:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:51:05.276 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:51:05.277 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:51:05.278 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:51:05.279 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:51:05.279 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:51:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:51:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:51:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:51:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:51:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:51:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:51:05.280 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T07:51:05.281 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:51:05.282 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:51:05.283 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T07:51:05.283 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:51:05.283 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:51:05.283 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:51:05.283 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:51:05.284 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:51:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:51:05.286 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:51:05.287 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:51:05.288 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:51:05.289 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:51:05.290 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T07:51:05.291 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T07:51:05.292 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:51:05.293 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T07:51:05.294 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:51:05.295 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T07:51:05.296 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:51:05.297 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T07:51:05.298 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:51:05.299 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T07:51:05.301 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:51:05.302 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:51:05.303 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:51:05.304 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:51:05.305 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:51:05.306 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:51:05.307 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T07:51:05.308 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T07:51:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:51:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:51:05.311 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:51:05.312 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:51:05.313 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:51:05.314 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:51:05.315 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:51:05.316 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T07:51:05.317 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T07:51:05.318 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:51:05.319 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T07:51:05.320 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:51:05.321 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:51:05.322 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T07:51:05.323 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T07:51:05.324 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:51:05.325 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:51:05.326 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:51:05.327 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T07:51:05.328 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:51:05.329 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:51:05.330 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:51:05.331 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:51:05.332 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:51:05.333 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:51:05.334 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:51:05.335 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:51:05.336 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:51:05.337 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:51:05.338 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:51:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:51:05.340 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T07:51:05.341 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:51:05.342 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T07:51:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T07:51:05.344 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:51:05.345 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:51:05.346 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:51:05.347 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:51:05.348 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:51:05.349 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:51:05.350 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:51:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T07:51:05.352 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T07:51:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:51:05.354 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:51:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:51:05.356 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:51:05.357 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T07:51:05.358 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:51:05.359 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:51:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:51:05.361 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:51:05.362 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:51:05.363 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:51:05.364 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:51:05.365 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:51:05.366 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:51:05.367 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:51:05.368 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:51:05.369 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:51:05.370 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:51:05.371 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:51:05.372 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:51:05.373 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:51:05.374 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:51:05.375 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:51:05.376 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:51:05.377 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:51:05.378 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:51:05.379 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:51:05.380 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:51:05.381 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:51:05.382 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:51:05.383 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:51:05.384 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:51:05.385 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:51:05.386 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T07:51:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T07:51:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:51:05.389 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:51:05.390 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:51:05.390 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:51:05.390 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:51:05.390 INFO:teuthology.orchestra.run.smithi097.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:51:05.390 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:51:05.391 DEBUG:teuthology.orchestra.run.smithi097:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T07:51:05.415 INFO:teuthology.orchestra.run.smithi097.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T07:51:05.415 INFO:teuthology.orchestra.run.smithi097.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T07:51:05.415 INFO:teuthology.orchestra.run.smithi097.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:51:05.415 INFO:teuthology.orchestra.run.smithi097.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:51:05.415 INFO:teuthology.orchestra.run.smithi097.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:51:05.416 INFO:teuthology.orchestra.run.smithi097.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:51:05.416 INFO:teuthology.orchestra.run.smithi097.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:51:05.416 INFO:teuthology.orchestra.run.smithi097.stdout:fi 2023-11-24T07:51:05.416 INFO:teuthology.orchestra.run.smithi097.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T07:51:05.416 INFO:teuthology.orchestra.run.smithi097.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T07:51:05.416 INFO:teuthology.orchestra.run.smithi097.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T07:51:05.417 INFO:teuthology.orchestra.run.smithi097.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T07:51:05.417 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T07:51:05.417 INFO:teuthology.orchestra.run.smithi097.stdout:fi 2023-11-24T07:51:05.417 INFO:teuthology.orchestra.run.smithi097.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T07:51:05.417 INFO:teuthology.orchestra.run.smithi097.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T07:51:05.417 INFO:teuthology.orchestra.run.smithi097.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T07:51:05.418 INFO:teuthology.orchestra.run.smithi097.stdout:fi 2023-11-24T07:51:05.418 DEBUG:teuthology.orchestra.run.smithi097:> sudo rpm -qi grub2-tools 2023-11-24T07:51:05.490 INFO:teuthology.orchestra.run.smithi097.stdout:Name : grub2-tools 2023-11-24T07:51:05.491 INFO:teuthology.orchestra.run.smithi097.stdout:Epoch : 1 2023-11-24T07:51:05.491 INFO:teuthology.orchestra.run.smithi097.stdout:Version : 2.06 2023-11-24T07:51:05.491 INFO:teuthology.orchestra.run.smithi097.stdout:Release : 68.el9 2023-11-24T07:51:05.491 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: x86_64 2023-11-24T07:51:05.492 INFO:teuthology.orchestra.run.smithi097.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T07:51:05.492 INFO:teuthology.orchestra.run.smithi097.stdout:Group : Unspecified 2023-11-24T07:51:05.492 INFO:teuthology.orchestra.run.smithi097.stdout:Size : 8264254 2023-11-24T07:51:05.492 INFO:teuthology.orchestra.run.smithi097.stdout:License : GPLv3+ 2023-11-24T07:51:05.492 INFO:teuthology.orchestra.run.smithi097.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T07:51:05.493 INFO:teuthology.orchestra.run.smithi097.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T07:51:05.493 INFO:teuthology.orchestra.run.smithi097.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T07:51:05.493 INFO:teuthology.orchestra.run.smithi097.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T07:51:05.493 INFO:teuthology.orchestra.run.smithi097.stdout:Packager : builder@centos.org 2023-11-24T07:51:05.493 INFO:teuthology.orchestra.run.smithi097.stdout:Vendor : CentOS 2023-11-24T07:51:05.493 INFO:teuthology.orchestra.run.smithi097.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T07:51:05.494 INFO:teuthology.orchestra.run.smithi097.stdout:Summary : Support tools for GRUB. 2023-11-24T07:51:05.494 INFO:teuthology.orchestra.run.smithi097.stdout:Description : 2023-11-24T07:51:05.494 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T07:51:05.494 INFO:teuthology.orchestra.run.smithi097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T07:51:05.494 INFO:teuthology.orchestra.run.smithi097.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T07:51:05.494 INFO:teuthology.orchestra.run.smithi097.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T07:51:05.495 INFO:teuthology.orchestra.run.smithi097.stdout:hardware devices. 2023-11-24T07:51:05.495 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T07:51:05.495 INFO:teuthology.orchestra.run.smithi097.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T07:51:05.496 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T07:51:05.496 INFO:teuthology.task.kernel:Updating grub on smithi097 to boot 6.6.0-g8247bbb5b470 2023-11-24T07:51:05.496 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T07:51:06.138 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2023-11-24T07:51:07.567 INFO:teuthology.orchestra.run.smithi097.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T07:51:07.606 INFO:teuthology.orchestra.run.smithi097.stderr:done 2023-11-24T07:51:07.608 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-11-24T07:51:07.664 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.zt7d2YMJ5N 2023-11-24T07:51:07.664 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zt7d2YMJ5N 2023-11-24T07:51:07.741 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.zt7d2YMJ5N 2023-11-24T07:51:07.880 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.zt7d2YMJ5N is 6KB 2023-11-24T07:51:07.929 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.zt7d2YMJ5N 2023-11-24T07:51:07.943 DEBUG:teuthology.orchestra.run.smithi097:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T07:51:08.008 INFO:teuthology.orchestra.run.smithi097.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T07:51:08.008 INFO:teuthology.orchestra.run.smithi097.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T07:51:08.008 INFO:teuthology.orchestra.run.smithi097.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T07:51:08.009 INFO:teuthology.orchestra.run.smithi097.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T07:51:08.010 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T07:51:08.154 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2023-11-24T07:51:24.116 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-24T07:51:24.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-24T07:51:24.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:51:38.170 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-24T07:51:38.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-24T07:51:38.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:51:42.434 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-11-24T07:51:51.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-24T07:51:51.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:51:54.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-11-24T07:51:56.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-24T07:52:05.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-24T07:52:05.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:52:06.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-24T07:52:06.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:52:08.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-24T07:52:20.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-24T07:52:20.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:52:39.010 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-11-24T07:52:54.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-24T07:52:54.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:52:56.906 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-11-24T07:52:57.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-24T07:52:57.482 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:52:57.482 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-11-24T07:52:57.519 INFO:teuthology.orchestra.run.smithi097.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:52:57.519 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:52:57.519 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:52:57.519 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T07:52:58.520 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-24T07:52:58.521 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-24T07:52:58.675 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2023-11-24T07:52:58.727 DEBUG:teuthology.parallel:result is None 2023-11-24T07:53:06.507 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T07:53:21.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-24T07:53:21.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:53:21.977 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-11-24T07:53:22.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-24T07:53:22.662 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:53:22.663 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-11-24T07:53:22.717 INFO:teuthology.orchestra.run.smithi183.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:53:22.717 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:53:22.717 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:53:22.717 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T07:53:23.718 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-24T07:53:23.719 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-24T07:53:23.872 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2023-11-24T07:53:23.920 DEBUG:teuthology.parallel:result is None 2023-11-24T07:53:23.920 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T07:53:23.939 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T07:53:23.940 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:53:23.950 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:53:24.010 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T07:53:24.017 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T07:53:24.024 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T07:53:24.024 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:53:24.033 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:53:24.101 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T07:53:24.107 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T07:53:24.107 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:53:24.116 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:53:24.231 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:53:24.244 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:53:24.273 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:53:24.291 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:53:24.295 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T07:53:24.303 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T07:53:24.303 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:53:24.314 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:53:24.416 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T07:53:24.425 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T07:53:24.425 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:53:24.433 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:53:24.488 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:53:24.576 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:53:24.688 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:53:24.772 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:53:24.872 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T07:53:24.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:53:24.968 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:53:25.059 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:53:25.165 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:53:25.255 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:53:25.354 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T07:53:25.354 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:53:25.453 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2023-11-24T07:53:25.462 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-11-24T07:53:25.588 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T07:53:25.617 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T07:53:25.948 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T07:53:25.957 INFO:teuthology.task.internal:Starting timer... 2023-11-24T07:53:25.957 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T07:53:25.967 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T07:53:25.976 DEBUG:teuthology.orchestra.run.smithi097:> sudo service auditd rotate 2023-11-24T07:53:26.094 INFO:teuthology.orchestra.run.smithi097.stdout:Rotating logs: 2023-11-24T07:53:26.099 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2023-11-24T07:53:26.231 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2023-11-24T07:53:26.235 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T07:53:26.235 DEBUG:teuthology.orchestra.run.smithi097:> /usr/sbin/getenforce 2023-11-24T07:53:26.299 INFO:teuthology.orchestra.run.smithi097.stdout:Permissive 2023-11-24T07:53:26.300 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2023-11-24T07:53:26.362 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2023-11-24T07:53:26.362 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi097.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2023-11-24T07:53:26.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T07:53:26.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:53:26.466 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T07:53:26.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:53:26.565 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T07:53:26.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo /usr/sbin/setenforce permissive 2023-11-24T07:53:26.670 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2023-11-24T07:53:26.775 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T07:53:26.785 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-24T07:53:26.790 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-24T07:53:26.910 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T07:53:26.926 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T07:53:26.928 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T08:03:32.492 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2023-11-24T08:03:32.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-24T08:03:32.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T08:03:32.670 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-11-24T08:03:32.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-11-24T08:03:32.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-24T08:03:32.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T08:03:32.963 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-11-24T08:03:33.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-11-24T08:03:33.112 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T08:03:33.123 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T08:03:33.123 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T08:03:33.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:03:33.133 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T08:03:33.133 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:03:33.224 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T08:03:33.227 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T08:03:33.268 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T08:03:33.277 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T08:03:33.351 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2023-11-24T08:03:33.367 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: ntpd: command not found 2023-11-24T08:03:33.388 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2023-11-24T08:03:33.408 INFO:teuthology.orchestra.run.smithi097.stdout:506 Cannot talk to daemon 2023-11-24T08:03:33.434 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T08:03:33.459 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T08:03:33.485 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T08:03:33.514 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T08:03:33.605 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-11-24T08:03:33.613 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:03:33.613 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-11-24T08:03:33.613 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.613 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.613 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.613 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.636 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2023-11-24T08:03:33.645 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:03:33.645 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2023-11-24T08:03:33.645 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.645 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.645 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.645 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:03:33.646 INFO:teuthology.run_tasks:Running task install... 2023-11-24T08:03:33.655 DEBUG:teuthology.task.install:project ceph 2023-11-24T08:03:33.655 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T08:03:33.655 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T08:03:33.656 INFO:teuthology.task.install:Using flavor: default 2023-11-24T08:03:33.661 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T08:03:33.662 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T08:03:33.662 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T08:03:33.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:03:33.664 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T08:03:33.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:03:33.805 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T08:03:33.805 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T08:03:33.818 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T08:03:33.819 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T08:03:33.922 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T08:03:33.922 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:03:33.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T08:03:33.984 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T08:03:33.985 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:03:33.985 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T08:03:34.024 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T08:03:34.024 DEBUG:teuthology.orchestra.run.smithi097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T08:03:34.088 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T08:03:34.088 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T08:03:34.166 DEBUG:teuthology.orchestra.run.smithi097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T08:03:34.233 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T08:03:34.294 DEBUG:teuthology.orchestra.run.smithi097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T08:03:34.363 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T08:03:34.381 INFO:teuthology.orchestra.run.smithi097.stdout:check_obsoletes = 1 2023-11-24T08:03:34.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum clean all 2023-11-24T08:03:34.447 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2023-11-24T08:03:34.450 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2023-11-24T08:03:34.752 INFO:teuthology.orchestra.run.smithi097.stdout:73 files removed 2023-11-24T08:03:34.779 INFO:teuthology.orchestra.run.smithi183.stdout:73 files removed 2023-11-24T08:03:34.790 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T08:03:34.814 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T08:03:35.784 INFO:teuthology.orchestra.run.smithi097.stdout:ceph packages for x86_64 161 kB/s | 78 kB 00:00 2023-11-24T08:03:35.848 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 148 kB/s | 78 kB 00:00 2023-11-24T08:03:36.305 INFO:teuthology.orchestra.run.smithi097.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2023-11-24T08:03:36.398 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 21 kB/s | 9.5 kB 00:00 2023-11-24T08:03:36.864 INFO:teuthology.orchestra.run.smithi097.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2023-11-24T08:03:36.965 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-11-24T08:03:37.585 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-9 - AppStream 9.9 MB/s | 6.4 MB 00:00 2023-11-24T08:03:37.665 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-11-24T08:03:39.268 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2023-11-24T08:03:39.511 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2023-11-24T08:03:40.932 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 7.9 MB 00:01 2023-11-24T08:03:41.422 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 7.9 MB 00:01 2023-11-24T08:03:43.576 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-11-24T08:03:44.649 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 18 MB 00:01 2023-11-24T08:03:48.509 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 5.8 MB 00:01 2023-11-24T08:03:49.933 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.8 MB 00:01 2023-11-24T08:03:50.085 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 15 kB 00:00 2023-11-24T08:03:51.717 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2023-11-24T08:03:51.829 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-11-24T08:03:53.724 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-11-24T08:03:57.437 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-11-24T08:03:59.393 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-11-24T08:04:00.279 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T08:04:00.280 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T08:04:00.299 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T08:04:00.300 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T08:04:00.302 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T08:04:00.303 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T08:04:00.305 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T08:04:00.309 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T08:04:00.310 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T08:04:00.388 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================================ 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================================ 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T08:04:00.415 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T08:04:00.416 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T08:04:00.417 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-11-24T08:04:00.418 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T08:04:00.419 INFO:teuthology.orchestra.run.smithi183.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T08:04:00.420 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T08:04:00.421 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T08:04:00.422 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T08:04:00.423 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T08:04:00.424 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T08:04:00.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T08:04:00.426 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T08:04:00.427 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================================ 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout:Install 132 Packages 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 15 Packages 2023-11-24T08:04:00.428 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:00.429 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 204 M 2023-11-24T08:04:00.429 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-11-24T08:04:01.413 INFO:teuthology.orchestra.run.smithi183.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 22 kB/s | 6.5 kB 00:00 2023-11-24T08:04:02.021 INFO:teuthology.orchestra.run.smithi183.stdout:(2/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.4 MB/s | 859 kB 00:00 2023-11-24T08:04:02.130 INFO:teuthology.orchestra.run.smithi183.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 1.3 MB/s | 141 kB 00:00 2023-11-24T08:04:02.317 INFO:teuthology.orchestra.run.smithi097.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T08:04:02.319 INFO:teuthology.orchestra.run.smithi097.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T08:04:02.340 INFO:teuthology.orchestra.run.smithi097.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T08:04:02.342 INFO:teuthology.orchestra.run.smithi097.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T08:04:02.343 INFO:teuthology.orchestra.run.smithi097.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T08:04:02.345 INFO:teuthology.orchestra.run.smithi097.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T08:04:02.348 INFO:teuthology.orchestra.run.smithi097.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T08:04:02.351 INFO:teuthology.orchestra.run.smithi097.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T08:04:02.353 INFO:teuthology.orchestra.run.smithi097.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T08:04:02.431 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2023-11-24T08:04:02.448 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================================ 2023-11-24T08:04:02.448 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2023-11-24T08:04:02.448 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================================ 2023-11-24T08:04:02.448 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2023-11-24T08:04:02.448 INFO:teuthology.orchestra.run.smithi097.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T08:04:02.449 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T08:04:02.450 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T08:04:02.451 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T08:04:02.452 INFO:teuthology.orchestra.run.smithi097.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T08:04:02.453 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T08:04:02.454 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T08:04:02.455 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T08:04:02.456 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T08:04:02.457 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T08:04:02.458 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T08:04:02.459 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout:Installing weak dependencies: 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:04:02.460 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2023-11-24T08:04:02.461 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================================ 2023-11-24T08:04:02.461 INFO:teuthology.orchestra.run.smithi097.stdout:Install 132 Packages 2023-11-24T08:04:02.461 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 15 Packages 2023-11-24T08:04:02.461 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:04:02.461 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 204 M 2023-11-24T08:04:02.461 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2023-11-24T08:04:02.497 INFO:teuthology.orchestra.run.smithi183.stdout:(4/147): ceph-common-18.0.0-7484.ga13ea5ff.el9. 14 MB/s | 19 MB 00:01 2023-11-24T08:04:02.622 INFO:teuthology.orchestra.run.smithi183.stdout:(5/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 12 MB/s | 1.5 MB 00:00 2023-11-24T08:04:02.864 INFO:teuthology.orchestra.run.smithi183.stdout:(6/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x8 3.0 MB/s | 5.2 MB 00:01 2023-11-24T08:04:02.931 INFO:teuthology.orchestra.run.smithi183.stdout:(7/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x86 2.6 MB/s | 2.1 MB 00:00 2023-11-24T08:04:03.031 INFO:teuthology.orchestra.run.smithi183.stdout:(8/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 11 MB/s | 4.4 MB 00:00 2023-11-24T08:04:03.081 INFO:teuthology.orchestra.run.smithi183.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 489 kB/s | 24 kB 00:00 2023-11-24T08:04:03.495 INFO:teuthology.orchestra.run.smithi097.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 17 kB/s | 6.5 kB 00:00 2023-11-24T08:04:04.670 INFO:teuthology.orchestra.run.smithi097.stdout:(2/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 732 kB/s | 859 kB 00:01 2023-11-24T08:04:04.912 INFO:teuthology.orchestra.run.smithi097.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 586 kB/s | 141 kB 00:00 2023-11-24T08:04:05.285 INFO:teuthology.orchestra.run.smithi097.stdout:(4/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x8 2.4 MB/s | 5.2 MB 00:02 2023-11-24T08:04:05.432 INFO:teuthology.orchestra.run.smithi183.stdout:(10/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x8 6.9 MB/s | 18 MB 00:02 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi097.stdout:(5/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 7.6 MB/s | 1.5 MB 00:00 2023-11-24T08:04:05.599 INFO:teuthology.orchestra.run.smithi183.stdout:(11/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el 3.2 MB/s | 8.6 MB 00:02 2023-11-24T08:04:05.632 INFO:teuthology.orchestra.run.smithi183.stdout:(12/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 1.1 MB/s | 217 kB 00:00 2023-11-24T08:04:05.666 INFO:teuthology.orchestra.run.smithi183.stdout:(13/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 472 kB/s | 31 kB 00:00 2023-11-24T08:04:05.766 INFO:teuthology.orchestra.run.smithi183.stdout:(14/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 1.6 MB/s | 163 kB 00:00 2023-11-24T08:04:05.800 INFO:teuthology.orchestra.run.smithi183.stdout:(15/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 4.2 MB/s | 719 kB 00:00 2023-11-24T08:04:05.804 INFO:teuthology.orchestra.run.smithi097.stdout:(6/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 14 MB/s | 4.4 MB 00:00 2023-11-24T08:04:05.875 INFO:teuthology.orchestra.run.smithi183.stdout:(16/147): librados-devel-18.0.0-7484.ga13ea5ff. 1.1 MB/s | 126 kB 00:00 2023-11-24T08:04:05.917 INFO:teuthology.orchestra.run.smithi183.stdout:(17/147): libradosstriper1-18.0.0-7484.ga13ea5f 4.0 MB/s | 476 kB 00:00 2023-11-24T08:04:06.329 INFO:teuthology.orchestra.run.smithi097.stdout:(7/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x86 1.5 MB/s | 2.1 MB 00:01 2023-11-24T08:04:06.426 INFO:teuthology.orchestra.run.smithi183.stdout:(18/147): ceph-test-18.0.0-7484.ga13ea5ff.el9.x 12 MB/s | 41 MB 00:03 2023-11-24T08:04:06.451 INFO:teuthology.orchestra.run.smithi183.stdout:(19/147): python3-ceph-argparse-18.0.0-7484.ga1 85 kB/s | 45 kB 00:00 2023-11-24T08:04:06.509 INFO:teuthology.orchestra.run.smithi183.stdout:(20/147): python3-ceph-common-18.0.0-7484.ga13e 1.5 MB/s | 129 kB 00:00 2023-11-24T08:04:06.560 INFO:teuthology.orchestra.run.smithi183.stdout:(21/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 1.5 MB/s | 162 kB 00:00 2023-11-24T08:04:06.618 INFO:teuthology.orchestra.run.smithi183.stdout:(22/147): python3-rados-18.0.0-7484.ga13ea5ff.e 2.9 MB/s | 319 kB 00:00 2023-11-24T08:04:06.719 INFO:teuthology.orchestra.run.smithi183.stdout:(23/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 1.0 MB/s | 99 kB 00:00 2023-11-24T08:04:06.794 INFO:teuthology.orchestra.run.smithi183.stdout:(24/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.1 MB/s | 85 kB 00:00 2023-11-24T08:04:06.836 INFO:teuthology.orchestra.run.smithi183.stdout:(25/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 1.1 MB/s | 298 kB 00:00 2023-11-24T08:04:06.945 INFO:teuthology.orchestra.run.smithi183.stdout:(26/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 1.5 MB/s | 170 kB 00:00 2023-11-24T08:04:06.958 INFO:teuthology.orchestra.run.smithi097.stdout:(8/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x86 15 MB/s | 18 MB 00:01 2023-11-24T08:04:07.008 INFO:teuthology.orchestra.run.smithi097.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 493 kB/s | 24 kB 00:00 2023-11-24T08:04:07.037 INFO:teuthology.orchestra.run.smithi183.stdout:(27/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 12 MB/s | 3.0 MB 00:00 2023-11-24T08:04:07.062 INFO:teuthology.orchestra.run.smithi183.stdout:(28/147): ceph-grafana-dashboards-18.0.0-7484.g 241 kB/s | 28 kB 00:00 2023-11-24T08:04:07.112 INFO:teuthology.orchestra.run.smithi183.stdout:(29/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 1.7 MB/s | 133 kB 00:00 2023-11-24T08:04:07.712 INFO:teuthology.orchestra.run.smithi183.stdout:(30/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 2.6 MB/s | 4.8 MB 00:01 2023-11-24T08:04:07.821 INFO:teuthology.orchestra.run.smithi183.stdout:(31/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 2.3 MB/s | 1.8 MB 00:00 2023-11-24T08:04:07.949 INFO:teuthology.orchestra.run.smithi183.stdout:(32/147): ceph-mgr-modules-core-18.0.0-7484.ga1 1.0 MB/s | 243 kB 00:00 2023-11-24T08:04:07.980 INFO:teuthology.orchestra.run.smithi183.stdout:(33/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 318 kB/s | 50 kB 00:00 2023-11-24T08:04:08.122 INFO:teuthology.orchestra.run.smithi183.stdout:(34/147): ceph-mgr-diskprediction-local-18.0.0- 7.3 MB/s | 7.4 MB 00:01 2023-11-24T08:04:08.147 INFO:teuthology.orchestra.run.smithi183.stdout:(35/147): ceph-prometheus-alerts-18.0.0-7484.ga 77 kB/s | 15 kB 00:00 2023-11-24T08:04:08.181 INFO:teuthology.orchestra.run.smithi183.stdout:(36/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 1.3 MB/s | 262 kB 00:00 2023-11-24T08:04:08.214 INFO:teuthology.orchestra.run.smithi183.stdout:(37/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 275 kB/s | 18 kB 00:00 2023-11-24T08:04:08.440 INFO:teuthology.orchestra.run.smithi183.stdout:(38/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 2.4 MB/s | 772 kB 00:00 2023-11-24T08:04:08.506 INFO:teuthology.orchestra.run.smithi183.stdout:(39/147): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2023-11-24T08:04:08.557 INFO:teuthology.orchestra.run.smithi183.stdout:(40/147): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 920 kB 00:00 2023-11-24T08:04:08.590 INFO:teuthology.orchestra.run.smithi183.stdout:(41/147): boost-program-options-1.75.0-8.el9.x8 720 kB/s | 106 kB 00:00 2023-11-24T08:04:08.618 INFO:teuthology.orchestra.run.smithi183.stdout:(42/147): elfutils-libelf-devel-0.190-1.el9.x86 210 kB/s | 21 kB 00:00 2023-11-24T08:04:08.641 INFO:teuthology.orchestra.run.smithi183.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 648 kB/s | 32 kB 00:00 2023-11-24T08:04:08.691 INFO:teuthology.orchestra.run.smithi183.stdout:(44/147): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 307 kB 00:00 2023-11-24T08:04:08.775 INFO:teuthology.orchestra.run.smithi183.stdout:(45/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2023-11-24T08:04:08.800 INFO:teuthology.orchestra.run.smithi183.stdout:(46/147): flexiblas-openblas-openmp-3.0.4-8.el9 119 kB/s | 17 kB 00:00 2023-11-24T08:04:08.833 INFO:teuthology.orchestra.run.smithi183.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 1.4 MB/s | 186 kB 00:00 2023-11-24T08:04:08.859 INFO:teuthology.orchestra.run.smithi183.stdout:(48/147): libaio-devel-0.3.111-13.el9.x86_64.rp 180 kB/s | 10 kB 00:00 2023-11-24T08:04:08.884 INFO:teuthology.orchestra.run.smithi183.stdout:(49/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2023-11-24T08:04:08.910 INFO:teuthology.orchestra.run.smithi183.stdout:(50/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 44 kB 00:00 2023-11-24T08:04:08.951 INFO:teuthology.orchestra.run.smithi183.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 8.7 MB/s | 578 kB 00:00 2023-11-24T08:04:08.993 INFO:teuthology.orchestra.run.smithi183.stdout:(52/147): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2023-11-24T08:04:09.018 INFO:teuthology.orchestra.run.smithi183.stdout:(53/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 252 kB/s | 24 kB 00:00 2023-11-24T08:04:09.044 INFO:teuthology.orchestra.run.smithi183.stdout:(54/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 510 kB/s | 46 kB 00:00 2023-11-24T08:04:09.086 INFO:teuthology.orchestra.run.smithi183.stdout:(55/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-11-24T08:04:09.136 INFO:teuthology.orchestra.run.smithi183.stdout:(56/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.8 MB/s | 217 kB 00:00 2023-11-24T08:04:09.161 INFO:teuthology.orchestra.run.smithi183.stdout:(57/147): openblas-0.3.21-2.el9.x86_64.rpm 304 kB/s | 34 kB 00:00 2023-11-24T08:04:09.236 INFO:teuthology.orchestra.run.smithi183.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2023-11-24T08:04:09.362 INFO:teuthology.orchestra.run.smithi183.stdout:(59/147): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2023-11-24T08:04:09.404 INFO:teuthology.orchestra.run.smithi183.stdout:(60/147): postgresql-contrib-13.11-1.el9.x86_64 3.4 MB/s | 811 kB 00:00 2023-11-24T08:04:09.429 INFO:teuthology.orchestra.run.smithi183.stdout:(61/147): postgresql-private-libs-13.11-1.el9.x 737 kB/s | 134 kB 00:00 2023-11-24T08:04:09.521 INFO:teuthology.orchestra.run.smithi183.stdout:(62/147): python3-jinja2-2.11.3-4.el9.noarch.rp 2.5 MB/s | 228 kB 00:00 2023-11-24T08:04:09.558 INFO:teuthology.orchestra.run.smithi097.stdout:(10/147): ceph-test-18.0.0-7484.ga13ea5ff.el9.x 16 MB/s | 41 MB 00:02 2023-11-24T08:04:09.625 INFO:teuthology.orchestra.run.smithi097.stdout:(11/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 3.2 MB/s | 217 kB 00:00 2023-11-24T08:04:09.667 INFO:teuthology.orchestra.run.smithi097.stdout:(12/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 767 kB/s | 31 kB 00:00 2023-11-24T08:04:09.688 INFO:teuthology.orchestra.run.smithi183.stdout:(63/147): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2023-11-24T08:04:09.751 INFO:teuthology.orchestra.run.smithi097.stdout:(13/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 8.5 MB/s | 719 kB 00:00 2023-11-24T08:04:09.796 INFO:teuthology.orchestra.run.smithi183.stdout:(64/147): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2023-11-24T08:04:09.801 INFO:teuthology.orchestra.run.smithi097.stdout:(14/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 3.3 MB/s | 163 kB 00:00 2023-11-24T08:04:09.813 INFO:teuthology.orchestra.run.smithi183.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 86 kB/s | 24 kB 00:00 2023-11-24T08:04:09.851 INFO:teuthology.orchestra.run.smithi097.stdout:(15/147): librados-devel-18.0.0-7484.ga13ea5ff. 2.5 MB/s | 126 kB 00:00 2023-11-24T08:04:09.855 INFO:teuthology.orchestra.run.smithi183.stdout:(66/147): python3-jsonpointer-2.0-4.el9.noarch. 449 kB/s | 18 kB 00:00 2023-11-24T08:04:09.905 INFO:teuthology.orchestra.run.smithi183.stdout:(67/147): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2023-11-24T08:04:09.930 INFO:teuthology.orchestra.run.smithi183.stdout:(68/147): python3-markupsafe-1.1.1-12.el9.x86_6 274 kB/s | 32 kB 00:00 2023-11-24T08:04:10.001 INFO:teuthology.orchestra.run.smithi097.stdout:(16/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el 2.4 MB/s | 8.6 MB 00:03 2023-11-24T08:04:10.043 INFO:teuthology.orchestra.run.smithi097.stdout:(17/147): libradosstriper1-18.0.0-7484.ga13ea5f 2.4 MB/s | 476 kB 00:00 2023-11-24T08:04:10.055 INFO:teuthology.orchestra.run.smithi183.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-11-24T08:04:10.081 INFO:teuthology.orchestra.run.smithi183.stdout:(70/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-11-24T08:04:10.094 INFO:teuthology.orchestra.run.smithi097.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.ga1 915 kB/s | 45 kB 00:00 2023-11-24T08:04:10.106 INFO:teuthology.orchestra.run.smithi183.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-11-24T08:04:10.156 INFO:teuthology.orchestra.run.smithi183.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 41 kB 00:00 2023-11-24T08:04:10.181 INFO:teuthology.orchestra.run.smithi183.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2023-11-24T08:04:10.206 INFO:teuthology.orchestra.run.smithi183.stdout:(74/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 132 kB 00:00 2023-11-24T08:04:10.228 INFO:teuthology.orchestra.run.smithi097.stdout:(19/147): python3-ceph-common-18.0.0-7484.ga13e 973 kB/s | 129 kB 00:00 2023-11-24T08:04:10.232 INFO:teuthology.orchestra.run.smithi183.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 986 kB/s | 47 kB 00:00 2023-11-24T08:04:10.303 INFO:teuthology.orchestra.run.smithi097.stdout:(20/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 2.1 MB/s | 162 kB 00:00 2023-11-24T08:04:10.306 INFO:teuthology.orchestra.run.smithi183.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 351 kB/s | 43 kB 00:00 2023-11-24T08:04:10.362 INFO:teuthology.orchestra.run.smithi097.stdout:(21/147): python3-rados-18.0.0-7484.ga13ea5ff.e 5.4 MB/s | 319 kB 00:00 2023-11-24T08:04:10.420 INFO:teuthology.orchestra.run.smithi097.stdout:(22/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 5.1 MB/s | 298 kB 00:00 2023-11-24T08:04:10.471 INFO:teuthology.orchestra.run.smithi097.stdout:(23/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 2.0 MB/s | 99 kB 00:00 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi097.stdout:(24/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 2.0 MB/s | 85 kB 00:00 2023-11-24T08:04:10.641 INFO:teuthology.orchestra.run.smithi183.stdout:(77/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2023-11-24T08:04:10.700 INFO:teuthology.orchestra.run.smithi183.stdout:(78/147): python3-toml-0.10.2-6.el9.noarch.rpm 102 kB/s | 39 kB 00:00 2023-11-24T08:04:10.725 INFO:teuthology.orchestra.run.smithi183.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 741 kB/s | 300 kB 00:00 2023-11-24T08:04:10.729 INFO:teuthology.orchestra.run.smithi097.stdout:(25/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 14 MB/s | 3.0 MB 00:00 2023-11-24T08:04:10.750 INFO:teuthology.orchestra.run.smithi183.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 56 kB 00:00 2023-11-24T08:04:10.775 INFO:teuthology.orchestra.run.smithi183.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-11-24T08:04:10.779 INFO:teuthology.orchestra.run.smithi097.stdout:(26/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 3.4 MB/s | 170 kB 00:00 2023-11-24T08:04:10.801 INFO:teuthology.orchestra.run.smithi183.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 63 kB 00:00 2023-11-24T08:04:10.826 INFO:teuthology.orchestra.run.smithi183.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 599 kB/s | 44 kB 00:00 2023-11-24T08:04:10.830 INFO:teuthology.orchestra.run.smithi097.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7484.g 567 kB/s | 28 kB 00:00 2023-11-24T08:04:10.860 INFO:teuthology.orchestra.run.smithi183.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-24T08:04:10.881 INFO:teuthology.orchestra.run.smithi097.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 2.6 MB/s | 133 kB 00:00 2023-11-24T08:04:10.893 INFO:teuthology.orchestra.run.smithi183.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.7 MB/s | 803 kB 00:00 2023-11-24T08:04:10.918 INFO:teuthology.orchestra.run.smithi183.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-11-24T08:04:10.960 INFO:teuthology.orchestra.run.smithi183.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2023-11-24T08:04:11.002 INFO:teuthology.orchestra.run.smithi183.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-11-24T08:04:11.027 INFO:teuthology.orchestra.run.smithi183.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 103 kB 00:00 2023-11-24T08:04:11.064 INFO:teuthology.orchestra.run.smithi097.stdout:(29/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 9.6 MB/s | 1.8 MB 00:00 2023-11-24T08:04:11.086 INFO:teuthology.orchestra.run.smithi183.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-11-24T08:04:11.111 INFO:teuthology.orchestra.run.smithi183.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.0 MB/s | 113 kB 00:00 2023-11-24T08:04:11.153 INFO:teuthology.orchestra.run.smithi183.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 1.5 MB/s | 187 kB 00:00 2023-11-24T08:04:11.173 INFO:teuthology.orchestra.run.smithi097.stdout:(30/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 4.1 MB/s | 4.8 MB 00:01 2023-11-24T08:04:11.289 INFO:teuthology.orchestra.run.smithi097.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7484.ga1 2.1 MB/s | 243 kB 00:00 2023-11-24T08:04:11.328 INFO:teuthology.orchestra.run.smithi183.stdout:(93/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.7 MB/s | 309 kB 00:00 2023-11-24T08:04:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 763 kB/s | 50 kB 00:00 2023-11-24T08:04:11.396 INFO:teuthology.orchestra.run.smithi183.stdout:(94/147): python3-devel-3.9.17-2.el9.x86_64.rpm 874 kB/s | 245 kB 00:00 2023-11-24T08:04:11.440 INFO:teuthology.orchestra.run.smithi097.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7484.ga 183 kB/s | 15 kB 00:00 2023-11-24T08:04:11.479 INFO:teuthology.orchestra.run.smithi183.stdout:(95/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 295 kB/s | 24 kB 00:00 2023-11-24T08:04:11.538 INFO:teuthology.orchestra.run.smithi183.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 848 kB/s | 49 kB 00:00 2023-11-24T08:04:11.582 INFO:teuthology.orchestra.run.smithi097.stdout:(34/147): ceph-mgr-diskprediction-local-18.0.0- 14 MB/s | 7.4 MB 00:00 2023-11-24T08:04:11.605 INFO:teuthology.orchestra.run.smithi183.stdout:(97/147): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-11-24T08:04:11.616 INFO:teuthology.orchestra.run.smithi097.stdout:(35/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 1.5 MB/s | 262 kB 00:00 2023-11-24T08:04:11.666 INFO:teuthology.orchestra.run.smithi097.stdout:(36/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 9.1 MB/s | 772 kB 00:00 2023-11-24T08:04:11.691 INFO:teuthology.orchestra.run.smithi097.stdout:(37/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 245 kB/s | 18 kB 00:00 2023-11-24T08:04:11.730 INFO:teuthology.orchestra.run.smithi183.stdout:(98/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 6.6 MB/s | 837 kB 00:00 2023-11-24T08:04:11.834 INFO:teuthology.orchestra.run.smithi183.stdout:(99/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 5.7 MB/s | 4.1 MB 00:00 2023-11-24T08:04:11.939 INFO:teuthology.orchestra.run.smithi183.stdout:(100/147): libarrow-9.0.0-9.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2023-11-24T08:04:11.972 INFO:teuthology.orchestra.run.smithi183.stdout:(101/147): python3-asyncssh-2.13.2-3.el9.noarch 2.2 MB/s | 548 kB 00:00 2023-11-24T08:04:11.983 INFO:teuthology.orchestra.run.smithi097.stdout:(38/147): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 920 kB 00:00 2023-11-24T08:04:11.998 INFO:teuthology.orchestra.run.smithi183.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 558 kB/s | 32 kB 00:00 2023-11-24T08:04:12.023 INFO:teuthology.orchestra.run.smithi183.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 302 kB/s | 15 kB 00:00 2023-11-24T08:04:12.025 INFO:teuthology.orchestra.run.smithi097.stdout:(39/147): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2023-11-24T08:04:12.048 INFO:teuthology.orchestra.run.smithi183.stdout:(104/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 203 kB/s | 43 kB 00:00 2023-11-24T08:04:12.059 INFO:teuthology.orchestra.run.smithi097.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2023-11-24T08:04:12.082 INFO:teuthology.orchestra.run.smithi183.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-11-24T08:04:12.084 INFO:teuthology.orchestra.run.smithi097.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 376 kB/s | 21 kB 00:00 2023-11-24T08:04:12.115 INFO:teuthology.orchestra.run.smithi183.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2023-11-24T08:04:12.117 INFO:teuthology.orchestra.run.smithi097.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-11-24T08:04:12.141 INFO:teuthology.orchestra.run.smithi183.stdout:(107/147): python3-jaraco-8.2.1-3.el9.noarch.rp 184 kB/s | 11 kB 00:00 2023-11-24T08:04:12.166 INFO:teuthology.orchestra.run.smithi183.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 357 kB/s | 18 kB 00:00 2023-11-24T08:04:12.176 INFO:teuthology.orchestra.run.smithi097.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 32 kB 00:00 2023-11-24T08:04:12.191 INFO:teuthology.orchestra.run.smithi183.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 469 kB/s | 23 kB 00:00 2023-11-24T08:04:12.242 INFO:teuthology.orchestra.run.smithi183.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2023-11-24T08:04:12.267 INFO:teuthology.orchestra.run.smithi183.stdout:(111/147): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2023-11-24T08:04:12.292 INFO:teuthology.orchestra.run.smithi183.stdout:(112/147): python3-google-auth-2.23.4-1.el9.noa 812 kB/s | 197 kB 00:00 2023-11-24T08:04:12.310 INFO:teuthology.orchestra.run.smithi097.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2023-11-24T08:04:12.318 INFO:teuthology.orchestra.run.smithi183.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-11-24T08:04:12.335 INFO:teuthology.orchestra.run.smithi097.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 113 kB/s | 17 kB 00:00 2023-11-24T08:04:12.343 INFO:teuthology.orchestra.run.smithi183.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 547 kB/s | 41 kB 00:00 2023-11-24T08:04:12.368 INFO:teuthology.orchestra.run.smithi183.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 947 kB/s | 46 kB 00:00 2023-11-24T08:04:12.377 INFO:teuthology.orchestra.run.smithi097.stdout:(46/147): libaio-devel-0.3.111-13.el9.x86_64.rp 249 kB/s | 10 kB 00:00 2023-11-24T08:04:12.393 INFO:teuthology.orchestra.run.smithi183.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2023-11-24T08:04:12.411 INFO:teuthology.orchestra.run.smithi097.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2023-11-24T08:04:12.419 INFO:teuthology.orchestra.run.smithi183.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-11-24T08:04:12.436 INFO:teuthology.orchestra.run.smithi097.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 159 kB 00:00 2023-11-24T08:04:12.452 INFO:teuthology.orchestra.run.smithi183.stdout:(118/147): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2023-11-24T08:04:12.461 INFO:teuthology.orchestra.run.smithi097.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 913 kB/s | 44 kB 00:00 2023-11-24T08:04:12.477 INFO:teuthology.orchestra.run.smithi183.stdout:(119/147): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2023-11-24T08:04:12.503 INFO:teuthology.orchestra.run.smithi183.stdout:(120/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2023-11-24T08:04:12.505 INFO:teuthology.orchestra.run.smithi097.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2023-11-24T08:04:12.528 INFO:teuthology.orchestra.run.smithi183.stdout:(121/147): python3-repoze-lru-0.7-16.el9.noarch 620 kB/s | 31 kB 00:00 2023-11-24T08:04:12.570 INFO:teuthology.orchestra.run.smithi183.stdout:(122/147): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2023-11-24T08:04:12.570 INFO:teuthology.orchestra.run.smithi097.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 5.5 MB/s | 578 kB 00:00 2023-11-24T08:04:12.596 INFO:teuthology.orchestra.run.smithi097.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 284 kB/s | 24 kB 00:00 2023-11-24T08:04:12.621 INFO:teuthology.orchestra.run.smithi097.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 46 kB 00:00 2023-11-24T08:04:12.628 INFO:teuthology.orchestra.run.smithi183.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2023-11-24T08:04:12.654 INFO:teuthology.orchestra.run.smithi183.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 474 kB/s | 59 kB 00:00 2023-11-24T08:04:12.654 INFO:teuthology.orchestra.run.smithi097.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-11-24T08:04:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2023-11-24T08:04:12.688 INFO:teuthology.orchestra.run.smithi097.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-11-24T08:04:12.704 INFO:teuthology.orchestra.run.smithi183.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2023-11-24T08:04:12.713 INFO:teuthology.orchestra.run.smithi097.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 616 kB/s | 34 kB 00:00 2023-11-24T08:04:12.729 INFO:teuthology.orchestra.run.smithi183.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2023-11-24T08:04:12.763 INFO:teuthology.orchestra.run.smithi183.stdout:(128/147): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-11-24T08:04:12.797 INFO:teuthology.orchestra.run.smithi183.stdout:(129/147): python3-zc-lockfile-2.0-10.el9.noarc 302 kB/s | 20 kB 00:00 2023-11-24T08:04:12.830 INFO:teuthology.orchestra.run.smithi183.stdout:(130/147): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2023-11-24T08:04:12.847 INFO:teuthology.orchestra.run.smithi097.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2023-11-24T08:04:12.864 INFO:teuthology.orchestra.run.smithi183.stdout:(131/147): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2023-11-24T08:04:12.921 INFO:teuthology.orchestra.run.smithi097.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 7.9 MB/s | 1.5 MB 00:00 2023-11-24T08:04:12.973 INFO:teuthology.orchestra.run.smithi097.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 6.4 MB/s | 811 kB 00:00 2023-11-24T08:04:12.998 INFO:teuthology.orchestra.run.smithi097.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi097.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-11-24T08:04:13.156 INFO:teuthology.orchestra.run.smithi183.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2023-11-24T08:04:13.206 INFO:teuthology.orchestra.run.smithi183.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-24T08:04:13.265 INFO:teuthology.orchestra.run.smithi097.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-11-24T08:04:13.307 INFO:teuthology.orchestra.run.smithi183.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 23 MB/s | 2.2 MB 00:00 2023-11-24T08:04:13.315 INFO:teuthology.orchestra.run.smithi097.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-11-24T08:04:13.366 INFO:teuthology.orchestra.run.smithi097.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 500 kB/s | 24 kB 00:00 2023-11-24T08:04:13.391 INFO:teuthology.orchestra.run.smithi097.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 244 kB/s | 18 kB 00:00 2023-11-24T08:04:13.415 INFO:teuthology.orchestra.run.smithi183.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 16 MB/s | 1.8 MB 00:00 2023-11-24T08:04:13.416 INFO:teuthology.orchestra.run.smithi097.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-11-24T08:04:13.441 INFO:teuthology.orchestra.run.smithi097.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 657 kB/s | 32 kB 00:00 2023-11-24T08:04:13.449 INFO:teuthology.orchestra.run.smithi183.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 1.3 MB/s | 42 kB 00:00 2023-11-24T08:04:13.507 INFO:teuthology.orchestra.run.smithi183.stdout:(137/147): NetworkManager-tui-1.45.6-1.el9.x86_ 4.1 MB/s | 245 kB 00:00 2023-11-24T08:04:13.567 INFO:teuthology.orchestra.run.smithi097.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-11-24T08:04:13.584 INFO:teuthology.orchestra.run.smithi097.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2023-11-24T08:04:13.591 INFO:teuthology.orchestra.run.smithi183.stdout:(138/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 4.2 MB/s | 3.0 MB 00:00 2023-11-24T08:04:13.616 INFO:teuthology.orchestra.run.smithi183.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 638 kB/s | 69 kB 00:00 2023-11-24T08:04:13.634 INFO:teuthology.orchestra.run.smithi097.stdout:(70/147): python3-prettytable-0.7.2-27.el9.noar 848 kB/s | 41 kB 00:00 2023-11-24T08:04:13.641 INFO:teuthology.orchestra.run.smithi183.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 749 kB/s | 36 kB 00:00 2023-11-24T08:04:13.675 INFO:teuthology.orchestra.run.smithi183.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2023-11-24T08:04:13.693 INFO:teuthology.orchestra.run.smithi097.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 174 kB 00:00 2023-11-24T08:04:13.709 INFO:teuthology.orchestra.run.smithi183.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 3.9 MB/s | 255 kB 00:00 2023-11-24T08:04:13.718 INFO:teuthology.orchestra.run.smithi097.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2023-11-24T08:04:13.752 INFO:teuthology.orchestra.run.smithi097.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2023-11-24T08:04:13.767 INFO:teuthology.orchestra.run.smithi183.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 246 kB/s | 22 kB 00:00 2023-11-24T08:04:13.768 INFO:teuthology.orchestra.run.smithi097.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 993 kB/s | 47 kB 00:00 2023-11-24T08:04:13.785 INFO:teuthology.orchestra.run.smithi097.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-11-24T08:04:13.810 INFO:teuthology.orchestra.run.smithi183.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 3.2 MB/s | 321 kB 00:00 2023-11-24T08:04:13.903 INFO:teuthology.orchestra.run.smithi097.stdout:(76/147): python3-toml-0.10.2-6.el9.noarch.rpm 332 kB/s | 39 kB 00:00 2023-11-24T08:04:13.910 INFO:teuthology.orchestra.run.smithi183.stdout:(145/147): librados2-18.0.0-7484.ga13ea5ff.el9. 3.1 MB/s | 3.3 MB 00:01 2023-11-24T08:04:14.187 INFO:teuthology.orchestra.run.smithi097.stdout:(77/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2023-11-24T08:04:14.219 INFO:teuthology.orchestra.run.smithi183.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 2.7 MB/s | 1.2 MB 00:00 2023-11-24T08:04:14.220 INFO:teuthology.orchestra.run.smithi097.stdout:(78/147): socat-1.7.4.1-5.el9.x86_64.rpm 967 kB/s | 300 kB 00:00 2023-11-24T08:04:14.245 INFO:teuthology.orchestra.run.smithi097.stdout:(79/147): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-11-24T08:04:14.271 INFO:teuthology.orchestra.run.smithi097.stdout:(80/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-11-24T08:04:14.296 INFO:teuthology.orchestra.run.smithi097.stdout:(81/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-11-24T08:04:14.321 INFO:teuthology.orchestra.run.smithi097.stdout:(82/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 901 kB/s | 44 kB 00:00 2023-11-24T08:04:14.346 INFO:teuthology.orchestra.run.smithi097.stdout:(83/147): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-24T08:04:14.352 INFO:teuthology.orchestra.run.smithi183.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.0 MB/s | 2.2 MB 00:00 2023-11-24T08:04:14.360 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-11-24T08:04:14.360 INFO:teuthology.orchestra.run.smithi183.stdout:Total 15 MB/s | 204 MB 00:13 2023-11-24T08:04:14.397 INFO:teuthology.orchestra.run.smithi097.stdout:(84/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 11 MB/s | 803 kB 00:00 2023-11-24T08:04:14.431 INFO:teuthology.orchestra.run.smithi097.stdout:(85/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-11-24T08:04:14.489 INFO:teuthology.orchestra.run.smithi097.stdout:(86/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-11-24T08:04:14.548 INFO:teuthology.orchestra.run.smithi097.stdout:(87/147): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2023-11-24T08:04:14.565 INFO:teuthology.orchestra.run.smithi097.stdout:(88/147): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-11-24T08:04:14.581 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-11-24T08:04:14.598 INFO:teuthology.orchestra.run.smithi097.stdout:(89/147): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-24T08:04:14.624 INFO:teuthology.orchestra.run.smithi097.stdout:(90/147): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-11-24T08:04:14.657 INFO:teuthology.orchestra.run.smithi097.stdout:(91/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-24T08:04:14.859 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-11-24T08:04:14.860 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-11-24T08:04:14.941 INFO:teuthology.orchestra.run.smithi097.stdout:(92/147): ceph-common-18.0.0-7484.ga13ea5ff.el9 1.6 MB/s | 19 MB 00:11 2023-11-24T08:04:15.075 INFO:teuthology.orchestra.run.smithi097.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 590 kB/s | 245 kB 00:00 2023-11-24T08:04:15.325 INFO:teuthology.orchestra.run.smithi097.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 5.9 MB/s | 4.1 MB 00:00 2023-11-24T08:04:15.484 INFO:teuthology.orchestra.run.smithi097.stdout:(95/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 571 kB/s | 309 kB 00:00 2023-11-24T08:04:15.517 INFO:teuthology.orchestra.run.smithi097.stdout:(96/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 129 kB/s | 24 kB 00:00 2023-11-24T08:04:15.551 INFO:teuthology.orchestra.run.smithi097.stdout:(97/147): liboath-2.6.7-2.el9.x86_64.rpm 739 kB/s | 49 kB 00:00 2023-11-24T08:04:15.634 INFO:teuthology.orchestra.run.smithi097.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 581 kB/s | 67 kB 00:00 2023-11-24T08:04:15.785 INFO:teuthology.orchestra.run.smithi097.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 3.6 MB/s | 548 kB 00:00 2023-11-24T08:04:15.835 INFO:teuthology.orchestra.run.smithi097.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 885 kB/s | 43 kB 00:00 2023-11-24T08:04:15.868 INFO:teuthology.orchestra.run.smithi097.stdout:(101/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.6 MB/s | 837 kB 00:00 2023-11-24T08:04:15.894 INFO:teuthology.orchestra.run.smithi097.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 557 kB/s | 32 kB 00:00 2023-11-24T08:04:15.919 INFO:teuthology.orchestra.run.smithi097.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 303 kB/s | 15 kB 00:00 2023-11-24T08:04:16.003 INFO:teuthology.orchestra.run.smithi097.stdout:(104/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2023-11-24T08:04:16.036 INFO:teuthology.orchestra.run.smithi097.stdout:(105/147): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2023-11-24T08:04:16.087 INFO:teuthology.orchestra.run.smithi097.stdout:(106/147): python3-google-auth-2.23.4-1.el9.noa 2.3 MB/s | 197 kB 00:00 2023-11-24T08:04:16.112 INFO:teuthology.orchestra.run.smithi097.stdout:(107/147): python3-jaraco-8.2.1-3.el9.noarch.rp 143 kB/s | 11 kB 00:00 2023-11-24T08:04:16.137 INFO:teuthology.orchestra.run.smithi097.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 356 kB/s | 18 kB 00:00 2023-11-24T08:04:16.163 INFO:teuthology.orchestra.run.smithi097.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 469 kB/s | 23 kB 00:00 2023-11-24T08:04:16.188 INFO:teuthology.orchestra.run.smithi097.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 394 kB/s | 19 kB 00:00 2023-11-24T08:04:16.222 INFO:teuthology.orchestra.run.smithi097.stdout:(111/147): python3-jaraco-text-3.2.0-6.el9.noar 341 kB/s | 20 kB 00:00 2023-11-24T08:04:16.247 INFO:teuthology.orchestra.run.smithi097.stdout:(112/147): python3-jwt+crypto-2.4.0-1.el9.noarc 156 kB/s | 9.0 kB 00:00 2023-11-24T08:04:16.347 INFO:teuthology.orchestra.run.smithi097.stdout:(113/147): libarrow-9.0.0-9.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2023-11-24T08:04:16.406 INFO:teuthology.orchestra.run.smithi097.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 223 kB/s | 41 kB 00:00 2023-11-24T08:04:16.431 INFO:teuthology.orchestra.run.smithi097.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 561 kB/s | 46 kB 00:00 2023-11-24T08:04:16.473 INFO:teuthology.orchestra.run.smithi097.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-11-24T08:04:16.498 INFO:teuthology.orchestra.run.smithi097.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 869 kB/s | 58 kB 00:00 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi097.stdout:(118/147): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2023-11-24T08:04:16.574 INFO:teuthology.orchestra.run.smithi097.stdout:(119/147): python3-portend-3.1.0-2.el9.noarch.r 221 kB/s | 16 kB 00:00 2023-11-24T08:04:16.599 INFO:teuthology.orchestra.run.smithi097.stdout:(120/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2023-11-24T08:04:16.633 INFO:teuthology.orchestra.run.smithi097.stdout:(121/147): python3-repoze-lru-0.7-16.el9.noarch 534 kB/s | 31 kB 00:00 2023-11-24T08:04:16.666 INFO:teuthology.orchestra.run.smithi097.stdout:(122/147): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2023-11-24T08:04:16.692 INFO:teuthology.orchestra.run.smithi097.stdout:(123/147): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-11-24T08:04:16.717 INFO:teuthology.orchestra.run.smithi097.stdout:(124/147): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-11-24T08:04:16.776 INFO:teuthology.orchestra.run.smithi097.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2023-11-24T08:04:16.801 INFO:teuthology.orchestra.run.smithi097.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 473 kB/s | 51 kB 00:00 2023-11-24T08:04:16.834 INFO:teuthology.orchestra.run.smithi097.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-11-24T08:04:16.860 INFO:teuthology.orchestra.run.smithi097.stdout:(128/147): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2023-11-24T08:04:16.885 INFO:teuthology.orchestra.run.smithi097.stdout:(129/147): python3-zc-lockfile-2.0-10.el9.noarc 406 kB/s | 20 kB 00:00 2023-11-24T08:04:16.919 INFO:teuthology.orchestra.run.smithi097.stdout:(130/147): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-11-24T08:04:16.952 INFO:teuthology.orchestra.run.smithi097.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-11-24T08:04:17.028 INFO:teuthology.orchestra.run.smithi097.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-11-24T08:04:17.037 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-11-24T08:04:17.086 INFO:teuthology.orchestra.run.smithi097.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 68 kB 00:00 2023-11-24T08:04:17.195 INFO:teuthology.orchestra.run.smithi097.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-24T08:04:17.279 INFO:teuthology.orchestra.run.smithi097.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 21 MB/s | 1.8 MB 00:00 2023-11-24T08:04:17.312 INFO:teuthology.orchestra.run.smithi097.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 1.3 MB/s | 42 kB 00:00 2023-11-24T08:04:17.388 INFO:teuthology.orchestra.run.smithi097.stdout:(137/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 7.0 MB/s | 3.0 MB 00:00 2023-11-24T08:04:17.421 INFO:teuthology.orchestra.run.smithi097.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 2.2 MB/s | 245 kB 00:00 2023-11-24T08:04:17.447 INFO:teuthology.orchestra.run.smithi097.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-24T08:04:17.472 INFO:teuthology.orchestra.run.smithi097.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 749 kB/s | 36 kB 00:00 2023-11-24T08:04:17.522 INFO:teuthology.orchestra.run.smithi097.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 2.5 MB/s | 192 kB 00:00 2023-11-24T08:04:17.556 INFO:teuthology.orchestra.run.smithi097.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 3.1 MB/s | 255 kB 00:00 2023-11-24T08:04:17.581 INFO:teuthology.orchestra.run.smithi097.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 22 kB 00:00 2023-11-24T08:04:17.614 INFO:teuthology.orchestra.run.smithi097.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-24T08:04:17.732 INFO:teuthology.orchestra.run.smithi097.stdout:(145/147): librados2-18.0.0-7484.ga13ea5ff.el9. 4.1 MB/s | 3.3 MB 00:00 2023-11-24T08:04:17.940 INFO:teuthology.orchestra.run.smithi097.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 3.4 MB/s | 1.2 MB 00:00 2023-11-24T08:04:18.215 INFO:teuthology.orchestra.run.smithi097.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 3.6 MB/s | 2.2 MB 00:00 2023-11-24T08:04:18.230 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2023-11-24T08:04:18.230 INFO:teuthology.orchestra.run.smithi097.stdout:Total 13 MB/s | 204 MB 00:15 2023-11-24T08:04:18.449 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2023-11-24T08:04:18.728 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2023-11-24T08:04:20.986 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2023-11-24T08:04:20.987 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2023-11-24T08:04:23.534 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-11-24T08:04:23.675 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T08:04:23.977 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T08:04:24.046 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T08:04:24.078 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T08:04:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T08:04:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T08:04:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T08:04:24.824 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T08:04:24.850 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T08:04:24.970 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T08:04:25.034 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T08:04:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T08:04:25.421 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T08:04:25.480 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T08:04:25.505 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T08:04:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T08:04:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T08:04:25.748 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T08:04:26.095 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T08:04:26.320 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T08:04:26.408 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T08:04:26.632 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T08:04:26.708 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T08:04:27.165 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T08:04:27.212 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T08:04:27.311 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T08:04:27.325 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2023-11-24T08:04:27.395 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T08:04:27.431 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T08:04:27.498 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T08:04:27.511 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T08:04:27.530 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T08:04:27.568 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T08:04:27.605 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T08:04:27.666 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T08:04:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T08:04:27.708 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T08:04:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T08:04:27.743 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T08:04:27.850 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T08:04:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T08:04:27.906 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T08:04:27.957 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T08:04:28.059 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T08:04:28.231 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T08:04:28.261 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T08:04:28.317 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T08:04:28.376 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T08:04:28.641 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T08:04:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T08:04:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T08:04:28.851 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T08:04:28.927 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T08:04:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T08:04:29.095 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T08:04:29.148 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T08:04:29.200 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T08:04:29.247 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T08:04:29.302 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T08:04:29.328 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T08:04:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T08:04:29.502 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T08:04:29.529 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T08:04:29.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T08:04:29.645 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T08:04:29.760 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T08:04:29.836 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T08:04:29.972 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T08:04:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T08:04:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T08:04:30.093 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T08:04:30.168 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T08:04:30.178 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T08:04:30.239 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T08:04:30.247 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T08:04:30.287 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T08:04:30.365 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T08:04:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T08:04:30.459 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T08:04:30.488 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T08:04:30.521 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T08:04:30.676 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T08:04:30.728 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T08:04:30.773 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T08:04:30.898 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T08:04:31.036 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T08:04:31.102 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T08:04:31.137 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T08:04:31.151 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T08:04:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T08:04:31.297 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T08:04:31.343 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T08:04:31.347 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T08:04:31.408 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T08:04:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T08:04:31.446 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T08:04:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T08:04:31.513 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T08:04:31.568 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T08:04:31.699 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T08:04:31.744 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T08:04:31.774 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T08:04:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T08:04:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T08:04:32.021 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T08:04:32.140 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T08:04:32.144 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T08:04:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T08:04:32.335 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T08:04:32.388 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T08:04:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T08:04:32.413 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T08:04:32.453 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T08:04:32.497 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T08:04:32.540 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T08:04:32.583 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T08:04:32.658 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T08:04:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T08:04:32.803 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T08:04:32.941 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T08:04:32.994 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T08:04:33.030 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T08:04:33.096 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T08:04:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T08:04:33.141 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T08:04:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T08:04:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T08:04:33.285 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T08:04:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T08:04:33.330 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T08:04:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T08:04:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T08:04:33.462 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T08:04:33.536 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T08:04:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T08:04:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T08:04:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T08:04:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T08:04:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T08:04:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T08:04:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T08:04:34.277 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T08:04:34.350 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T08:04:34.412 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T08:04:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T08:04:34.514 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T08:04:34.561 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T08:04:34.594 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T08:04:34.658 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T08:04:34.659 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T08:04:34.712 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T08:04:34.757 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T08:04:34.890 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T08:04:34.910 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T08:04:34.938 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T08:04:34.940 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T08:04:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T08:04:35.032 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T08:04:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T08:04:35.230 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T08:04:35.282 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T08:04:35.351 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T08:04:35.440 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T08:04:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T08:04:35.779 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T08:04:35.824 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T08:04:35.955 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T08:04:35.959 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T08:04:36.005 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T08:04:36.030 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T08:04:36.071 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T08:04:36.112 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T08:04:36.173 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T08:04:36.216 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T08:04:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T08:04:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T08:04:36.418 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T08:04:36.547 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T08:04:36.595 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T08:04:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T08:04:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T08:04:36.758 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T08:04:36.907 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T08:04:36.964 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T08:04:37.110 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T08:04:37.170 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T08:04:37.491 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T08:04:37.585 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T08:04:37.624 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T08:04:37.655 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T08:04:37.729 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T08:04:37.773 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T08:04:38.126 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T08:04:38.136 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T08:04:38.177 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T08:04:38.177 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T08:04:38.211 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T08:04:38.244 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T08:04:38.298 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T08:04:38.324 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T08:04:38.379 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T08:04:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T08:04:38.617 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T08:04:38.853 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T08:04:38.888 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T08:04:38.971 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T08:04:38.998 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T08:04:39.402 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T08:04:39.535 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T08:04:41.070 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T08:04:41.171 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T08:04:41.209 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T08:04:41.240 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T08:04:41.281 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T08:04:41.326 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T08:04:41.412 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T08:04:41.453 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T08:04:41.688 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T08:04:41.720 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T08:04:41.873 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T08:04:41.901 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T08:04:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T08:04:42.073 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T08:04:42.115 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T08:04:42.273 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T08:04:42.274 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T08:04:42.274 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T08:04:42.274 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:42.316 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T08:04:42.433 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T08:04:42.457 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T08:04:42.531 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T08:04:42.575 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T08:04:45.022 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T08:04:45.642 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T08:04:45.692 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T08:04:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T08:04:45.843 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T08:04:45.843 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T08:04:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:04:45.885 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T08:04:54.728 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T08:04:54.729 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2023-11-24T08:04:54.729 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2023-11-24T08:04:54.729 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2023-11-24T08:04:54.729 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2023-11-24T08:04:54.729 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2023-11-24T08:04:54.729 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2023-11-24T08:04:54.729 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2023-11-24T08:04:54.730 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:54.945 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T08:04:55.009 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T08:04:55.009 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:04:55.009 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T08:04:55.009 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:56.749 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T08:04:56.833 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T08:04:56.833 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:04:56.833 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T08:04:56.833 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T08:04:56.833 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T08:04:56.833 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:57.058 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T08:04:57.131 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T08:04:57.131 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:04:57.131 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T08:04:57.131 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T08:04:57.132 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T08:04:57.132 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:57.608 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T08:04:57.679 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T08:04:57.680 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:04:57.680 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T08:04:57.680 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T08:04:57.680 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T08:04:57.680 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:04:57.802 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T08:04:58.148 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /sys 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /proc 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /mnt 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /var/tmp 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /home 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /root 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /tmp 2023-11-24T08:04:58.149 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:04:58.376 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T08:04:58.426 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T08:04:58.428 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T08:04:58.428 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:04:58.428 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T08:04:58.428 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:04:58.486 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T08:04:58.534 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T08:04:58.639 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T08:04:58.665 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T08:04:58.983 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T08:04:59.024 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T08:05:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T08:05:00.151 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T08:05:00.183 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T08:05:00.209 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T08:05:00.210 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:00.210 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T08:05:00.210 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T08:05:00.210 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T08:05:00.210 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:00.324 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T08:05:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T08:05:00.510 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T08:05:00.513 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T08:05:00.513 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:00.513 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T08:05:00.513 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T08:05:00.513 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T08:05:00.514 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:00.544 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T08:05:00.627 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T08:05:00.628 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:00.628 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T08:05:00.628 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T08:05:00.628 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T08:05:00.628 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:00.686 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T08:05:00.724 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T08:05:00.850 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T08:05:01.003 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T08:05:01.071 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T08:05:01.071 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:01.071 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T08:05:01.071 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:01.199 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T08:05:01.707 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T08:05:01.746 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T08:05:01.827 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T08:05:01.827 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:01.827 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T08:05:01.827 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:05:01.827 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:05:01.827 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:01.831 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T08:05:01.874 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T08:05:01.880 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T08:05:01.920 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T08:05:01.979 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T08:05:01.979 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:01.979 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T08:05:01.979 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:02.015 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T08:05:02.053 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T08:05:02.056 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T08:05:02.164 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T08:05:02.165 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:02.165 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T08:05:02.165 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:05:02.165 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:05:02.165 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:02.364 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T08:05:02.396 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T08:05:02.620 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T08:05:02.620 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:02.620 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T08:05:02.620 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T08:05:02.620 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T08:05:02.620 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:03.504 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T08:05:03.538 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T08:05:03.682 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T08:05:03.878 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T08:05:03.907 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T08:05:03.980 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T08:05:03.980 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:03.980 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T08:05:03.980 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T08:05:03.980 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T08:05:03.980 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:04.033 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T08:05:04.072 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T08:05:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T08:05:05.053 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T08:05:05.093 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T08:05:05.166 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T08:05:05.166 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:05.166 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T08:05:05.166 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:05:05.166 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:05:05.166 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:05.219 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T08:05:05.309 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T08:05:05.309 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:05.310 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T08:05:05.310 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:05.378 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T08:05:05.482 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T08:05:05.483 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:05.483 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T08:05:05.483 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:05:05.483 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:05:05.483 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T08:05:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T08:05:05.935 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T08:05:05.935 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T08:05:05.935 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T08:05:05.935 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T08:05:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:06.754 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T08:05:06.799 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T08:05:06.854 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T08:05:06.885 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T08:05:07.183 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T08:05:07.302 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T08:05:07.356 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T08:05:07.390 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T08:05:07.422 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T08:05:07.457 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T08:05:07.554 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T08:05:07.617 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T08:05:07.658 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T08:05:08.615 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T08:05:08.665 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T08:05:08.722 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T08:05:10.035 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T08:05:10.067 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T08:05:10.113 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T08:05:10.156 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T08:05:10.197 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T08:05:10.211 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T08:05:10.233 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T08:05:10.286 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T08:05:10.433 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T08:05:10.473 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T08:05:10.506 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T08:05:10.511 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T08:05:10.541 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T08:05:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T08:05:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T08:05:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T08:05:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T08:05:10.715 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T08:05:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T08:05:10.766 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T08:05:10.786 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T08:05:10.822 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T08:05:10.837 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T08:05:10.870 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T08:05:10.870 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T08:05:10.934 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T08:05:10.999 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T08:05:11.031 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T08:05:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T08:05:11.073 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T08:05:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T08:05:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T08:05:11.420 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T08:05:11.420 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T08:05:11.574 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T08:05:11.615 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T08:05:11.641 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T08:05:11.674 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T08:05:11.814 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T08:05:12.075 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T08:05:12.075 INFO:teuthology.orchestra.run.smithi183.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T08:05:12.075 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:12.152 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T08:05:12.197 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T08:05:12.252 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T08:05:13.558 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T08:05:13.731 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T08:05:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T08:05:14.032 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T08:05:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T08:05:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T08:05:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T08:05:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T08:05:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T08:05:14.348 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T08:05:14.398 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T08:05:14.445 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T08:05:14.477 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T08:05:14.478 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T08:05:14.607 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T08:05:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T08:05:14.677 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T08:05:14.677 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T08:05:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T08:05:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T08:05:15.212 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T08:05:15.248 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T08:05:15.282 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T08:05:15.316 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T08:05:15.443 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T08:05:15.706 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T08:05:15.706 INFO:teuthology.orchestra.run.smithi097.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T08:05:15.707 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:16.816 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T08:05:16.816 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T08:05:16.817 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T08:05:16.818 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T08:05:16.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T08:05:16.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T08:05:16.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T08:05:16.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T08:05:16.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T08:05:16.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T08:05:16.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T08:05:16.833 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T08:05:16.834 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T08:05:16.835 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T08:05:16.836 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T08:05:16.837 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T08:05:16.838 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T08:05:16.839 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T08:05:16.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T08:05:16.841 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T08:05:16.841 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T08:05:16.841 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T08:05:16.841 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T08:05:19.101 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T08:05:19.101 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:19.101 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-11-24T08:05:19.101 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:19.101 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:19.101 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:19.101 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:19.102 INFO:teuthology.orchestra.run.smithi183.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T08:05:19.102 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T08:05:19.102 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T08:05:19.102 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T08:05:19.102 INFO:teuthology.orchestra.run.smithi183.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T08:05:19.102 INFO:teuthology.orchestra.run.smithi183.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T08:05:19.102 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T08:05:19.103 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.104 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.105 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T08:05:19.106 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: jq-1.6-16.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T08:05:19.107 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T08:05:19.108 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T08:05:19.109 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T08:05:19.110 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T08:05:19.110 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T08:05:19.110 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T08:05:19.110 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T08:05:19.110 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T08:05:19.110 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T08:05:19.110 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.111 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T08:05:19.112 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T08:05:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T08:05:19.114 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T08:05:19.115 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T08:05:19.116 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T08:05:19.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T08:05:19.118 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T08:05:19.119 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T08:05:19.119 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T08:05:19.119 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T08:05:19.119 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T08:05:19.119 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T08:05:19.119 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:19.120 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-11-24T08:05:19.700 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T08:05:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T08:05:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T08:05:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T08:05:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T08:05:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T08:05:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T08:05:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T08:05:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T08:05:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T08:05:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T08:05:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T08:05:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T08:05:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T08:05:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T08:05:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T08:05:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T08:05:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T08:05:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T08:05:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T08:05:22.712 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T08:05:22.713 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.714 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T08:05:22.715 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: jq-1.6-16.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.716 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T08:05:22.717 INFO:teuthology.orchestra.run.smithi097.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T08:05:22.718 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T08:05:22.719 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T08:05:22.720 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T08:05:22.721 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.722 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.723 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T08:05:22.724 INFO:teuthology.orchestra.run.smithi097.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T08:05:22.724 INFO:teuthology.orchestra.run.smithi097.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T08:05:22.724 INFO:teuthology.orchestra.run.smithi097.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T08:05:22.724 INFO:teuthology.orchestra.run.smithi097.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T08:05:22.724 INFO:teuthology.orchestra.run.smithi097.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T08:05:22.724 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T08:05:22.724 INFO:teuthology.orchestra.run.smithi097.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T08:05:22.725 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:22.725 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2023-11-24T08:05:23.348 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:23.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:05:23.497 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T08:05:23.557 INFO:teuthology.orchestra.run.smithi097.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T08:05:23.558 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T08:05:23.558 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T08:05:23.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:05:23.777 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T08:05:23.843 INFO:teuthology.orchestra.run.smithi183.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T08:05:23.844 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T08:05:23.844 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T08:05:23.844 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T08:05:23.844 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:23.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T08:05:23.930 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:23.930 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T08:05:24.009 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T08:05:24.009 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:24.010 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T08:05:24.084 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T08:05:24.202 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:24.202 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T08:05:24.289 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T08:05:24.408 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T08:05:24.408 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:24.408 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T08:05:24.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T08:05:24.611 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:24.612 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T08:05:24.690 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T08:05:24.802 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T08:05:24.802 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:24.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T08:05:24.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T08:05:25.006 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:25.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T08:05:25.089 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T08:05:25.206 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T08:05:25.272 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T08:05:25.273 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2023-11-24T08:05:25.280 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-11-24T08:05:25.362 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T08:05:25.363 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T08:05:25.367 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T08:05:25.457 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T08:05:25.457 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T08:05:25.463 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T08:05:25.545 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T08:05:25.545 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T08:05:25.545 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T08:05:25.545 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:25.545 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T08:05:25.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:25.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:25.869 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:25.869 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T08:05:25.915 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:26.174 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:26.280 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T08:05:26.280 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T08:05:26.281 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}', 'email': None, 'first_in_suite': False, 'job_id': '7465583', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-tests', 'sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9764, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-tests', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNj/Q+XzPTzQh4YeOrpq7cp5fQgcIqmxw09S5DRAXHWKDHAJeGN2B62rS/F+NlvAjXihUPMgzxruiDaYYDBUu6s=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2jbnTgFWWyS3hgRkhI4wivbPVBPcBaeh1trxn73JT6JR2bGccc0/+77lrdqIoyBiIEbah/aUxaZR5TMFK6IMg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_07:31:48', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T08:05:26.281 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T08:05:26.286 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T08:05:26.346 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T08:05:26.373 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T08:05:26.456 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:26.457 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T08:05:26.496 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T08:05:26.497 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2023-11-24T08:05:26.577 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T08:05:26.577 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:26.577 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-11-24T08:05:26.578 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:26.578 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:26.578 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-11-24 08:05:16.189193930 +0000 2023-11-24T08:05:26.578 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-11-24 08:02:39.601919742 +0000 2023-11-24T08:05:26.578 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-11-24 08:02:39.601919742 +0000 2023-11-24T08:05:26.578 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-11-24 08:02:39.601919742 +0000 2023-11-24T08:05:26.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T08:05:26.689 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-11-24T08:05:26.690 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-11-24T08:05:26.690 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000349587 s, 1.5 MB/s 2023-11-24T08:05:26.693 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T08:05:26.735 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2023-11-24T08:05:26.814 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-11-24 08:05:16.190193913 +0000 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-11-24 08:02:40.593902787 +0000 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-11-24 08:02:40.593902787 +0000 2023-11-24T08:05:26.815 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-11-24 08:02:40.593902787 +0000 2023-11-24T08:05:26.815 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T08:05:26.922 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-11-24T08:05:26.922 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-11-24T08:05:26.922 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00028029 s, 1.8 MB/s 2023-11-24T08:05:26.925 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T08:05:26.970 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2023-11-24T08:05:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-11-24 08:05:16.193193862 +0000 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-11-24 08:02:41.607885456 +0000 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-11-24 08:02:41.607885456 +0000 2023-11-24T08:05:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-11-24 08:02:41.607885456 +0000 2023-11-24T08:05:27.061 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T08:05:27.170 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-11-24T08:05:27.171 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-11-24T08:05:27.171 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000297468 s, 1.7 MB/s 2023-11-24T08:05:27.173 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T08:05:27.214 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2023-11-24T08:05:27.294 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T08:05:27.294 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:27.295 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-11-24T08:05:27.295 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:27.295 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:27.295 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-11-24 08:05:16.194193845 +0000 2023-11-24T08:05:27.295 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-11-24 08:02:42.625868057 +0000 2023-11-24T08:05:27.295 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-11-24 08:02:42.625868057 +0000 2023-11-24T08:05:27.295 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-11-24 08:02:42.625868057 +0000 2023-11-24T08:05:27.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T08:05:27.402 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-11-24T08:05:27.403 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-11-24T08:05:27.403 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000300061 s, 1.7 MB/s 2023-11-24T08:05:27.406 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T08:05:27.448 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:27.448 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:27.448 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T08:05:27.502 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T08:05:27.502 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-11-24T08:05:27.549 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T08:05:27.549 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:27.549 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 631 Links: 1 2023-11-24T08:05:27.549 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:27.549 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:27.549 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-24 08:05:12.524003883 +0000 2023-11-24T08:05:27.549 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-24 08:02:37.547693734 +0000 2023-11-24T08:05:27.550 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-24 08:02:37.547693734 +0000 2023-11-24T08:05:27.550 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-24 08:02:37.547693734 +0000 2023-11-24T08:05:27.550 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T08:05:27.670 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-24T08:05:27.671 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-24T08:05:27.671 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000306777 s, 1.7 MB/s 2023-11-24T08:05:27.673 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T08:05:27.728 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-11-24T08:05:27.772 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T08:05:27.772 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:27.772 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-11-24T08:05:27.772 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:27.772 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:27.773 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-24 08:05:12.525003856 +0000 2023-11-24T08:05:27.773 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-24 08:02:38.586665588 +0000 2023-11-24T08:05:27.773 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-24 08:02:38.586665588 +0000 2023-11-24T08:05:27.773 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-24 08:02:38.586665588 +0000 2023-11-24T08:05:27.773 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T08:05:27.897 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-24T08:05:27.898 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-24T08:05:27.898 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000283767 s, 1.8 MB/s 2023-11-24T08:05:27.900 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T08:05:27.945 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-11-24T08:05:28.038 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-24 08:05:12.525003856 +0000 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-24 08:02:39.607637930 +0000 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-24 08:02:39.607637930 +0000 2023-11-24T08:05:28.039 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-24 08:02:39.607637930 +0000 2023-11-24T08:05:28.039 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T08:05:28.125 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-24T08:05:28.125 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-24T08:05:28.125 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000354321 s, 1.4 MB/s 2023-11-24T08:05:28.129 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T08:05:28.186 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-11-24T08:05:28.236 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-11-24 08:05:12.526003830 +0000 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-11-24 08:02:40.613610678 +0000 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-11-24 08:02:40.613610678 +0000 2023-11-24T08:05:28.237 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-11-24 08:02:40.613610678 +0000 2023-11-24T08:05:28.237 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T08:05:28.331 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-11-24T08:05:28.331 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-11-24T08:05:28.331 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000389993 s, 1.3 MB/s 2023-11-24T08:05:28.334 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T08:05:28.390 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:28.391 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T08:05:28.391 INFO:tasks.ceph:Generating config... 2023-11-24T08:05:28.392 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T08:05:28.392 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T08:05:28.392 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T08:05:28.392 INFO:tasks.ceph:[client] pid file = 2023-11-24T08:05:28.392 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T08:05:28.393 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T08:05:28.393 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T08:05:28.394 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T08:05:28.394 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T08:05:28.394 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T08:05:28.394 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T08:05:28.394 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T08:05:28.395 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T08:05:28.396 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T08:05:28.396 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T08:05:28.576 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T08:05:28.584 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T08:05:28.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:05:28.855 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97'), ('mon.b', '172.21.15.183'), ('mon.c', '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]')] 2023-11-24T08:05:28.855 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T08:05:28.856 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:28.856 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T08:05:28.908 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --add b 172.21.15.183 --addv c '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:29.064 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:29.064 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid bcc30232-58ca-4ca3-86d0-71be2a8a6471 2023-11-24T08:05:29.064 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = pacific 2023-11-24T08:05:29.064 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2023-11-24T08:05:29.064 INFO:teuthology.orchestra.run.smithi097.stdout:fsid bcc30232-58ca-4ca3-86d0-71be2a8a6471 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2023-11-24T08:05:29.063447+0000 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:created 2023-11-24T08:05:29.063447+0000 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 16 (pacific) 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:2: [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] mon.c 2023-11-24T08:05:29.065 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T08:05:29.067 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T08:05:29.121 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bcc30232-58ca-4ca3-86d0-71be2a8a6471... 2023-11-24T08:05:29.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T08:05:29.127 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T08:05:29.287 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2023-11-24T08:05:29.287 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2023-11-24T08:05:29.288 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2023-11-24T08:05:29.289 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2023-11-24T08:05:29.290 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.97,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = bcc30232-58ca-4ca3-86d0-71be2a8a6471 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2023-11-24T08:05:29.292 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.292 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2023-11-24T08:05:29.292 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2023-11-24T08:05:29.292 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.292 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2023-11-24T08:05:29.292 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2023-11-24T08:05:29.292 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2023-11-24T08:05:29.294 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi097.stdout: debug finisher = 20 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2023-11-24T08:05:29.298 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2023-11-24T08:05:29.299 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:05:29.299 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = "" 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2023-11-24T08:05:29.300 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2023-11-24T08:05:29.301 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-11-24T08:05:29.302 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-11-24T08:05:29.302 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-11-24T08:05:29.304 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.305 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-11-24T08:05:29.306 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.306 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-11-24T08:05:29.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-11-24T08:05:29.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-11-24T08:05:29.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-11-24T08:05:29.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-11-24T08:05:29.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-11-24T08:05:29.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-11-24T08:05:29.307 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T08:05:29.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T08:05:29.308 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-11-24T08:05:29.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.308 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T08:05:29.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.308 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-11-24T08:05:29.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-11-24T08:05:29.309 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-11-24T08:05:29.309 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-11-24T08:05:29.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-11-24T08:05:29.309 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.97,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-11-24T08:05:29.309 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = bcc30232-58ca-4ca3-86d0-71be2a8a6471 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-11-24T08:05:29.310 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-11-24T08:05:29.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-11-24T08:05:29.311 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug trim objects = true 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-11-24T08:05:29.312 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore allocator = bitmap 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-24T08:05:29.314 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug finisher = 20 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-11-24T08:05:29.315 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.316 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-11-24T08:05:29.317 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = "" 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2023-11-24T08:05:29.318 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds balancer = 20 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-11-24T08:05:29.319 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-11-24T08:05:29.320 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-11-24T08:05:29.348 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T08:05:29.349 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T08:05:29.497 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T08:05:29.498 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:29.498 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T08:05:29.549 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:29.549 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T08:05:29.599 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:05:29.600 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:29.600 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T08:05:29.600 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:05:29.745 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:05:29.745 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:29.844 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:05:29.844 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:29.844 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T08:05:29.845 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:05:30.003 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:05:30.003 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:30.101 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T08:05:30.101 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T08:05:30.101 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T08:05:30.295 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T08:05:30.306 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T08:05:30.489 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T08:05:30.499 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T08:05:30.499 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T08:05:30.669 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T08:05:30.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T08:05:30.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T08:05:30.922 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T08:05:30.929 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T08:05:31.020 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T08:05:31.214 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T08:05:31.223 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T08:05:31.317 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T08:05:31.497 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T08:05:31.506 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T08:05:31.598 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T08:05:31.598 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T08:05:31.712 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T08:05:31.756 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T08:05:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T08:05:31.925 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T08:05:32.058 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T08:05:32.108 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T08:05:32.229 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T08:05:32.279 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T08:05:32.279 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T08:05:32.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T08:05:32.381 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:32.381 INFO:tasks.ceph:role: osd.0 2023-11-24T08:05:32.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:05:32.381 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T08:05:32.478 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:32.479 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:32.479 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:32.479 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:32.480 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:32.480 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:32.480 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:32.998 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-11-24T08:05:33.005 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-11-24T08:05:33.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T08:05:33.198 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T08:05:33.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T08:05:33.408 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:33.408 INFO:tasks.ceph:role: osd.1 2023-11-24T08:05:33.408 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:05:33.408 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:33.510 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:34.025 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-11-24T08:05:34.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-11-24T08:05:34.031 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T08:05:34.174 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T08:05:34.272 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T08:05:34.369 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:34.370 INFO:tasks.ceph:role: osd.2 2023-11-24T08:05:34.370 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:05:34.370 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T08:05:34.470 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:34.470 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:34.471 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:34.471 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:34.471 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:34.990 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-11-24T08:05:34.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-11-24T08:05:34.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T08:05:35.200 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T08:05:35.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T08:05:35.399 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:35.399 INFO:tasks.ceph:role: osd.3 2023-11-24T08:05:35.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:05:35.400 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T08:05:35.497 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:35.497 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:35.498 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:35.960 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-11-24T08:05:35.967 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-11-24T08:05:35.967 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T08:05:36.108 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T08:05:36.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:36.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:36.363+0000 7f5e154f6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T08:05:36.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:36.368+0000 7f5e154f6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T08:05:36.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:36.368+0000 7f5e154f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:05:36.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:36.368+0000 7f5e154f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:05:36.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:36.368+0000 7f5e154f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:05:36.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:36.376+0000 7f5e154f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T08:05:39.307 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T08:05:39.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:39.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:39.548+0000 7f46ad01f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T08:05:39.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:39.548+0000 7f46ad01f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T08:05:39.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:39.548+0000 7f46ad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:05:39.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:39.549+0000 7f46ad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:05:39.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:39.549+0000 7f46ad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:05:39.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:39.551+0000 7f46ad01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T08:05:42.720 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T08:05:42.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:42.929+0000 7f40908c7500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T08:05:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:42.930+0000 7f40908c7500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T08:05:42.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:42.930+0000 7f40908c7500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:05:42.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:42.930+0000 7f40908c7500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:05:42.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:42.930+0000 7f40908c7500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:05:42.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:42.932+0000 7f40908c7500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T08:05:45.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T08:05:45.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:46.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:46.107+0000 7f36a1a00500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T08:05:46.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:46.108+0000 7f36a1a00500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T08:05:46.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:46.108+0000 7f36a1a00500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:05:46.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:46.108+0000 7f36a1a00500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:05:46.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:46.108+0000 7f36a1a00500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:05:46.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:05:46.110+0000 7f36a1a00500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T08:05:49.290 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T08:05:49.381 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T08:05:49.484 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:49.484 INFO:tasks.ceph:role: osd.4 2023-11-24T08:05:49.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:05:49.484 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T08:05:49.585 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:49.585 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:49.585 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:49.586 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:49.586 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:49.586 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:49.586 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:49.587 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:49.587 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:49.587 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:50.112 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-24T08:05:50.119 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-24T08:05:50.119 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T08:05:50.302 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T08:05:50.411 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T08:05:50.504 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:50.504 INFO:tasks.ceph:role: osd.5 2023-11-24T08:05:50.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:05:50.505 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T08:05:50.602 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:50.603 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:51.101 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-24T08:05:51.107 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-24T08:05:51.107 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T08:05:51.255 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T08:05:51.345 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T08:05:51.432 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:51.432 INFO:tasks.ceph:role: osd.6 2023-11-24T08:05:51.432 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:05:51.433 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T08:05:51.528 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:51.528 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:51.528 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:51.528 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:51.528 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:51.528 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:51.529 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:51.529 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:51.529 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:51.529 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:52.039 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-24T08:05:52.046 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-24T08:05:52.046 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T08:05:52.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T08:05:52.347 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T08:05:52.444 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:05:52.444 INFO:tasks.ceph:role: osd.7 2023-11-24T08:05:52.444 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:05:52.444 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T08:05:52.548 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:05:52.549 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:05:53.046 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-11-24T08:05:53.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-11-24T08:05:53.052 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T08:05:53.201 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T08:05:53.296 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:53.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:53.445+0000 7fb3abc1f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T08:05:53.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:53.451+0000 7fb3abc1f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T08:05:53.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:53.451+0000 7fb3abc1f500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:05:53.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:53.451+0000 7fb3abc1f500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:05:53.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:53.451+0000 7fb3abc1f500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:05:53.461 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:53.459+0000 7fb3abc1f500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T08:05:56.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:56.292 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:56.637 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T08:05:56.723 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:56.851 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:56.849+0000 7f8396c12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T08:05:56.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:56.850+0000 7f8396c12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T08:05:56.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:56.850+0000 7f8396c12500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:05:56.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:56.850+0000 7f8396c12500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:05:56.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:56.850+0000 7f8396c12500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:05:56.854 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:56.852+0000 7f8396c12500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T08:05:59.764 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T08:05:59.859 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:05:59.999 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:59.997+0000 7fc619f1e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T08:06:00.000 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:59.998+0000 7fc619f1e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T08:06:00.000 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:59.998+0000 7fc619f1e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:06:00.000 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:59.998+0000 7fc619f1e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:06:00.000 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:05:59.998+0000 7fc619f1e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:06:00.001 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:00.000+0000 7fc619f1e500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T08:06:02.930 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T08:06:03.032 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:06:03.173 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:03.170+0000 7fc3e2e1a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T08:06:03.173 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:03.171+0000 7fc3e2e1a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T08:06:03.174 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:03.171+0000 7fc3e2e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:06:03.174 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:03.171+0000 7fc3e2e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:06:03.174 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:03.171+0000 7fc3e2e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:06:03.175 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:03.173+0000 7fc3e2e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T08:06:06.335 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T08:06:06.433 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T08:06:06.434 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:06.434 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T08:06:06.537 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:06.537 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T08:06:06.635 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:06.635 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T08:06:06.731 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:06.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T08:06:06.827 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:06.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T08:06:06.923 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:06.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T08:06:07.018 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:07.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T08:06:07.113 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.113 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T08:06:07.214 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.214 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T08:06:07.309 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.309 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T08:06:07.406 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.406 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T08:06:07.501 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.501 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T08:06:07.579 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.579 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T08:06:07.717 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.717 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T08:06:07.817 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:07.817 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T08:06:07.877 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:07.878 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T08:06:07.931 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.931 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T08:06:07.990 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:07.990 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T08:06:08.044 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T08:06:08.044 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T08:06:08.053 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T08:06:08.144 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2023-11-24T08:06:08.144 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBKWWBllCuPERAArK2zl8RIPMkTlAhzLNlmFA== 2023-11-24T08:06:08.144 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-11-24T08:06:08.144 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBKWWBla6HUJxAAmnmOMozOIiFQLQUkTIKk4A== 2023-11-24T08:06:08.144 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-11-24T08:06:08.144 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBKWWBlc4ntNhAA8Oy8ILhxD8YB1sJLM0mM9g== 2023-11-24T08:06:08.144 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBQWWBlV77EFRAApa17yGQxKKISFGl9bEzKaw== 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBTWWBlXcnIIBAAozoESPVBgIBa+QJ/49tKfQ== 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBWWWBlvSCDNxAAzL+FUVH5G6TJIo7rlMZg2g== 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBaWWBlBwSEBhAA5xnhi7CwH1wlOsB4MCCb+g== 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBKWWBlhUsXHRAA+M4Xqk/1IST3GdY3StZ6BA== 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-11-24T08:06:08.145 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBLWWBlPuK6DBAAJ+xdUoSuQYWaNB5fxT+KUg== 2023-11-24T08:06:08.146 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-11-24T08:06:08.146 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBLWWBlFYGSHRAAADRrXLoK48hPklxyW1WzcA== 2023-11-24T08:06:08.147 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2023-11-24T08:06:08.147 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBhWWBlkjyiGhAAL/ol7qrulBQIf8GyydKJsA== 2023-11-24T08:06:08.147 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2023-11-24T08:06:08.148 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBkWWBlanS2MhAA4xcYdLcg+8q9nM/951rQlQ== 2023-11-24T08:06:08.148 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2023-11-24T08:06:08.148 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBnWWBlCbSAOxAAWc6xWwjfXZYPqnLl9hWeoA== 2023-11-24T08:06:08.148 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2023-11-24T08:06:08.149 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBrWWBlsuI9ChAAHhaUrqmwPt/1+a0DdURzcw== 2023-11-24T08:06:08.149 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-11-24T08:06:08.149 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBLWWBlRHFuKhAAF85SZrFh9cWe6ZO4yGMg/A== 2023-11-24T08:06:08.149 INFO:teuthology.orchestra.run.smithi097.stdout:[client.2] 2023-11-24T08:06:08.150 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBLWWBlI7y0MxAAv+f8hJsc4vckfKJkvIA64A== 2023-11-24T08:06:08.150 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2023-11-24T08:06:08.150 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBMWWBli+FvAxAA6aQ/G1LZRmLYopDOy07vaA== 2023-11-24T08:06:08.150 INFO:teuthology.orchestra.run.smithi097.stdout:[client.3] 2023-11-24T08:06:08.150 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBMWWBl1LOmDRAASwF1bEb4YJvEVJKc0zxJkw== 2023-11-24T08:06:08.151 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2023-11-24T08:06:08.151 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBKWWBllCuPERAArK2zl8RIPMkTlAhzLNlmFA== 2023-11-24T08:06:08.151 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-11-24T08:06:08.151 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBKWWBla6HUJxAAmnmOMozOIiFQLQUkTIKk4A== 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBKWWBlc4ntNhAA8Oy8ILhxD8YB1sJLM0mM9g== 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBQWWBlV77EFRAApa17yGQxKKISFGl9bEzKaw== 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBTWWBlXcnIIBAAozoESPVBgIBa+QJ/49tKfQ== 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBWWWBlvSCDNxAAzL+FUVH5G6TJIo7rlMZg2g== 2023-11-24T08:06:08.152 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBaWWBlBwSEBhAA5xnhi7CwH1wlOsB4MCCb+g== 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBKWWBlhUsXHRAA+M4Xqk/1IST3GdY3StZ6BA== 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBLWWBlPuK6DBAAJ+xdUoSuQYWaNB5fxT+KUg== 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBLWWBlFYGSHRAAADRrXLoK48hPklxyW1WzcA== 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBhWWBlkjyiGhAAL/ol7qrulBQIf8GyydKJsA== 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBkWWBlanS2MhAA4xcYdLcg+8q9nM/951rQlQ== 2023-11-24T08:06:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBnWWBlCbSAOxAAWc6xWwjfXZYPqnLl9hWeoA== 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBrWWBlsuI9ChAAHhaUrqmwPt/1+a0DdURzcw== 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBLWWBlRHFuKhAAF85SZrFh9cWe6ZO4yGMg/A== 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout:[client.2] 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBLWWBlI7y0MxAAv+f8hJsc4vckfKJkvIA64A== 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout:[client.1] 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBMWWBli+FvAxAA6aQ/G1LZRmLYopDOy07vaA== 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout:[client.3] 2023-11-24T08:06:08.154 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBMWWBl1LOmDRAASwF1bEb4YJvEVJKc0zxJkw== 2023-11-24T08:06:08.156 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:06:08.162 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:06:08.304 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:08.312 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:08.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:08.458 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:08.608 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:08.615 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:08.757 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:08.763 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:08.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:08.911 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.054 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.194 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:06:09.203 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:06:09.340 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:09.348 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:09.486 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:09.491 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:06:09.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.642 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.786 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:09.934 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:10.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:10.073 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:06:10.216 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.222 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.367 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.510 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.515 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.663 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.669 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:06:10.807 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T08:06:10.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T08:06:10.899 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:06:11.058 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T08:06:11.133 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T08:06:11.235 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:06:11.393 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T08:06:11.482 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T08:06:11.574 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:06:11.731 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T08:06:11.814 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:06:11.822 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:06:11.875 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T08:06:11.875 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T08:06:11.876 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T08:06:11.881 INFO:tasks.ceph.mon.a:Started 2023-11-24T08:06:11.881 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T08:06:11.881 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T08:06:11.886 INFO:tasks.ceph.mon.b:Started 2023-11-24T08:06:11.886 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T08:06:11.887 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T08:06:11.891 INFO:tasks.ceph.mon.c:Started 2023-11-24T08:06:11.891 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T08:06:11.892 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T08:06:11.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T08:06:11.897 INFO:tasks.ceph.mgr.y:Started 2023-11-24T08:06:11.897 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T08:06:11.897 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T08:06:11.903 INFO:tasks.ceph.mgr.x:Started 2023-11-24T08:06:11.903 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T08:06:11.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T08:06:12.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.079+0000 7f7e44da5640 1 Processor -- start 2023-11-24T08:06:12.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.079+0000 7f7e44da5640 1 -- start start 2023-11-24T08:06:12.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e44da5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:12.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e44da5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:12.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e44da5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e400d1be0 con 0x7f7e400b2230 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e44da5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400ce980 con 0x7f7e400d13e0 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e44da5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400d0bf0 con 0x7f7e4015d880 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e35d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7e400b2230 0x7f7e400cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40332/0 (socket says 172.21.15.97:40332) 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 learned_addr learned my addr 172.21.15.97:0/619427344 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.080+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:12.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:12.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.081+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.282+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.282+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:12.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.283+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:06:12.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.684+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.684+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.684+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.684+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.684+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.684+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.685+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.685+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.685+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:12.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:12.685+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:06:13.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.485+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:13.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.486+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:06:13.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.486+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:13.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.486+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:13.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.486+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:06:13.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.486+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:13.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.487+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:13.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.487+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:13.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.487+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:13.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:13.487+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:06:15.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e400d3260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:06:15.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e400d3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:15.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e400d37a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:06:15.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e400d37a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:15.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> v1:172.21.15.97:6789/0 conn(0x7f7e400b2230 legacy=0x7f7e400cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:15.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:15.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e400d23f0 con 0x7f7e200036e0 2023-11-24T08:06:15.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.080+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400d0bf0 con 0x7f7e20007350 2023-11-24T08:06:15.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.081+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:15.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.081+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:15.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.081+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:15.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.081+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:15.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.082+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:06:15.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.283+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:15.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.283+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:15.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.284+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:15.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.284+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:15.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.284+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:06:15.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.685+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:15.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.685+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:15.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.685+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:15.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.685+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:15.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:15.686+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:06:16.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:16.487+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:16.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:16.488+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:16.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:16.488+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:16.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:16.488+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:16.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:16.488+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:06:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 msgr2=0x7f7e20009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:06:19.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007350 0x7f7e20009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:19.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> v1:172.21.15.183:6789/0 conn(0x7f7e200036e0 legacy=0x7f7e20005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:19.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 reap_dead start 2023-11-24T08:06:19.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:19.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:19.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2000af10 con 0x7f7e400b2230 2023-11-24T08:06:19.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400d0bf0 con 0x7f7e400d13e0 2023-11-24T08:06:19.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20007800 con 0x7f7e4015d880 2023-11-24T08:06:19.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.082+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:19.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.284+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.685+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.685+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:18.686+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:19.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:19.488+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:06:21.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 msgr2=0x7f7e20012220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:06:21.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e4015d880 0x7f7e20012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 msgr2=0x7f7e2000a720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:06:21.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.183:3300/0 conn(0x7f7e400d13e0 0x7f7e2000a720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:21.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 >> v1:172.21.15.97:6789/0 conn(0x7f7e400b2230 legacy=0x7f7e20009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:21.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:21.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e20007990 con 0x7f7e200061a0 2023-11-24T08:06:21.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.081+0000 7f7e3cd99640 1 -- 172.21.15.97:0/619427344 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400d0bf0 con 0x7f7e20007ba0 2023-11-24T08:06:21.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.082+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.082+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 msgr2=0x7f7e20005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:06:21.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.083+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 msgr2=0x7f7e20005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:21.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.083+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:21.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.083+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:06:21.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.284+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.284+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 msgr2=0x7f7e20005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:06:21.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.284+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 msgr2=0x7f7e20005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:21.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.284+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:21.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.284+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:06:21.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.685+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:21.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.686+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 msgr2=0x7f7e20005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:06:21.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.686+0000 7f7e3e59c640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 msgr2=0x7f7e20005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:06:21.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.686+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:06:21.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:21.686+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:06:22.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.359+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147393036 0 0) 0x7f7e20007990 con 0x7f7e200061a0 2023-11-24T08:06:22.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.359+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c003520 con 0x7f7e200061a0 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494465029 0 0) 0x7f7e2c003520 con 0x7f7e200061a0 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 msgr2=0x7f7e20005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 --2- 172.21.15.97:0/619427344 >> v2:172.21.15.97:3300/0 conn(0x7f7e20007ba0 0x7f7e20005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20006dd0 con 0x7f7e200061a0 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f7e28001260 con 0x7f7e200061a0 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 >> v1:172.21.15.183:6789/0 conn(0x7f7e200061a0 legacy=0x7f7e200065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3ed9d640 1 -- 172.21.15.97:0/619427344 reap_dead start 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c003970 0x7f7e2c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c0047c0 0x7f7e2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c005250 0x7f7e2c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.360+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400d0bf0 con 0x7f7e2c003970 2023-11-24T08:06:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.361+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c00c1a0 con 0x7f7e2c0047c0 2023-11-24T08:06:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.361+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c00c360 con 0x7f7e2c005250 2023-11-24T08:06:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.361+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c0047c0 0x7f7e2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.362+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c003970 0x7f7e2c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.362+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c005250 0x7f7e2c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.362+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c005250 msgr2=0x7f7e2c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.362+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c005250 0x7f7e2c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.363+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c003970 msgr2=0x7f7e2c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.363+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c003970 0x7f7e2c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.363+0000 7f7e35d9b640 1 -- 172.21.15.97:0/619427344 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c003520 con 0x7f7e2c0047c0 2023-11-24T08:06:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.364+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c0047c0 0x7f7e2c004c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7e28007380 tx=0x7f7e2c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5f0968014ab5d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:22.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.366+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2802e860 con 0x7f7e2c0047c0 2023-11-24T08:06:22.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.366+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28032070 con 0x7f7e2c0047c0 2023-11-24T08:06:22.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.366+0000 7f7e3dd9b640 1 -- 172.21.15.97:0/619427344 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2802ec60 con 0x7f7e2c0047c0 2023-11-24T08:06:22.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.367+0000 7f7e44da5640 1 -- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c0047c0 msgr2=0x7f7e2c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:22.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.367+0000 7f7e44da5640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c0047c0 0x7f7e2c004c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7e28007380 tx=0x7f7e2c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.367+0000 7f7e44da5640 1 -- 172.21.15.97:0/619427344 shutdown_connections 2023-11-24T08:06:22.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.367+0000 7f7e44da5640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c005250 0x7f7e2c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.367+0000 7f7e44da5640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c0047c0 0x7f7e2c004c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.367+0000 7f7e44da5640 1 --2- 172.21.15.97:0/619427344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c003970 0x7f7e2c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.367+0000 7f7e44da5640 1 -- 172.21.15.97:0/619427344 >> 172.21.15.97:0/619427344 conn(0x7f7e4008cce0 msgr2=0x7f7e4009c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:22.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.368+0000 7f7e44da5640 1 -- 172.21.15.97:0/619427344 shutdown_connections 2023-11-24T08:06:22.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.368+0000 7f7e44da5640 1 -- 172.21.15.97:0/619427344 wait complete. 2023-11-24T08:06:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.370+0000 7f7e44da5640 1 Processor -- start 2023-11-24T08:06:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.371+0000 7f7e44da5640 1 -- start start 2023-11-24T08:06:22.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e44da5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c003970 0x7f7e4014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:22.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e44da5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c0047c0 0x7f7e400b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:22.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e44da5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c005250 0x7f7e401f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e44da5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4014a680 con 0x7f7e2c0047c0 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e44da5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e401f3af0 con 0x7f7e2c005250 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e44da5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e401f3dd0 con 0x7f7e2c003970 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e35d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c0047c0 0x7f7e400b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e35d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c0047c0 0x7f7e400b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:59100/0 (socket says 172.21.15.97:59100) 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.372+0000 7f7e35d9b640 1 -- 172.21.15.97:0/656919013 learned_addr learned my addr 172.21.15.97:0/656919013 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e3ed9d640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c005250 0x7f7e401f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e3e59c640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c003970 0x7f7e4014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:22.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e35d9b640 1 -- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c003970 msgr2=0x7f7e4014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:22.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c003970 0x7f7e4014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e35d9b640 1 -- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c005250 msgr2=0x7f7e401f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:22.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c005250 0x7f7e401f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e35d9b640 1 -- 172.21.15.97:0/656919013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4014a310 con 0x7f7e2c0047c0 2023-11-24T08:06:22.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.373+0000 7f7e35d9b640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c0047c0 0x7f7e400b8660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7e28000c00 tx=0x7f7e28001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:22.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.374+0000 7f7e377fe640 1 -- 172.21.15.97:0/656919013 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28001200 con 0x7f7e2c0047c0 2023-11-24T08:06:22.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.374+0000 7f7e377fe640 1 -- 172.21.15.97:0/656919013 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28007930 con 0x7f7e2c0047c0 2023-11-24T08:06:22.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.374+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4014b050 con 0x7f7e2c0047c0 2023-11-24T08:06:22.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.374+0000 7f7e377fe640 1 -- 172.21.15.97:0/656919013 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28005450 con 0x7f7e2c0047c0 2023-11-24T08:06:22.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.374+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e400b8ba0 con 0x7f7e2c0047c0 2023-11-24T08:06:22.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.375+0000 7f7e377fe640 1 -- 172.21.15.97:0/656919013 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e280055b0 con 0x7f7e2c0047c0 2023-11-24T08:06:22.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.375+0000 7f7e377fe640 1 -- 172.21.15.97:0/656919013 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7e28041440 con 0x7f7e2c0047c0 2023-11-24T08:06:22.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.376+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4014a7f0 con 0x7f7e2c0047c0 2023-11-24T08:06:22.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.380+0000 7f7e377fe640 1 -- 172.21.15.97:0/656919013 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7e28045020 con 0x7f7e2c0047c0 2023-11-24T08:06:22.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.454+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7e4014a7f0 con 0x7f7e2c0047c0 2023-11-24T08:06:22.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.458+0000 7f7e377fe640 1 -- 172.21.15.97:0/656919013 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7e28058090 con 0x7f7e2c0047c0 2023-11-24T08:06:22.462 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2023-11-24T08:06:22.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c0047c0 msgr2=0x7f7e400b8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:22.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c0047c0 0x7f7e400b8660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7e28000c00 tx=0x7f7e28001120 comp rx=0 tx=0).stop 2023-11-24T08:06:22.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 shutdown_connections 2023-11-24T08:06:22.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e2c005250 0x7f7e401f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e2c0047c0 0x7f7e400b8660 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 --2- 172.21.15.97:0/656919013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e2c003970 0x7f7e4014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:22.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 >> 172.21.15.97:0/656919013 conn(0x7f7e4008cce0 msgr2=0x7f7e4015b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:22.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 shutdown_connections 2023-11-24T08:06:22.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:22.460+0000 7f7e44da5640 1 -- 172.21.15.97:0/656919013 wait complete. 2023-11-24T08:06:22.480 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T08:06:22.481 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T08:06:22.481 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:22.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T08:06:22.571 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:22.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T08:06:22.696 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:22.696 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T08:06:22.774 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:06:22.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T08:06:22.904 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:22.904 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T08:06:22.954 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:22.952+0000 7f965a456040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:06:22.999 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:22.999 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T08:06:23.012 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:23.010+0000 7f965a456040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:06:23.085 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:23.086 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T08:06:23.093 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:23.092+0000 7f4e7e44c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:06:23.159 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:23.158+0000 7f4e7e44c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:06:23.176 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:06:23.176 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T08:06:23.308 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 05f88460-1812-46e4-8211-b9a58577f862 0 2023-11-24T08:06:23.493 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.492+0000 7f711212c640 1 Processor -- start 2023-11-24T08:06:23.493 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.492+0000 7f711212c640 1 -- start start 2023-11-24T08:06:23.494 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.493+0000 7f711212c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f710c0ce8f0 0x7f710c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.494 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.493+0000 7f711212c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710c0d0de0 con 0x7f710c160f80 2023-11-24T08:06:23.494 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.493+0000 7f711212c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710c0d10c0 con 0x7f710c0b2a00 2023-11-24T08:06:23.494 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.493+0000 7f711212c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710c0d13a0 con 0x7f710c0ce8f0 2023-11-24T08:06:23.495 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.493+0000 7f710bfff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f710c0b2a00 0x7f710c0b2e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57228/0 (socket says 172.21.15.183:57228) 2023-11-24T08:06:23.495 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.493+0000 7f710bfff640 1 -- 172.21.15.183:0/2019429950 learned_addr learned my addr 172.21.15.183:0/2019429950 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-11-24T08:06:23.496 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f7103fff640 1 --2- 172.21.15.183:0/2019429950 >> v2:172.21.15.97:3300/0 conn(0x7f710c0ce8f0 0x7f710c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256453502 0 0) 0x7f710c0d10c0 con 0x7f710c0b2a00 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f8003520 con 0x7f710c0b2a00 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104062182 0 0) 0x7f70f8003520 con 0x7f710c0b2a00 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 >> v2:172.21.15.97:3300/0 conn(0x7f710c0ce8f0 msgr2=0x7f710c0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 --2- 172.21.15.183:0/2019429950 >> v2:172.21.15.97:3300/0 conn(0x7f710c0ce8f0 0x7f710c0ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 >> v1:172.21.15.97:6789/0 conn(0x7f710c160f80 legacy=0x7f710c161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0d1680 con 0x7f710c0b2a00 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f71040019f0 con 0x7f710c0b2a00 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 >> v1:172.21.15.183:6789/0 conn(0x7f710c0b2a00 legacy=0x7f710c0b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.497 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f8003970 0x7f70f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f80047c0 0x7f70f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f8005180 0x7f70f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0d13a0 con 0x7f70f8005180 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f800c020 con 0x7f70f80047c0 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.494+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f800c1e0 con 0x7f70f8003970 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710b7fe640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f8003970 0x7f70f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f7103fff640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f80047c0 0x7f70f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710bfff640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f8005180 0x7f70f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710b7fe640 1 -- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f80047c0 msgr2=0x7f70f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:23.498 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710b7fe640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f80047c0 0x7f70f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.499 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710b7fe640 1 -- 172.21.15.183:0/2019429950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f8005180 msgr2=0x7f70f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:23.499 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710b7fe640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f8005180 0x7f70f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.499 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710b7fe640 1 -- 172.21.15.183:0/2019429950 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8003520 con 0x7f70f8003970 2023-11-24T08:06:23.499 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710bfff640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f8005180 0x7f70f800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:23.499 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.495+0000 7f710bfff640 1 -- 172.21.15.183:0/2019429950 reap_dead start 2023-11-24T08:06:23.500 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.496+0000 7f710b7fe640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f8003970 0x7f70f8003d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70fc001750 tx=0x7f70f80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6235938bd051a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:23.500 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.496+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0052d0 con 0x7f70f8003970 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.496+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc02e050 con 0x7f70f8003970 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.496+0000 7f710affd640 1 -- 172.21.15.183:0/2019429950 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc003830 con 0x7f70f8003970 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.497+0000 7f711212c640 1 -- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f8003970 msgr2=0x7f70f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.497+0000 7f711212c640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f8003970 0x7f70f8003d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70fc001750 tx=0x7f70f80057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.497+0000 7f711212c640 1 -- 172.21.15.183:0/2019429950 shutdown_connections 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.497+0000 7f711212c640 1 --2- 172.21.15.183:0/2019429950 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f8003970 0x7f70f8003d90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.497+0000 7f711212c640 1 -- 172.21.15.183:0/2019429950 >> 172.21.15.183:0/2019429950 conn(0x7f710c09c550 msgr2=0x7f710c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.497+0000 7f711212c640 1 -- 172.21.15.183:0/2019429950 shutdown_connections 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.497+0000 7f711212c640 1 -- 172.21.15.183:0/2019429950 wait complete. 2023-11-24T08:06:23.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.499+0000 7f711212c640 1 Processor -- start 2023-11-24T08:06:23.502 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.499+0000 7f711212c640 1 -- start start 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f711212c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f8003970 0x7f710c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f711212c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f710c0c7c90 0x7f710c1f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f711212c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f710c1f67e0 0x7f710c1f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f711212c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c1f4850 con 0x7f710c1f67e0 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f711212c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0c8130 con 0x7f70f8003970 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f711212c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0c8410 con 0x7f710c0c7c90 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f710b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f8003970 0x7f710c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f7103fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f710c0c7c90 0x7f710c1f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f710b7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f8003970 0x7f710c0c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38578/0 (socket says 172.21.15.183:38578) 2023-11-24T08:06:23.504 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f710b7fe640 1 -- 172.21.15.183:0/2619075237 learned_addr learned my addr 172.21.15.183:0/2619075237 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:23.505 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.500+0000 7f710bfff640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f710c1f67e0 0x7f710c1f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.505 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f710b7fe640 1 -- 172.21.15.183:0/2619075237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f710c0c7c90 msgr2=0x7f710c1f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.505 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f710b7fe640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f710c0c7c90 0x7f710c1f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.505 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f710b7fe640 1 -- 172.21.15.183:0/2619075237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f710c1f67e0 msgr2=0x7f710c1f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.505 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f710b7fe640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f710c1f67e0 0x7f710c1f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.505 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f710b7fe640 1 -- 172.21.15.183:0/2619075237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0c86f0 con 0x7f70f8003970 2023-11-24T08:06:23.505 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f710bfff640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f710c1f67e0 0x7f710c1f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f710b7fe640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f8003970 0x7f710c0c7750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70fc02bc00 tx=0x7f70fc001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f7108ff9640 1 -- 172.21.15.183:0/2619075237 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0076c0 con 0x7f70f8003970 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f7108ff9640 1 -- 172.21.15.183:0/2619075237 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc007a30 con 0x7f70f8003970 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f7108ff9640 1 -- 172.21.15.183:0/2619075237 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc006be0 con 0x7f70f8003970 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.501+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c0c89d0 con 0x7f70f8003970 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.502+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c0ccc60 con 0x7f70f8003970 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.502+0000 7f7108ff9640 1 -- 172.21.15.183:0/2619075237 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70fc0038f0 con 0x7f70f8003970 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.502+0000 7f7108ff9640 1 -- 172.21.15.183:0/2619075237 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f70fc03d740 con 0x7f70f8003970 2023-11-24T08:06:23.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.503+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c0675d0 con 0x7f70f8003970 2023-11-24T08:06:23.507 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.506+0000 7f7108ff9640 1 -- 172.21.15.183:0/2619075237 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f70fc041020 con 0x7f70f8003970 2023-11-24T08:06:23.585 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.584+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05f88460-1812-46e4-8211-b9a58577f862", "id": 0} v 0) v1 -- 0x7f710c0b25d0 con 0x7f70f8003970 2023-11-24T08:06:23.592 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.591+0000 7f7108ff9640 1 -- 172.21.15.183:0/2619075237 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05f88460-1812-46e4-8211-b9a58577f862", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70fc001370 con 0x7f70f8003970 2023-11-24T08:06:23.592 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-11-24T08:06:23.594 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f8003970 msgr2=0x7f710c0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.594 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f8003970 0x7f710c0c7750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70fc02bc00 tx=0x7f70fc001120 comp rx=0 tx=0).stop 2023-11-24T08:06:23.594 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 shutdown_connections 2023-11-24T08:06:23.594 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f710c1f67e0 0x7f710c1f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.594 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f710c0c7c90 0x7f710c1f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.595 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 --2- 172.21.15.183:0/2619075237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f8003970 0x7f710c0c7750 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.595 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 >> 172.21.15.183:0/2619075237 conn(0x7f710c09c550 msgr2=0x7f710c06c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:23.595 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 shutdown_connections 2023-11-24T08:06:23.595 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.593+0000 7f711212c640 1 -- 172.21.15.183:0/2619075237 wait complete. 2023-11-24T08:06:23.611 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 8d28ab52-43c9-4d73-9b9c-657a944e4655 1 2023-11-24T08:06:23.628 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:23.626+0000 7f965a456040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:06:23.689 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:23.687+0000 7f965a456040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:06:23.740 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:23.738+0000 7f965a456040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:06:23.791 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:23.790+0000 7f4e7e44c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:06:23.802 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:23.800+0000 7f965a456040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:06:23.802 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.801+0000 7fd2c25fa640 1 Processor -- start 2023-11-24T08:06:23.802 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.801+0000 7fd2c25fa640 1 -- start start 2023-11-24T08:06:23.804 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c25fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd2bc06c990 0x7fd2bc06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.804 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c25fa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0b2830 con 0x7fd2bc070d90 2023-11-24T08:06:23.804 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c25fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0b2530 con 0x7fd2bc0b2cc0 2023-11-24T08:06:23.804 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c25fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc06d3e0 con 0x7fd2bc06c990 2023-11-24T08:06:23.804 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c0df7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd2bc06c990 0x7fd2bc06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.805 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c0df7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd2bc06c990 0x7fd2bc06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38592/0 (socket says 172.21.15.183:38592) 2023-11-24T08:06:23.805 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c0df7640 1 -- 172.21.15.183:0/3215673521 learned_addr learned my addr 172.21.15.183:0/3215673521 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:23.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c0df7640 1 -- 172.21.15.183:0/3215673521 >> v1:172.21.15.183:6789/0 conn(0x7fd2bc0b2cc0 legacy=0x7fd2bc0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c0df7640 1 -- 172.21.15.183:0/3215673521 >> v1:172.21.15.97:6789/0 conn(0x7fd2bc070d90 legacy=0x7fd2bc071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:23.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.803+0000 7fd2c0df7640 1 -- 172.21.15.183:0/3215673521 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc06d6c0 con 0x7fd2bc06c990 2023-11-24T08:06:23.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.805+0000 7fd2c0df7640 1 --2- 172.21.15.183:0/3215673521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc06c990 0x7fd2bc06cdd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00bb10 tx=0x7fd2ac02e170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df7286cb32188f04 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:23.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.805+0000 7fd2b3fff640 1 -- 172.21.15.183:0/3215673521 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac036440 con 0x7fd2bc06c990 2023-11-24T08:06:23.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.805+0000 7fd2b3fff640 1 -- 172.21.15.183:0/3215673521 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0365a0 con 0x7fd2bc06c990 2023-11-24T08:06:23.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.805+0000 7fd2b3fff640 1 -- 172.21.15.183:0/3215673521 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac036930 con 0x7fd2bc06c990 2023-11-24T08:06:23.807 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.805+0000 7fd2c25fa640 1 -- 172.21.15.183:0/3215673521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc06c990 msgr2=0x7fd2bc06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.807 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.805+0000 7fd2c25fa640 1 --2- 172.21.15.183:0/3215673521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc06c990 0x7fd2bc06cdd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00bb10 tx=0x7fd2ac02e170 comp rx=0 tx=0).stop 2023-11-24T08:06:23.807 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.806+0000 7fd2c25fa640 1 -- 172.21.15.183:0/3215673521 shutdown_connections 2023-11-24T08:06:23.807 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.806+0000 7fd2c25fa640 1 --2- 172.21.15.183:0/3215673521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc06c990 0x7fd2bc06cdd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.807 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.806+0000 7fd2c25fa640 1 -- 172.21.15.183:0/3215673521 >> 172.21.15.183:0/3215673521 conn(0x7fd2bc0b15b0 msgr2=0x7fd2bc0b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:23.807 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.806+0000 7fd2c25fa640 1 -- 172.21.15.183:0/3215673521 shutdown_connections 2023-11-24T08:06:23.808 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.806+0000 7fd2c25fa640 1 -- 172.21.15.183:0/3215673521 wait complete. 2023-11-24T08:06:23.808 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.807+0000 7fd2c25fa640 1 Processor -- start 2023-11-24T08:06:23.808 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.807+0000 7fd2c25fa640 1 -- start start 2023-11-24T08:06:23.811 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.808+0000 7fd2c25fa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2bc06c990 0x7fd2bc1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.811 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.808+0000 7fd2c25fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2bc070d90 0x7fd2bc145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.811 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.808+0000 7fd2c25fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc0b2cc0 0x7fd2bc1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:23.811 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.808+0000 7fd2c25fa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc158560 con 0x7fd2bc06c990 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.808+0000 7fd2c25fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc158840 con 0x7fd2bc0b2cc0 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.808+0000 7fd2c25fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc158b20 con 0x7fd2bc070d90 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2bc070d90 0x7fd2bc145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c1df9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc0b2cc0 0x7fd2bc1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2bc070d90 0x7fd2bc145e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:44512/0 (socket says 172.21.15.183:44512) 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 -- 172.21.15.183:0/1331449938 learned_addr learned my addr 172.21.15.183:0/1331449938 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c15f8640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2bc06c990 0x7fd2bc1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:23.812 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 -- 172.21.15.183:0/1331449938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc0b2cc0 msgr2=0x7fd2bc1598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc0b2cc0 0x7fd2bc1598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 -- 172.21.15.183:0/1331449938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2bc06c990 msgr2=0x7fd2bc1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2bc06c990 0x7fd2bc1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 -- 172.21.15.183:0/1331449938 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac00b770 con 0x7fd2bc070d90 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.809+0000 7fd2c0df7640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2bc070d90 0x7fd2bc145e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00b2c0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.810+0000 7fd2b1ffb640 1 -- 172.21.15.183:0/1331449938 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac034b00 con 0x7fd2bc070d90 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.810+0000 7fd2b1ffb640 1 -- 172.21.15.183:0/1331449938 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac034c80 con 0x7fd2bc070d90 2023-11-24T08:06:23.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.810+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc158e00 con 0x7fd2bc070d90 2023-11-24T08:06:23.814 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.810+0000 7fd2b1ffb640 1 -- 172.21.15.183:0/1331449938 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac041440 con 0x7fd2bc070d90 2023-11-24T08:06:23.814 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.810+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc1593c0 con 0x7fd2bc070d90 2023-11-24T08:06:23.814 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.810+0000 7fd2b1ffb640 1 -- 172.21.15.183:0/1331449938 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd2ac0418a0 con 0x7fd2bc070d90 2023-11-24T08:06:23.814 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.810+0000 7fd2b1ffb640 1 -- 172.21.15.183:0/1331449938 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd2ac04bca0 con 0x7fd2bc070d90 2023-11-24T08:06:23.814 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.811+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc1595b0 con 0x7fd2bc070d90 2023-11-24T08:06:23.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.814+0000 7fd2b1ffb640 1 -- 172.21.15.183:0/1331449938 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd2ac046070 con 0x7fd2bc070d90 2023-11-24T08:06:23.851 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:23.850+0000 7f965a456040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:06:23.857 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:23.856+0000 7f4e7e44c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:06:23.893 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.892+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8d28ab52-43c9-4d73-9b9c-657a944e4655", "id": 1} v 0) v1 -- 0x7fd2bc158c60 con 0x7fd2bc070d90 2023-11-24T08:06:23.901 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.900+0000 7fd2b1ffb640 1 -- 172.21.15.183:0/1331449938 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d28ab52-43c9-4d73-9b9c-657a944e4655", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd2bc158c60 con 0x7fd2bc070d90 2023-11-24T08:06:23.901 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-24T08:06:23.903 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.901+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2bc070d90 msgr2=0x7fd2bc145e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:23.903 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.901+0000 7fd2c25fa640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2bc070d90 0x7fd2bc145e80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00b2c0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.903 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.901+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 shutdown_connections 2023-11-24T08:06:23.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.901+0000 7fd2c25fa640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2bc0b2cc0 0x7fd2bc1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.901+0000 7fd2c25fa640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2bc070d90 0x7fd2bc145e80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.901+0000 7fd2c25fa640 1 --2- 172.21.15.183:0/1331449938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd2bc06c990 0x7fd2bc1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:23.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.901+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 >> 172.21.15.183:0/1331449938 conn(0x7fd2bc0b15b0 msgr2=0x7fd2bc15b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:23.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.902+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 shutdown_connections 2023-11-24T08:06:23.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:23.902+0000 7fd2c25fa640 1 -- 172.21.15.183:0/1331449938 wait complete. 2023-11-24T08:06:23.910 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:23.909+0000 7f4e7e44c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:06:23.919 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new dcd3d758-4f3e-406f-81f3-6b23892a26d3 2 2023-11-24T08:06:23.965 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:23.963+0000 7f965a456040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T08:06:23.977 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:23.976+0000 7f4e7e44c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:06:24.029 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:24.028+0000 7f4e7e44c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:06:24.044 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:24.043+0000 7f965a456040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:06:24.098 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:24.096+0000 7f965a456040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:06:24.104 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.103+0000 7f70d2767640 1 Processor -- start 2023-11-24T08:06:24.104 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.103+0000 7f70d2767640 1 -- start start 2023-11-24T08:06:24.107 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d2767640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f70cc15d4b0 0x7f70cc0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.107 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d2767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cf9a0 0x7f70cc0cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.107 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d2767640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0d0320 con 0x7f70cc0cddf0 2023-11-24T08:06:24.107 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d2767640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0b2730 con 0x7f70cc15d4b0 2023-11-24T08:06:24.107 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d2767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0d1ec0 con 0x7f70cc0cf9a0 2023-11-24T08:06:24.107 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d0f64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cf9a0 0x7f70cc0cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.107 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d0f64640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cf9a0 0x7f70cc0cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:44518/0 (socket says 172.21.15.183:44518) 2023-11-24T08:06:24.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d0f64640 1 -- 172.21.15.183:0/2229685600 learned_addr learned my addr 172.21.15.183:0/2229685600 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:24.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d1f66640 1 --1- 172.21.15.183:0/2229685600 >> v1:172.21.15.183:6789/0 conn(0x7f70cc0cddf0 0x7f70cc0ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57250/0 (socket says 172.21.15.183:57250) 2023-11-24T08:06:24.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.105+0000 7f70d1765640 1 --2- 172.21.15.183:0/2229685600 >> v2:172.21.15.97:3300/0 conn(0x7f70cc15d4b0 0x7f70cc0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.106+0000 7f70d0f64640 1 -- 172.21.15.183:0/2229685600 >> v2:172.21.15.97:3300/0 conn(0x7f70cc15d4b0 msgr2=0x7f70cc0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:24.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.106+0000 7f70d0f64640 1 --2- 172.21.15.183:0/2229685600 >> v2:172.21.15.97:3300/0 conn(0x7f70cc15d4b0 0x7f70cc0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.108 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.106+0000 7f70d0f64640 1 -- 172.21.15.183:0/2229685600 >> v1:172.21.15.183:6789/0 conn(0x7f70cc0cddf0 legacy=0x7f70cc0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.109 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.106+0000 7f70d0f64640 1 -- 172.21.15.183:0/2229685600 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0b29d0 con 0x7f70cc0cf9a0 2023-11-24T08:06:24.109 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.106+0000 7f70d1765640 1 --2- 172.21.15.183:0/2229685600 >> v2:172.21.15.97:3300/0 conn(0x7f70cc15d4b0 0x7f70cc0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:24.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.107+0000 7f70d0f64640 1 --2- 172.21.15.183:0/2229685600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cf9a0 0x7f70cc0cfde0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0098a0 tx=0x7f70bc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=585a8f42e17e1398 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:24.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.107+0000 7f70c3fff640 1 -- 172.21.15.183:0/2229685600 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc030840 con 0x7f70cc0cf9a0 2023-11-24T08:06:24.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.107+0000 7f70c3fff640 1 -- 172.21.15.183:0/2229685600 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc0309a0 con 0x7f70cc0cf9a0 2023-11-24T08:06:24.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.107+0000 7f70c3fff640 1 -- 172.21.15.183:0/2229685600 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc030d30 con 0x7f70cc0cf9a0 2023-11-24T08:06:24.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 -- 172.21.15.183:0/2229685600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cf9a0 msgr2=0x7f70cc0cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 --2- 172.21.15.183:0/2229685600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cf9a0 0x7f70cc0cfde0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0098a0 tx=0x7f70bc02b980 comp rx=0 tx=0).stop 2023-11-24T08:06:24.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 -- 172.21.15.183:0/2229685600 shutdown_connections 2023-11-24T08:06:24.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 --2- 172.21.15.183:0/2229685600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cf9a0 0x7f70cc0cfde0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 --2- 172.21.15.183:0/2229685600 >> v2:172.21.15.97:3300/0 conn(0x7f70cc15d4b0 0x7f70cc0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 -- 172.21.15.183:0/2229685600 >> 172.21.15.183:0/2229685600 conn(0x7f70cc0d3000 msgr2=0x7f70cc0d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:24.111 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 -- 172.21.15.183:0/2229685600 shutdown_connections 2023-11-24T08:06:24.112 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.108+0000 7f70d2767640 1 -- 172.21.15.183:0/2229685600 wait complete. 2023-11-24T08:06:24.113 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.109+0000 7f70d2767640 1 Processor -- start 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.110+0000 7f70d2767640 1 -- start start 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d2767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cddf0 0x7f70cc1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d2767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70cc0cf9a0 0x7f70cc15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d2767640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70cc15d4b0 0x7f70cc0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d2767640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0cc740 con 0x7f70cc15d4b0 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d2767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc15f8c0 con 0x7f70cc0cf9a0 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d2767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc1f2ac0 con 0x7f70cc0cddf0 2023-11-24T08:06:24.114 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cddf0 0x7f70cc1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d0f64640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70cc0cf9a0 0x7f70cc15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cddf0 0x7f70cc1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:44534/0 (socket says 172.21.15.183:44534) 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 -- 172.21.15.183:0/898048493 learned_addr learned my addr 172.21.15.183:0/898048493 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 -- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70cc0cf9a0 msgr2=0x7f70cc15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70cc0cf9a0 0x7f70cc15e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 -- 172.21.15.183:0/898048493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70cc15d4b0 msgr2=0x7f70cc0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1f66640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70cc15d4b0 0x7f70cc0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70cc15d4b0 0x7f70cc0cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 -- 172.21.15.183:0/898048493 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc0094d0 con 0x7f70cc0cddf0 2023-11-24T08:06:24.115 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d0f64640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70cc0cf9a0 0x7f70cc15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.111+0000 7f70d1765640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cddf0 0x7f70cc1590b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70c800d800 tx=0x7f70c800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.112+0000 7f70c1ffb640 1 -- 172.21.15.183:0/898048493 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8004030 con 0x7f70cc0cddf0 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.112+0000 7f70c1ffb640 1 -- 172.21.15.183:0/898048493 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c8004190 con 0x7f70cc0cddf0 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.112+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc15da10 con 0x7f70cc0cddf0 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.112+0000 7f70c1ffb640 1 -- 172.21.15.183:0/898048493 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8004520 con 0x7f70cc0cddf0 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.112+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc15ef90 con 0x7f70cc0cddf0 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.112+0000 7f70c1ffb640 1 -- 172.21.15.183:0/898048493 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70c80099a0 con 0x7f70cc0cddf0 2023-11-24T08:06:24.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.112+0000 7f70c1ffb640 1 -- 172.21.15.183:0/898048493 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f70c8003cf0 con 0x7f70cc0cddf0 2023-11-24T08:06:24.117 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.113+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc067450 con 0x7f70cc0cddf0 2023-11-24T08:06:24.117 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.116+0000 7f70c1ffb640 1 -- 172.21.15.183:0/898048493 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f70c8009c50 con 0x7f70cc0cddf0 2023-11-24T08:06:24.159 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:24.157+0000 7f965a456040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:06:24.162 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:24.161+0000 7f4e7e44c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T08:06:24.205 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.204+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dcd3d758-4f3e-406f-81f3-6b23892a26d3", "id": 2} v 0) v1 -- 0x7f70cc0b1f40 con 0x7f70cc0cddf0 2023-11-24T08:06:24.212 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.211+0000 7f70c1ffb640 1 -- 172.21.15.183:0/898048493 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dcd3d758-4f3e-406f-81f3-6b23892a26d3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70c8003610 con 0x7f70cc0cddf0 2023-11-24T08:06:24.212 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-11-24T08:06:24.213 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cddf0 msgr2=0x7f70cc1590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.213 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cddf0 0x7f70cc1590b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70c800d800 tx=0x7f70c800dcc0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.214 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 shutdown_connections 2023-11-24T08:06:24.214 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70cc15d4b0 0x7f70cc0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.214 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70cc0cf9a0 0x7f70cc15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.214 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 --2- 172.21.15.183:0/898048493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70cc0cddf0 0x7f70cc1590b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.214 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 >> 172.21.15.183:0/898048493 conn(0x7f70cc0d3000 msgr2=0x7f70cc0b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:24.214 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 shutdown_connections 2023-11-24T08:06:24.214 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.212+0000 7f70d2767640 1 -- 172.21.15.183:0/898048493 wait complete. 2023-11-24T08:06:24.215 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:24.211+0000 7f965a456040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:06:24.230 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 9331e8e6-c5fe-4633-8e9e-87442adf70ef 3 2023-11-24T08:06:24.250 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:24.249+0000 7f4e7e44c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:06:24.309 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:24.308+0000 7f4e7e44c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:06:24.376 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:24.374+0000 7f4e7e44c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:06:24.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.414+0000 7fc334977640 1 Processor -- start 2023-11-24T08:06:24.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.414+0000 7fc334977640 1 -- start start 2023-11-24T08:06:24.418 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.415+0000 7fc334977640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc3300cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.415+0000 7fc334977640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc3300b31d0 0x7fc3300b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.415+0000 7fc334977640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300d0320 con 0x7fc33015d4b0 2023-11-24T08:06:24.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.415+0000 7fc334977640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300d1c60 con 0x7fc3300b31d0 2023-11-24T08:06:24.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.415+0000 7fc334977640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b2730 con 0x7fc3300cf9a0 2023-11-24T08:06:24.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc327fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc3300cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc32ed9d640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc33015d4b0 0x7fc3300d1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57254/0 (socket says 172.21.15.183:57254) 2023-11-24T08:06:24.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc32ed9d640 1 -- 172.21.15.183:0/1085905579 learned_addr learned my addr 172.21.15.183:0/1085905579 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-11-24T08:06:24.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc32f59e640 1 --2- 172.21.15.183:0/1085905579 >> v2:172.21.15.97:3300/0 conn(0x7fc3300b31d0 0x7fc3300b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc327fff640 1 -- 172.21.15.183:0/1085905579 >> v2:172.21.15.97:3300/0 conn(0x7fc3300b31d0 msgr2=0x7fc3300b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:24.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc327fff640 1 --2- 172.21.15.183:0/1085905579 >> v2:172.21.15.97:3300/0 conn(0x7fc3300b31d0 0x7fc3300b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc327fff640 1 -- 172.21.15.183:0/1085905579 >> v1:172.21.15.183:6789/0 conn(0x7fc33015d4b0 legacy=0x7fc3300d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc327fff640 1 -- 172.21.15.183:0/1085905579 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300d1ec0 con 0x7fc3300cf9a0 2023-11-24T08:06:24.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.416+0000 7fc32e59c640 1 -- 172.21.15.183:0/1085905579 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384890289 0 0) 0x7fc3300d0320 con 0x7fc33015d4b0 2023-11-24T08:06:24.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.417+0000 7fc327fff640 1 --2- 172.21.15.183:0/1085905579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc3300cfde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc3180097d0 tx=0x7fc31802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66f377de58ef0de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:24.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc32e59c640 1 -- 172.21.15.183:0/1085905579 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318031800 con 0x7fc3300cf9a0 2023-11-24T08:06:24.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc32e59c640 1 -- 172.21.15.183:0/1085905579 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318031960 con 0x7fc3300cf9a0 2023-11-24T08:06:24.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc32e59c640 1 -- 172.21.15.183:0/1085905579 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318031cf0 con 0x7fc3300cf9a0 2023-11-24T08:06:24.427 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 -- 172.21.15.183:0/1085905579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 msgr2=0x7fc3300cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.427 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 --2- 172.21.15.183:0/1085905579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc3300cfde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc3180097d0 tx=0x7fc31802b8a0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.427 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 -- 172.21.15.183:0/1085905579 shutdown_connections 2023-11-24T08:06:24.427 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 --2- 172.21.15.183:0/1085905579 >> v2:172.21.15.97:3300/0 conn(0x7fc3300b31d0 0x7fc3300b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.427 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 --2- 172.21.15.183:0/1085905579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc3300cfde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 -- 172.21.15.183:0/1085905579 >> 172.21.15.183:0/1085905579 conn(0x7fc3300d3000 msgr2=0x7fc3300d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:24.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 -- 172.21.15.183:0/1085905579 shutdown_connections 2023-11-24T08:06:24.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.418+0000 7fc334977640 1 -- 172.21.15.183:0/1085905579 wait complete. 2023-11-24T08:06:24.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.420+0000 7fc334977640 1 Processor -- start 2023-11-24T08:06:24.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.420+0000 7fc334977640 1 -- start start 2023-11-24T08:06:24.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.421+0000 7fc334977640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3300b31d0 0x7fc33015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.428 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.421+0000 7fc334977640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc33015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.421+0000 7fc334977640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc33015d4b0 0x7fc3300b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.421+0000 7fc334977640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b6160 con 0x7fc33015d4b0 2023-11-24T08:06:24.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.421+0000 7fc334977640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b6f00 con 0x7fc3300b31d0 2023-11-24T08:06:24.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.421+0000 7fc334977640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b71e0 con 0x7fc3300cf9a0 2023-11-24T08:06:24.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3300b31d0 0x7fc33015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc327fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc33015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.429 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3300b31d0 0x7fc33015edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38618/0 (socket says 172.21.15.183:38618) 2023-11-24T08:06:24.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 -- 172.21.15.183:0/2333498058 learned_addr learned my addr 172.21.15.183:0/2333498058 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:24.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32f59e640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc33015d4b0 0x7fc3300b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 -- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 msgr2=0x7fc33015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc33015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 -- 172.21.15.183:0/2333498058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc33015d4b0 msgr2=0x7fc3300b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc33015d4b0 0x7fc3300b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.430 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 -- 172.21.15.183:0/2333498058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009400 con 0x7fc3300b31d0 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc327fff640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc33015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.422+0000 7fc32ed9d640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3300b31d0 0x7fc33015edc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc32000c500 tx=0x7fc32000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.423+0000 7fc3277fe640 1 -- 172.21.15.183:0/2333498058 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320007560 con 0x7fc3300b31d0 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.423+0000 7fc3277fe640 1 -- 172.21.15.183:0/2333498058 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3200047e0 con 0x7fc3300b31d0 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.423+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3300b6390 con 0x7fc3300b31d0 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.423+0000 7fc3277fe640 1 -- 172.21.15.183:0/2333498058 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320004b90 con 0x7fc3300b31d0 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.423+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3300b6950 con 0x7fc3300b31d0 2023-11-24T08:06:24.431 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.423+0000 7fc3277fe640 1 -- 172.21.15.183:0/2333498058 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc32001d440 con 0x7fc3300b31d0 2023-11-24T08:06:24.432 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.423+0000 7fc3277fe640 1 -- 172.21.15.183:0/2333498058 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc32001db80 con 0x7fc3300b31d0 2023-11-24T08:06:24.432 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.424+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3300d2710 con 0x7fc3300b31d0 2023-11-24T08:06:24.432 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.427+0000 7fc3277fe640 1 -- 172.21.15.183:0/2333498058 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc320018070 con 0x7fc3300b31d0 2023-11-24T08:06:24.436 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:24.435+0000 7f4e7e44c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:06:24.506 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.504+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9331e8e6-c5fe-4633-8e9e-87442adf70ef", "id": 3} v 0) v1 -- 0x7fc3300b6b40 con 0x7fc3300b31d0 2023-11-24T08:06:24.513 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.512+0000 7fc3277fe640 1 -- 172.21.15.183:0/2333498058 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9331e8e6-c5fe-4633-8e9e-87442adf70ef", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc32001d7c0 con 0x7fc3300b31d0 2023-11-24T08:06:24.513 INFO:teuthology.orchestra.run.smithi183.stdout:3 2023-11-24T08:06:24.514 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3300b31d0 msgr2=0x7fc33015edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3300b31d0 0x7fc33015edc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc32000c500 tx=0x7fc32000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 shutdown_connections 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc33015d4b0 0x7fc3300b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3300cf9a0 0x7fc33015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 --2- 172.21.15.183:0/2333498058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3300b31d0 0x7fc33015edc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 >> 172.21.15.183:0/2333498058 conn(0x7fc3300d3000 msgr2=0x7fc3300d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 shutdown_connections 2023-11-24T08:06:24.515 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.513+0000 7fc334977640 1 -- 172.21.15.183:0/2333498058 wait complete. 2023-11-24T08:06:24.531 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 3367d2f7-5bf7-4236-93ad-56c480dba2ab 4 2023-11-24T08:06:24.666 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:24.664+0000 7f965a456040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T08:06:24.768 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.767+0000 7f0dc704b640 1 Processor -- start 2023-11-24T08:06:24.769 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.767+0000 7f0dc704b640 1 -- start start 2023-11-24T08:06:24.771 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dc704b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.771 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dc704b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00b1ee0 con 0x7f0dc0143ae0 2023-11-24T08:06:24.771 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dc704b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00b2780 con 0x7f0dc015e1e0 2023-11-24T08:06:24.772 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dc704b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc015e990 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.772 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dbffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.772 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dc55e8640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f0dc015e1e0 0x7f0dc00702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57264/0 (socket says 172.21.15.183:57264) 2023-11-24T08:06:24.772 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dbffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:44560/0 (socket says 172.21.15.183:44560) 2023-11-24T08:06:24.773 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.769+0000 7f0dc55e8640 1 -- 172.21.15.183:0/175879953 learned_addr learned my addr 172.21.15.183:0/175879953 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-11-24T08:06:24.773 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.770+0000 7f0dbffff640 1 -- 172.21.15.183:0/175879953 >> v1:172.21.15.183:6789/0 conn(0x7f0dc015e1e0 legacy=0x7f0dc00702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.773 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.770+0000 7f0dbffff640 1 -- 172.21.15.183:0/175879953 >> v1:172.21.15.97:6789/0 conn(0x7f0dc0143ae0 legacy=0x7f0dc00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.773 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.770+0000 7f0dbf7fe640 1 -- 172.21.15.183:0/175879953 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592621376 0 0) 0x7f0dc00b2780 con 0x7f0dc015e1e0 2023-11-24T08:06:24.774 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.770+0000 7f0dbffff640 1 -- 172.21.15.183:0/175879953 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00b2130 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.780 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.772+0000 7f0dbffff640 1 --2- 172.21.15.183:0/175879953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc015dca0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0097d0 tx=0x7f0dac02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfea7e7c1885699a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:24.780 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.772+0000 7f0dbf7fe640 1 -- 172.21.15.183:0/175879953 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031890 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.781 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.772+0000 7f0dbf7fe640 1 -- 172.21.15.183:0/175879953 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0319f0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.781 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.772+0000 7f0dbf7fe640 1 -- 172.21.15.183:0/175879953 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031d80 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.781 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.772+0000 7f0dc704b640 1 -- 172.21.15.183:0/175879953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 msgr2=0x7f0dc015dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.781 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.772+0000 7f0dc704b640 1 --2- 172.21.15.183:0/175879953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc015dca0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0097d0 tx=0x7f0dac02b930 comp rx=0 tx=0).stop 2023-11-24T08:06:24.782 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.773+0000 7f0dc704b640 1 -- 172.21.15.183:0/175879953 shutdown_connections 2023-11-24T08:06:24.782 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.773+0000 7f0dc704b640 1 --2- 172.21.15.183:0/175879953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc015dca0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.782 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.773+0000 7f0dc704b640 1 -- 172.21.15.183:0/175879953 >> 172.21.15.183:0/175879953 conn(0x7f0dc006a800 msgr2=0x7f0dc006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:24.783 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.773+0000 7f0dc704b640 1 -- 172.21.15.183:0/175879953 shutdown_connections 2023-11-24T08:06:24.783 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.773+0000 7f0dc704b640 1 -- 172.21.15.183:0/175879953 wait complete. 2023-11-24T08:06:24.783 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.774+0000 7f0dc704b640 1 Processor -- start 2023-11-24T08:06:24.783 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.774+0000 7f0dc704b640 1 -- start start 2023-11-24T08:06:24.783 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.775+0000 7f0dc704b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc0131650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.784 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.775+0000 7f0dc704b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0dc0143ae0 0x7f0dc00b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.784 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.775+0000 7f0dc704b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dc015e1e0 0x7f0dc00c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:24.784 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.775+0000 7f0dc704b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00b15f0 con 0x7f0dc0143ae0 2023-11-24T08:06:24.784 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.775+0000 7f0dc704b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0131c30 con 0x7f0dc015e1e0 2023-11-24T08:06:24.785 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.775+0000 7f0dc704b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0131f10 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.785 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc55e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dc015e1e0 0x7f0dc00c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.785 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc0131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.785 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc0131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:44566/0 (socket says 172.21.15.183:44566) 2023-11-24T08:06:24.786 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc55e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dc015e1e0 0x7f0dc00c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38622/0 (socket says 172.21.15.183:38622) 2023-11-24T08:06:24.786 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 -- 172.21.15.183:0/92345355 learned_addr learned my addr 172.21.15.183:0/92345355 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:24.786 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dbffff640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0dc0143ae0 0x7f0dc00b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:24.786 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 -- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dc015e1e0 msgr2=0x7f0dc00c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.786 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dc015e1e0 0x7f0dc00c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.787 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 -- 172.21.15.183:0/92345355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0dc0143ae0 msgr2=0x7f0dc00b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.787 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0dc0143ae0 0x7f0dc00b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.787 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 -- 172.21.15.183:0/92345355 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009400 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.787 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dbffff640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0dc0143ae0 0x7f0dc00b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:24.788 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc55e8640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dc015e1e0 0x7f0dc00c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:24.788 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.776+0000 7f0dc4de7640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc0131650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c450 tx=0x7f0db400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:24.788 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.777+0000 7f0dbd7fa640 1 -- 172.21.15.183:0/92345355 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40052d0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.788 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.777+0000 7f0dbd7fa640 1 -- 172.21.15.183:0/92345355 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4005430 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.788 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.777+0000 7f0dbd7fa640 1 -- 172.21.15.183:0/92345355 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4012870 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.777+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc01321f0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.777+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc01327b0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.777+0000 7f0dbd7fa640 1 -- 172.21.15.183:0/92345355 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0db4012cd0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.777+0000 7f0dbd7fa640 1 -- 172.21.15.183:0/92345355 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0db4003b00 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.790 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.778+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc006e0d0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.790 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.780+0000 7f0dbd7fa640 1 -- 172.21.15.183:0/92345355 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0db40035f0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.827 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:24.825+0000 7f965a456040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:06:24.858 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.857+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3367d2f7-5bf7-4236-93ad-56c480dba2ab", "id": 4} v 0) v1 -- 0x7f0dc00675d0 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.864 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.863+0000 7f0dbd7fa640 1 -- 172.21.15.183:0/92345355 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3367d2f7-5bf7-4236-93ad-56c480dba2ab", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0db4003790 con 0x7f0dc00cf9a0 2023-11-24T08:06:24.865 INFO:teuthology.orchestra.run.smithi183.stdout:4 2023-11-24T08:06:24.866 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 msgr2=0x7f0dc0131650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:24.866 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc0131650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c450 tx=0x7f0db400c910 comp rx=0 tx=0).stop 2023-11-24T08:06:24.866 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 shutdown_connections 2023-11-24T08:06:24.866 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dc015e1e0 0x7f0dc00c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.867 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0dc0143ae0 0x7f0dc00b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.867 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 --2- 172.21.15.183:0/92345355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dc00cf9a0 0x7f0dc0131650 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:24.867 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 >> 172.21.15.183:0/92345355 conn(0x7f0dc006a800 msgr2=0x7f0dc006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:24.867 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 shutdown_connections 2023-11-24T08:06:24.867 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:24.865+0000 7f0dc704b640 1 -- 172.21.15.183:0/92345355 wait complete. 2023-11-24T08:06:24.882 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new a21f3456-2ae2-4304-8f08-1cba93ad2e78 5 2023-11-24T08:06:24.911 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:24.910+0000 7f4e7e44c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T08:06:24.969 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:24.967+0000 7f965a456040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:06:25.022 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:25.020+0000 7f965a456040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:06:25.071 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.070+0000 7f95a759e640 1 Processor -- start 2023-11-24T08:06:25.071 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.070+0000 7f95a759e640 1 -- start start 2023-11-24T08:06:25.073 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a759e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f95a8160a20 0x7f95a80cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f95a80b3b20 0x7f95a80cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a80d1e00 con 0x7f95a8160e00 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a759e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80d3c40 con 0x7f95a8160a20 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80d3e50 con 0x7f95a80b3b20 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f95a80b3b20 0x7f95a80cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f959ffff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f95a8160e00 0x7f95a80b2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57276/0 (socket says 172.21.15.183:57276) 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f959ffff640 1 -- 172.21.15.183:0/3169209884 learned_addr learned my addr 172.21.15.183:0/3169209884 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a659c640 1 --2- 172.21.15.183:0/3169209884 >> v2:172.21.15.97:3300/0 conn(0x7f95a8160a20 0x7f95a80cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.074 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a6d9d640 1 -- 172.21.15.183:0/3169209884 >> v2:172.21.15.97:3300/0 conn(0x7f95a8160a20 msgr2=0x7f95a80cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:25.075 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.072+0000 7f95a6d9d640 1 --2- 172.21.15.183:0/3169209884 >> v2:172.21.15.97:3300/0 conn(0x7f95a8160a20 0x7f95a80cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.075 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.073+0000 7f95a6d9d640 1 -- 172.21.15.183:0/3169209884 >> v1:172.21.15.183:6789/0 conn(0x7f95a8160e00 legacy=0x7f95a80b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.075 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.073+0000 7f95a6d9d640 1 -- 172.21.15.183:0/3169209884 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80d1a90 con 0x7f95a80b3b20 2023-11-24T08:06:25.075 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.073+0000 7f95a5d9b640 1 -- 172.21.15.183:0/3169209884 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094437797 0 0) 0x7f95a80d1e00 con 0x7f95a8160e00 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.074+0000 7f95a6d9d640 1 --2- 172.21.15.183:0/3169209884 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80b3b20 0x7f95a80cfd90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95a808d550 tx=0x7f95a002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b03fffebb299534 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.074+0000 7f95a5d9b640 1 -- 172.21.15.183:0/3169209884 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a002cc80 con 0x7f95a80b3b20 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.074+0000 7f95a5d9b640 1 -- 172.21.15.183:0/3169209884 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a002cde0 con 0x7f95a80b3b20 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.074+0000 7f95a5d9b640 1 -- 172.21.15.183:0/3169209884 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0034660 con 0x7f95a80b3b20 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.074+0000 7f95a759e640 1 -- 172.21.15.183:0/3169209884 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80b3b20 msgr2=0x7f95a80cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.074+0000 7f95a759e640 1 --2- 172.21.15.183:0/3169209884 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80b3b20 0x7f95a80cfd90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95a808d550 tx=0x7f95a002bed0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.075+0000 7f95a759e640 1 -- 172.21.15.183:0/3169209884 shutdown_connections 2023-11-24T08:06:25.076 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.075+0000 7f95a759e640 1 --2- 172.21.15.183:0/3169209884 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80b3b20 0x7f95a80cfd90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.077 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.075+0000 7f95a759e640 1 --2- 172.21.15.183:0/3169209884 >> v2:172.21.15.97:3300/0 conn(0x7f95a8160a20 0x7f95a80cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.077 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.075+0000 7f95a759e640 1 -- 172.21.15.183:0/3169209884 >> 172.21.15.183:0/3169209884 conn(0x7f95a80d3120 msgr2=0x7f95a80d3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.077 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.075+0000 7f95a759e640 1 -- 172.21.15.183:0/3169209884 shutdown_connections 2023-11-24T08:06:25.077 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.075+0000 7f95a759e640 1 -- 172.21.15.183:0/3169209884 wait complete. 2023-11-24T08:06:25.078 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.077+0000 7f95a759e640 1 Processor -- start 2023-11-24T08:06:25.078 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.077+0000 7f95a759e640 1 -- start start 2023-11-24T08:06:25.078 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.077+0000 7f4e7e44c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:06:25.080 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80b3b20 0x7f95a815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a8160a20 0x7f95a80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a8160e00 0x7f95a80b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a759e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a815cfb0 con 0x7f95a8160e00 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80cca30 con 0x7f95a8160a20 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80cbe20 con 0x7f95a80b3b20 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f959ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a8160a20 0x7f95a80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80b3b20 0x7f95a815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f959ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a8160a20 0x7f95a80ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:38632/0 (socket says 172.21.15.183:38632) 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f959ffff640 1 -- 172.21.15.183:0/2082784150 learned_addr learned my addr 172.21.15.183:0/2082784150 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.078+0000 7f95a6d9d640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a8160e00 0x7f95a80b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959ffff640 1 -- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80b3b20 msgr2=0x7f95a815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959ffff640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80b3b20 0x7f95a815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959ffff640 1 -- 172.21.15.183:0/2082784150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a8160e00 msgr2=0x7f95a80b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959ffff640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a8160e00 0x7f95a80b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959ffff640 1 -- 172.21.15.183:0/2082784150 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009a70 con 0x7f95a8160a20 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f95a659c640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80b3b20 0x7f95a815ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959ffff640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a8160a20 0x7f95a80ccec0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f959000c460 tx=0x7f959000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959effd640 1 -- 172.21.15.183:0/2082784150 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900074e0 con 0x7f95a8160a20 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959effd640 1 -- 172.21.15.183:0/2082784150 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590007660 con 0x7f95a8160a20 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a80cc100 con 0x7f95a8160a20 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f959effd640 1 -- 172.21.15.183:0/2082784150 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590004a20 con 0x7f95a8160a20 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.079+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80cc6c0 con 0x7f95a8160a20 2023-11-24T08:06:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.080+0000 7f959effd640 1 -- 172.21.15.183:0/2082784150 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9590012400 con 0x7f95a8160a20 2023-11-24T08:06:25.083 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.080+0000 7f959effd640 1 -- 172.21.15.183:0/2082784150 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f9590012c30 con 0x7f95a8160a20 2023-11-24T08:06:25.083 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.081+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a80674c0 con 0x7f95a8160a20 2023-11-24T08:06:25.084 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.083+0000 7f959effd640 1 -- 172.21.15.183:0/2082784150 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9590018070 con 0x7f95a8160a20 2023-11-24T08:06:25.131 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:25.129+0000 7f965a456040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:06:25.159 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.158+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a21f3456-2ae2-4304-8f08-1cba93ad2e78", "id": 5} v 0) v1 -- 0x7f95a80ccba0 con 0x7f95a8160a20 2023-11-24T08:06:25.166 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.165+0000 7f959effd640 1 -- 172.21.15.183:0/2082784150 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a21f3456-2ae2-4304-8f08-1cba93ad2e78", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95900126b0 con 0x7f95a8160a20 2023-11-24T08:06:25.166 INFO:teuthology.orchestra.run.smithi183.stdout:5 2023-11-24T08:06:25.167 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a8160a20 msgr2=0x7f95a80ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.168 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a8160a20 0x7f95a80ccec0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f959000c460 tx=0x7f959000c920 comp rx=0 tx=0).stop 2023-11-24T08:06:25.168 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 shutdown_connections 2023-11-24T08:06:25.168 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a8160e00 0x7f95a80b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.168 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a8160a20 0x7f95a80ccec0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.168 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 --2- 172.21.15.183:0/2082784150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80b3b20 0x7f95a815ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.168 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 >> 172.21.15.183:0/2082784150 conn(0x7f95a80d3120 msgr2=0x7f95a815fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.169 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 shutdown_connections 2023-11-24T08:06:25.169 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.166+0000 7f95a759e640 1 -- 172.21.15.183:0/2082784150 wait complete. 2023-11-24T08:06:25.183 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 95dfafb5-84b2-4680-906c-fdb99aba144c 6 2023-11-24T08:06:25.210 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.209+0000 7f4e7e44c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:06:25.243 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:25.241+0000 7f965a456040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:06:25.270 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.269+0000 7f4e7e44c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:06:25.386 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.385+0000 7f4e7e44c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:06:25.404 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:25.402+0000 7f965a456040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:06:25.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.406+0000 7fc609885640 1 Processor -- start 2023-11-24T08:06:25.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.406+0000 7fc609885640 1 -- start start 2023-11-24T08:06:25.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc609885640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6040cff60 0x7fc6040ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc609885640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040d1e00 con 0x7fc604160e00 2023-11-24T08:06:25.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc609885640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040d3e50 con 0x7fc604160a20 2023-11-24T08:06:25.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc609885640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040d3c40 con 0x7fc6040cff60 2023-11-24T08:06:25.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc608883640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc604160a20 0x7fc6040cf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57282/0 (socket says 172.21.15.183:57282) 2023-11-24T08:06:25.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc608883640 1 -- 172.21.15.183:0/4053155771 learned_addr learned my addr 172.21.15.183:0/4053155771 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-11-24T08:06:25.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc609084640 1 --2- 172.21.15.183:0/4053155771 >> v2:172.21.15.97:3300/0 conn(0x7fc6040cff60 0x7fc6040ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241449453 0 0) 0x7fc6040d3e50 con 0x7fc604160a20 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.408+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f4003520 con 0x7fc604160a20 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3225983488 0 0) 0x7fc5f4003520 con 0x7fc604160a20 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 >> v2:172.21.15.97:3300/0 conn(0x7fc6040cff60 msgr2=0x7fc6040ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 --2- 172.21.15.183:0/4053155771 >> v2:172.21.15.97:3300/0 conn(0x7fc6040cff60 0x7fc6040ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 >> v1:172.21.15.97:6789/0 conn(0x7fc604160e00 legacy=0x7fc6040cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040d1a90 con 0x7fc604160a20 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fc5f8001670 con 0x7fc604160a20 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 >> v1:172.21.15.183:6789/0 conn(0x7fc604160a20 legacy=0x7fc6040cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc5f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f40047c0 0x7fc5f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5f4005180 0x7fc5f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040d3c40 con 0x7fc5f40047c0 2023-11-24T08:06:25.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f400c020 con 0x7fc5f4005180 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f400c1e0 con 0x7fc5f4003970 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc608883640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc5f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc609084640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5f4005180 0x7fc5f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.409+0000 7fc603fff640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f40047c0 0x7fc5f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.410+0000 7fc608883640 1 -- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5f4005180 msgr2=0x7fc5f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.410+0000 7fc608883640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5f4005180 0x7fc5f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.410+0000 7fc608883640 1 -- 172.21.15.183:0/4053155771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f40047c0 msgr2=0x7fc5f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.410+0000 7fc608883640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f40047c0 0x7fc5f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.410+0000 7fc608883640 1 -- 172.21.15.183:0/4053155771 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4003520 con 0x7fc5f4003970 2023-11-24T08:06:25.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.410+0000 7fc609084640 1 -- 172.21.15.183:0/4053155771 reap_dead start 2023-11-24T08:06:25.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.411+0000 7fc608883640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc5f4003d90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c240 tx=0x7fc5f40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=573b0efc6fbfaf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.411+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8005ad0 con 0x7fc5f4003970 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.411+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f8005c30 con 0x7fc5f4003970 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.411+0000 7fc6037fe640 1 -- 172.21.15.183:0/4053155771 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f802ca90 con 0x7fc5f4003970 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.411+0000 7fc609885640 1 -- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 msgr2=0x7fc5f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.411+0000 7fc609885640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc5f4003d90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c240 tx=0x7fc5f40057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.412+0000 7fc609885640 1 -- 172.21.15.183:0/4053155771 shutdown_connections 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.412+0000 7fc609885640 1 --2- 172.21.15.183:0/4053155771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc5f4003d90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.412+0000 7fc609885640 1 -- 172.21.15.183:0/4053155771 >> 172.21.15.183:0/4053155771 conn(0x7fc6040d3120 msgr2=0x7fc6040d3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.412+0000 7fc609885640 1 -- 172.21.15.183:0/4053155771 shutdown_connections 2023-11-24T08:06:25.416 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.412+0000 7fc609885640 1 -- 172.21.15.183:0/4053155771 wait complete. 2023-11-24T08:06:25.416 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.414+0000 7fc609885640 1 Processor -- start 2023-11-24T08:06:25.416 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.415+0000 7fc609885640 1 -- start start 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc609885640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc6041f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc609885640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6040caec0 0x7fc6040b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc609885640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6040cb340 0x7fc6040b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc609885640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cc520 con 0x7fc6040caec0 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc609885640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cb910 con 0x7fc6040cb340 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc609885640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cbbf0 con 0x7fc5f4003970 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc608883640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc6041f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.419 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc608883640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc6041f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:44594/0 (socket says 172.21.15.183:44594) 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.416+0000 7fc608883640 1 -- 172.21.15.183:0/2831584042 learned_addr learned my addr 172.21.15.183:0/2831584042 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc609084640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6040cb340 0x7fc6040b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc603fff640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6040caec0 0x7fc6040b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc608883640 1 -- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6040cb340 msgr2=0x7fc6040b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc608883640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6040cb340 0x7fc6040b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc608883640 1 -- 172.21.15.183:0/2831584042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6040caec0 msgr2=0x7fc6040b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc608883640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6040caec0 0x7fc6040b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc608883640 1 -- 172.21.15.183:0/2831584042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040cbed0 con 0x7fc5f4003970 2023-11-24T08:06:25.420 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc608883640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc6041f2480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc5f802c3f0 tx=0x7fc5f802e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc6017fa640 1 -- 172.21.15.183:0/2831584042 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f803c040 con 0x7fc5f4003970 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc6017fa640 1 -- 172.21.15.183:0/2831584042 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f802cd20 con 0x7fc5f4003970 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6040cc1b0 con 0x7fc5f4003970 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.417+0000 7fc6017fa640 1 -- 172.21.15.183:0/2831584042 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80072b0 con 0x7fc5f4003970 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.418+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6040cc9b0 con 0x7fc5f4003970 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.418+0000 7fc6017fa640 1 -- 172.21.15.183:0/2831584042 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc5f8032070 con 0x7fc5f4003970 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.418+0000 7fc6017fa640 1 -- 172.21.15.183:0/2831584042 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc5f8040420 con 0x7fc5f4003970 2023-11-24T08:06:25.421 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.419+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc604067b60 con 0x7fc5f4003970 2023-11-24T08:06:25.422 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.421+0000 7fc6017fa640 1 -- 172.21.15.183:0/2831584042 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc5f8045070 con 0x7fc5f4003970 2023-11-24T08:06:25.454 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:25.453+0000 7f965a456040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:06:25.501 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.500+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "95dfafb5-84b2-4680-906c-fdb99aba144c", "id": 6} v 0) v1 -- 0x7fc60415f7a0 con 0x7fc5f4003970 2023-11-24T08:06:25.505 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.504+0000 7f4e7e44c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:06:25.511 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.509+0000 7fc6017fa640 1 -- 172.21.15.183:0/2831584042 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95dfafb5-84b2-4680-906c-fdb99aba144c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5f8007ce0 con 0x7fc5f4003970 2023-11-24T08:06:25.511 INFO:teuthology.orchestra.run.smithi183.stdout:6 2023-11-24T08:06:25.512 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 msgr2=0x7fc6041f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.512 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc6041f2480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc5f802c3f0 tx=0x7fc5f802e070 comp rx=0 tx=0).stop 2023-11-24T08:06:25.512 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 shutdown_connections 2023-11-24T08:06:25.513 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6040cb340 0x7fc6040b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.513 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6040caec0 0x7fc6040b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.513 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 --2- 172.21.15.183:0/2831584042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5f4003970 0x7fc6041f2480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.513 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 >> 172.21.15.183:0/2831584042 conn(0x7fc6040d3120 msgr2=0x7fc6040cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.513 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 shutdown_connections 2023-11-24T08:06:25.513 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.511+0000 7fc609885640 1 -- 172.21.15.183:0/2831584042 wait complete. 2023-11-24T08:06:25.527 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 6731ed00-f858-42ec-ad53-1d31d1b20790 7 2023-11-24T08:06:25.613 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:25.611+0000 7f965a456040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:06:25.678 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.677+0000 7f4e7e44c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:06:25.715 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.714+0000 7f70fa11d640 1 Processor -- start 2023-11-24T08:06:25.716 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.714+0000 7f70fa11d640 1 -- start start 2023-11-24T08:06:25.718 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70fa11d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f70f40cfcf0 0x7f70f4160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.718 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70fa11d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f70f40d00d0 0x7f70f4160c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.718 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70fa11d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40d4160 con 0x7f70f40d3910 2023-11-24T08:06:25.718 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70fa11d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40ceff0 con 0x7f70f40cfcf0 2023-11-24T08:06:25.719 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70fa11d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40cf410 con 0x7f70f40d00d0 2023-11-24T08:06:25.719 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f70f40d00d0 0x7f70f4160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.719 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f2ffd640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f70f40d3910 0x7f70f40b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57292/0 (socket says 172.21.15.183:57292) 2023-11-24T08:06:25.720 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f2ffd640 1 -- 172.21.15.183:0/1919735363 learned_addr learned my addr 172.21.15.183:0/1919735363 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-11-24T08:06:25.720 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f37fe640 1 --2- 172.21.15.183:0/1919735363 >> v2:172.21.15.97:3300/0 conn(0x7f70f40cfcf0 0x7f70f4160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.720 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f3fff640 1 -- 172.21.15.183:0/1919735363 >> v2:172.21.15.97:3300/0 conn(0x7f70f40cfcf0 msgr2=0x7f70f4160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:25.720 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f3fff640 1 --2- 172.21.15.183:0/1919735363 >> v2:172.21.15.97:3300/0 conn(0x7f70f40cfcf0 0x7f70f4160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.720 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f3fff640 1 -- 172.21.15.183:0/1919735363 >> v1:172.21.15.183:6789/0 conn(0x7f70f40d3910 legacy=0x7f70f40b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.721 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.716+0000 7f70f3fff640 1 -- 172.21.15.183:0/1919735363 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40b2420 con 0x7f70f40d00d0 2023-11-24T08:06:25.723 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.718+0000 7f70f3fff640 1 --2- 172.21.15.183:0/1919735363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d00d0 0x7f70f4160c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cdb60 tx=0x7f70ec02be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec23673d601414a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.723 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.718+0000 7f70f27fc640 1 -- 172.21.15.183:0/1919735363 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec02cbe0 con 0x7f70f40d00d0 2023-11-24T08:06:25.723 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.718+0000 7f70f27fc640 1 -- 172.21.15.183:0/1919735363 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec02cd40 con 0x7f70f40d00d0 2023-11-24T08:06:25.723 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.718+0000 7f70f27fc640 1 -- 172.21.15.183:0/1919735363 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec034660 con 0x7f70f40d00d0 2023-11-24T08:06:25.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.718+0000 7f70fa11d640 1 -- 172.21.15.183:0/1919735363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d00d0 msgr2=0x7f70f4160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.718+0000 7f70fa11d640 1 --2- 172.21.15.183:0/1919735363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d00d0 0x7f70f4160c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cdb60 tx=0x7f70ec02be30 comp rx=0 tx=0).stop 2023-11-24T08:06:25.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.719+0000 7f70fa11d640 1 -- 172.21.15.183:0/1919735363 shutdown_connections 2023-11-24T08:06:25.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.719+0000 7f70fa11d640 1 --2- 172.21.15.183:0/1919735363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d00d0 0x7f70f4160c40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.719+0000 7f70fa11d640 1 --2- 172.21.15.183:0/1919735363 >> v2:172.21.15.97:3300/0 conn(0x7f70f40cfcf0 0x7f70f4160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.724 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.719+0000 7f70fa11d640 1 -- 172.21.15.183:0/1919735363 >> 172.21.15.183:0/1919735363 conn(0x7f70f409c530 msgr2=0x7f70f40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.725 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.719+0000 7f70fa11d640 1 -- 172.21.15.183:0/1919735363 shutdown_connections 2023-11-24T08:06:25.725 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.719+0000 7f70fa11d640 1 -- 172.21.15.183:0/1919735363 wait complete. 2023-11-24T08:06:25.725 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.721+0000 7f70fa11d640 1 Processor -- start 2023-11-24T08:06:25.725 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.721+0000 7f70fa11d640 1 -- start start 2023-11-24T08:06:25.727 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70fa11d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f40cfcf0 0x7f70f40cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.727 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70fa11d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f40d00d0 0x7f70f4154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.728 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70fa11d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d3910 0x7f70f40b8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.728 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70fa11d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40cc310 con 0x7f70f40d00d0 2023-11-24T08:06:25.728 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70fa11d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f41f76c0 con 0x7f70f40d3910 2023-11-24T08:06:25.728 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70fa11d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40cb970 con 0x7f70f40cfcf0 2023-11-24T08:06:25.728 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f40cfcf0 0x7f70f40cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.728 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f40cfcf0 0x7f70f40cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:44596/0 (socket says 172.21.15.183:44596) 2023-11-24T08:06:25.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70f37fe640 1 -- 172.21.15.183:0/4198721676 learned_addr learned my addr 172.21.15.183:0/4198721676 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-11-24T08:06:25.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.723+0000 7f70f3fff640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d3910 0x7f70f40b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70f2ffd640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f40d00d0 0x7f70f4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70f37fe640 1 -- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d3910 msgr2=0x7f70f40b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70f37fe640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d3910 0x7f70f40b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70f37fe640 1 -- 172.21.15.183:0/4198721676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f40d00d0 msgr2=0x7f70f4154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.729 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70f37fe640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f40d00d0 0x7f70f4154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.730 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70f37fe640 1 -- 172.21.15.183:0/4198721676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009a70 con 0x7f70f40cfcf0 2023-11-24T08:06:25.730 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70f37fe640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f40cfcf0 0x7f70f40cc730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70e400d800 tx=0x7f70e400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.730 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70dbfff640 1 -- 172.21.15.183:0/4198721676 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e400b6c0 con 0x7f70f40cfcf0 2023-11-24T08:06:25.730 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70dbfff640 1 -- 172.21.15.183:0/4198721676 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e400b820 con 0x7f70f40cfcf0 2023-11-24T08:06:25.730 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f40cbc50 con 0x7f70f40cfcf0 2023-11-24T08:06:25.730 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70dbfff640 1 -- 172.21.15.183:0/4198721676 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e400bbb0 con 0x7f70f40cfcf0 2023-11-24T08:06:25.730 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.724+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f40b8a80 con 0x7f70f40cfcf0 2023-11-24T08:06:25.731 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.725+0000 7f70dbfff640 1 -- 172.21.15.183:0/4198721676 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70e401e760 con 0x7f70f40cfcf0 2023-11-24T08:06:25.731 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.725+0000 7f70dbfff640 1 -- 172.21.15.183:0/4198721676 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f70e400bd10 con 0x7f70f40cfcf0 2023-11-24T08:06:25.731 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.725+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f40cc580 con 0x7f70f40cfcf0 2023-11-24T08:06:25.731 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.728+0000 7f70dbfff640 1 -- 172.21.15.183:0/4198721676 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f70e4014570 con 0x7f70f40cfcf0 2023-11-24T08:06:25.733 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.732+0000 7f4e7e44c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:06:25.806 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.805+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6731ed00-f858-42ec-ad53-1d31d1b20790", "id": 7} v 0) v1 -- 0x7f70f40675d0 con 0x7f70f40cfcf0 2023-11-24T08:06:25.813 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.812+0000 7f70dbfff640 1 -- 172.21.15.183:0/4198721676 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6731ed00-f858-42ec-ad53-1d31d1b20790", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70e401eae0 con 0x7f70f40cfcf0 2023-11-24T08:06:25.813 INFO:teuthology.orchestra.run.smithi183.stdout:7 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f40cfcf0 msgr2=0x7f70f40cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f40cfcf0 0x7f70f40cc730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70e400d800 tx=0x7f70e400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 shutdown_connections 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40d3910 0x7f70f40b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70f40d00d0 0x7f70f4154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 --2- 172.21.15.183:0/4198721676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f40cfcf0 0x7f70f40cc730 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 >> 172.21.15.183:0/4198721676 conn(0x7f70f409c530 msgr2=0x7f70f40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.815 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 shutdown_connections 2023-11-24T08:06:25.816 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:06:25.813+0000 7f70fa11d640 1 -- 172.21.15.183:0/4198721676 wait complete. 2023-11-24T08:06:25.829 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T08:06:25.829 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T08:06:25.838 INFO:tasks.ceph.osd.0:Started 2023-11-24T08:06:25.838 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T08:06:25.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T08:06:25.846 INFO:tasks.ceph.osd.1:Started 2023-11-24T08:06:25.846 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T08:06:25.847 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T08:06:25.855 INFO:tasks.ceph.osd.2:Started 2023-11-24T08:06:25.855 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T08:06:25.855 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T08:06:25.862 INFO:tasks.ceph.osd.3:Started 2023-11-24T08:06:25.862 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T08:06:25.862 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T08:06:25.867 INFO:tasks.ceph.osd.4:Started 2023-11-24T08:06:25.867 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T08:06:25.868 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T08:06:25.872 INFO:tasks.ceph.osd.5:Started 2023-11-24T08:06:25.872 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T08:06:25.873 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T08:06:25.878 INFO:tasks.ceph.osd.6:Started 2023-11-24T08:06:25.878 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T08:06:25.878 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T08:06:25.883 INFO:tasks.ceph.osd.7:Started 2023-11-24T08:06:25.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:25.907 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:25.906+0000 7f4e7e44c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:06:26.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.110+0000 7f611e66b640 1 Processor -- start 2023-11-24T08:06:26.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.111+0000 7f611e66b640 1 -- start start 2023-11-24T08:06:26.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f611e66b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f61180ce8f0 0x7f61180ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:26.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f611e66b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:26.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f611e66b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61180d0de0 con 0x7f6118160f80 2023-11-24T08:06:26.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f611e66b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61180d10c0 con 0x7f61180ce8f0 2023-11-24T08:06:26.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f611e66b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180d13a0 con 0x7f61180b2a00 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f610ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f61180ce8f0 0x7f61180ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f610ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f61180ce8f0 0x7f61180ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34266/0 (socket says 172.21.15.97:34266) 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f610ffff640 1 -- 172.21.15.97:0/2637863373 learned_addr learned my addr 172.21.15.97:0/2637863373 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f611cc08640 1 --2- 172.21.15.97:0/2637863373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f610ffff640 1 -- 172.21.15.97:0/2637863373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 msgr2=0x7f61180b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f610ffff640 1 --2- 172.21.15.97:0/2637863373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f610ffff640 1 -- 172.21.15.97:0/2637863373 >> v1:172.21.15.183:6789/0 conn(0x7f6118160f80 legacy=0x7f6118161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:26.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.112+0000 7f610ffff640 1 -- 172.21.15.97:0/2637863373 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180d1680 con 0x7f61180ce8f0 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.113+0000 7f610ffff640 1 --2- 172.21.15.97:0/2637863373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61180ce8f0 0x7f61180ced30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6100009870 tx=0x7f610002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c531752950ead7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f61177fe640 1 -- 172.21.15.97:0/2637863373 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100031640 con 0x7f61180ce8f0 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f61177fe640 1 -- 172.21.15.97:0/2637863373 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61000317a0 con 0x7f61180ce8f0 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f61177fe640 1 -- 172.21.15.97:0/2637863373 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100031b30 con 0x7f61180ce8f0 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f611e66b640 1 -- 172.21.15.97:0/2637863373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61180ce8f0 msgr2=0x7f61180ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f611e66b640 1 --2- 172.21.15.97:0/2637863373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61180ce8f0 0x7f61180ced30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6100009870 tx=0x7f610002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f611e66b640 1 -- 172.21.15.97:0/2637863373 shutdown_connections 2023-11-24T08:06:26.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f611e66b640 1 --2- 172.21.15.97:0/2637863373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f611e66b640 1 --2- 172.21.15.97:0/2637863373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61180ce8f0 0x7f61180ced30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.114+0000 7f611e66b640 1 -- 172.21.15.97:0/2637863373 >> 172.21.15.97:0/2637863373 conn(0x7f611809c550 msgr2=0x7f61180d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:26.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.115+0000 7f611e66b640 1 -- 172.21.15.97:0/2637863373 shutdown_connections 2023-11-24T08:06:26.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.115+0000 7f611e66b640 1 -- 172.21.15.97:0/2637863373 wait complete. 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.116+0000 7f611e66b640 1 Processor -- start 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.116+0000 7f611e66b640 1 -- start start 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611e66b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611e66b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61180ce8f0 0x7f61180c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611e66b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6118160f80 0x7f611806b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611e66b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180c82d0 con 0x7f6118160f80 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611e66b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181f70b0 con 0x7f61180ce8f0 2023-11-24T08:06:26.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611e66b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61181f6530 con 0x7f61180b2a00 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611cc08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6118160f80 0x7f611806b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f6117fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.117+0000 7f611cc08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6118160f80 0x7f611806b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34278/0 (socket says 172.21.15.97:34278) 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611cc08640 1 -- 172.21.15.97:0/3329638123 learned_addr learned my addr 172.21.15.97:0/3329638123 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f610ffff640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61180ce8f0 0x7f61180c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611cc08640 1 -- 172.21.15.97:0/3329638123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 msgr2=0x7f61180c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611cc08640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611cc08640 1 -- 172.21.15.97:0/3329638123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61180ce8f0 msgr2=0x7f61180c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:26.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611cc08640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61180ce8f0 0x7f61180c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611cc08640 1 -- 172.21.15.97:0/3329638123 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000094d0 con 0x7f6118160f80 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611cc08640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6118160f80 0x7f611806b130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6110007e40 tx=0x7f611000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f61157fa640 1 -- 172.21.15.97:0/3329638123 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110014620 con 0x7f6118160f80 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f61157fa640 1 -- 172.21.15.97:0/3329638123 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611000ee90 con 0x7f6118160f80 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f61157fa640 1 -- 172.21.15.97:0/3329638123 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100149e0 con 0x7f6118160f80 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.118+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61181f6810 con 0x7f6118160f80 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.119+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61181f6dd0 con 0x7f6118160f80 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.119+0000 7f61157fa640 1 -- 172.21.15.97:0/3329638123 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f611001e460 con 0x7f6118160f80 2023-11-24T08:06:26.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.119+0000 7f61157fa640 1 -- 172.21.15.97:0/3329638123 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f611001ede0 con 0x7f6118160f80 2023-11-24T08:06:26.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.120+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61180675d0 con 0x7f6118160f80 2023-11-24T08:06:26.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.123+0000 7f61157fa640 1 -- 172.21.15.97:0/3329638123 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f611001e710 con 0x7f6118160f80 2023-11-24T08:06:26.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.205+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61180b90d0 con 0x7f6118160f80 2023-11-24T08:06:26.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.206+0000 7f61157fa640 1 -- 172.21.15.97:0/3329638123 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f611002c090 con 0x7f6118160f80 2023-11-24T08:06:26.208 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:26.208 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":10,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:25.807374+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:26.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.207+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6118160f80 msgr2=0x7f611806b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:26.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.207+0000 7f611e66b640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6118160f80 0x7f611806b130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6110007e40 tx=0x7f611000e4b0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.207+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 shutdown_connections 2023-11-24T08:06:26.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.207+0000 7f611e66b640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6118160f80 0x7f611806b130 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.207+0000 7f611e66b640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61180ce8f0 0x7f61180c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.207+0000 7f611e66b640 1 --2- 172.21.15.97:0/3329638123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61180b2a00 0x7f61180c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:26.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.208+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 >> 172.21.15.97:0/3329638123 conn(0x7f611809c550 msgr2=0x7f61180d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:26.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.208+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 shutdown_connections 2023-11-24T08:06:26.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:26.208+0000 7f611e66b640 1 -- 172.21.15.97:0/3329638123 wait complete. 2023-11-24T08:06:26.226 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T08:06:26.226 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T08:06:26.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:26.479 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:26.543 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-11-24T08:06:26.540+0000 7f0c1500e500 -1 Falling back to public interface 2023-11-24T08:06:26.546 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-24T08:06:26.545+0000 7f9155a07500 -1 Falling back to public interface 2023-11-24T08:06:26.553 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-11-24T08:06:26.550+0000 7f1f99a14500 -1 Falling back to public interface 2023-11-24T08:06:26.568 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-11-24T08:06:26.566+0000 7fbc16e1e500 -1 Falling back to public interface 2023-11-24T08:06:26.573 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-24T08:06:26.572+0000 7f401e60c500 -1 Falling back to public interface 2023-11-24T08:06:26.590 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-24T08:06:26.589+0000 7f5313413500 -1 Falling back to public interface 2023-11-24T08:06:26.592 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-24T08:06:26.591+0000 7fc2f7a8c500 -1 Falling back to public interface 2023-11-24T08:06:26.595 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-11-24T08:06:26.593+0000 7f835820c500 -1 Falling back to public interface 2023-11-24T08:06:26.733 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:26.730+0000 7f965a456040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:06:26.926 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:26.925+0000 7f4e7e44c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:06:27.032 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:27.063 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:27.060+0000 7f965a456040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:06:27.126 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:27.124+0000 7f965a456040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:06:27.191 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.188+0000 7efc135de640 1 Processor -- start 2023-11-24T08:06:27.192 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.189+0000 7efc135de640 1 -- start start 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc135de640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc0c144a00 0x7efc0c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc135de640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc135de640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc0c06c720 0x7efc0c15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc135de640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c06cbb0 con 0x7efc0c06c720 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc135de640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c070b30 con 0x7efc0c144a00 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc135de640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c070520 con 0x7efc0c0cccc0 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc11b7b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc0c06c720 0x7efc0c15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc10b79640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc11b7b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc0c06c720 0x7efc0c15ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34294/0 (socket says 172.21.15.97:34294) 2023-11-24T08:06:27.194 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc11b7b640 1 -- 172.21.15.97:0/1459853891 learned_addr learned my addr 172.21.15.97:0/1459853891 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:27.195 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.190+0000 7efc1137a640 1 --2- 172.21.15.97:0/1459853891 >> v2:172.21.15.183:3300/0 conn(0x7efc0c144a00 0x7efc0c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.195 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.191+0000 7efc11b7b640 1 -- 172.21.15.97:0/1459853891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 msgr2=0x7efc0c06c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:27.195 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.191+0000 7efc11b7b640 1 --2- 172.21.15.97:0/1459853891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c06c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.195 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.191+0000 7efc11b7b640 1 -- 172.21.15.97:0/1459853891 >> v2:172.21.15.183:3300/0 conn(0x7efc0c144a00 msgr2=0x7efc0c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:27.195 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.191+0000 7efc11b7b640 1 --2- 172.21.15.97:0/1459853891 >> v2:172.21.15.183:3300/0 conn(0x7efc0c144a00 0x7efc0c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.195 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.191+0000 7efc11b7b640 1 -- 172.21.15.97:0/1459853891 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0cd470 con 0x7efc0c06c720 2023-11-24T08:06:27.197 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.192+0000 7efc11b7b640 1 --2- 172.21.15.97:0/1459853891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c15ec60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0b4340 tx=0x7efc0402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98504c4d9e441eae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:27.198 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.192+0000 7efc03fff640 1 -- 172.21.15.97:0/1459853891 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0402ca70 con 0x7efc0c06c720 2023-11-24T08:06:27.198 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.192+0000 7efc03fff640 1 -- 172.21.15.97:0/1459853891 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0402cbd0 con 0x7efc0c06c720 2023-11-24T08:06:27.198 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.192+0000 7efc03fff640 1 -- 172.21.15.97:0/1459853891 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040343f0 con 0x7efc0c06c720 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 -- 172.21.15.97:0/1459853891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 msgr2=0x7efc0c15ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 --2- 172.21.15.97:0/1459853891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c15ec60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0b4340 tx=0x7efc0402bed0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 -- 172.21.15.97:0/1459853891 shutdown_connections 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 --2- 172.21.15.97:0/1459853891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c15ec60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 --2- 172.21.15.97:0/1459853891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c06c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 --2- 172.21.15.97:0/1459853891 >> v2:172.21.15.183:3300/0 conn(0x7efc0c144a00 0x7efc0c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 -- 172.21.15.97:0/1459853891 >> 172.21.15.97:0/1459853891 conn(0x7efc0c06dd50 msgr2=0x7efc0c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 -- 172.21.15.97:0/1459853891 shutdown_connections 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.193+0000 7efc135de640 1 -- 172.21.15.97:0/1459853891 wait complete. 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.194+0000 7efc135de640 1 Processor -- start 2023-11-24T08:06:27.199 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.195+0000 7efc135de640 1 -- start start 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.195+0000 7efc135de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c13a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.195+0000 7efc135de640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c0ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc135de640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc0c144a00 0x7efc0c13e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc135de640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0ad5f0 con 0x7efc0c06c720 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc135de640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0ac970 con 0x7efc0c144a00 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc135de640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0acc50 con 0x7efc0c0cccc0 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c13a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c13a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34310/0 (socket says 172.21.15.97:34310) 2023-11-24T08:06:27.202 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 -- 172.21.15.97:0/2861839981 learned_addr learned my addr 172.21.15.97:0/2861839981 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc10b79640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c0ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc11b7b640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc0c144a00 0x7efc0c13e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 -- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 msgr2=0x7efc0c0ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c0ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 -- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc0c144a00 msgr2=0x7efc0c13e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc0c144a00 0x7efc0c13e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 -- 172.21.15.97:0/2861839981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc04009b30 con 0x7efc0c06c720 2023-11-24T08:06:27.203 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.196+0000 7efc1137a640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c13a960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e9b0 tx=0x7efc0800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.197+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08009670 con 0x7efc0c06c720 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.197+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800c9a0 con 0x7efc0c06c720 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.197+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800cd50 con 0x7efc0c06c720 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.197+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c0acf30 con 0x7efc0c06c720 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.197+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c13aea0 con 0x7efc0c06c720 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.197+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc08005c90 con 0x7efc0c06c720 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.197+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7efc08013470 con 0x7efc0c06c720 2023-11-24T08:06:27.204 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.198+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c0ad860 con 0x7efc0c06c720 2023-11-24T08:06:27.205 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.200+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7efc08021060 con 0x7efc0c06c720 2023-11-24T08:06:27.235 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:27.233+0000 7f4e7e44c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:06:27.247 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:27.244+0000 7f965a456040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:06:27.259 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.257+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mgrmap(e 2) v1 ==== 44567+0+0 (secure 0 0 0) 0x7efc08005f40 con 0x7efc0c06c720 2023-11-24T08:06:27.275 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.272+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc0c0675d0 con 0x7efc0c06c720 2023-11-24T08:06:27.275 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.273+0000 7efc01ffb640 1 -- 172.21.15.97:0/2861839981 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7efc0801b7c0 con 0x7efc0c06c720 2023-11-24T08:06:27.276 INFO:teuthology.misc.health.smithi097.stdout: 2023-11-24T08:06:27.276 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":10,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:25.807374+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:27.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 msgr2=0x7efc0c13a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:27.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c13a960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e9b0 tx=0x7efc0800ee70 comp rx=0 tx=0).stop 2023-11-24T08:06:27.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 shutdown_connections 2023-11-24T08:06:27.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc0c144a00 0x7efc0c13e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc0c0cccc0 0x7efc0c0ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 --2- 172.21.15.97:0/2861839981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0c06c720 0x7efc0c13a960 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:27.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 >> 172.21.15.97:0/2861839981 conn(0x7efc0c06dd50 msgr2=0x7efc0c0af520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:27.278 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 shutdown_connections 2023-11-24T08:06:27.278 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:27.274+0000 7efc135de640 1 -- 172.21.15.97:0/2861839981 wait complete. 2023-11-24T08:06:27.291 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T08:06:27.300 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:27.298+0000 7f4e7e44c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:06:27.416 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-11-24T08:06:27.414+0000 7f4e7e44c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:06:28.278 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:28.275+0000 7f95fb8bc640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T08:06:28.280 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-11-24T08:06:28.278+0000 7f95fb8bc640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T08:06:30.053 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-11-24T08:06:30.051+0000 7f0c1500e500 -1 osd.1 0 log_to_monitors true 2023-11-24T08:06:30.072 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-24T08:06:30.070+0000 7f9155a07500 -1 osd.4 0 log_to_monitors true 2023-11-24T08:06:30.103 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-24T08:06:30.101+0000 7f401e60c500 -1 osd.7 0 log_to_monitors true 2023-11-24T08:06:30.137 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-11-24T08:06:30.134+0000 7fbc16e1e500 -1 osd.2 0 log_to_monitors true 2023-11-24T08:06:30.143 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-11-24T08:06:30.140+0000 7f835820c500 -1 osd.3 0 log_to_monitors true 2023-11-24T08:06:30.164 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-24T08:06:30.162+0000 7fc2f7a8c500 -1 osd.6 0 log_to_monitors true 2023-11-24T08:06:30.167 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-24T08:06:30.165+0000 7f5313413500 -1 osd.5 0 log_to_monitors true 2023-11-24T08:06:30.352 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-11-24T08:06:30.349+0000 7f1f99a14500 -1 osd.0 0 log_to_monitors true 2023-11-24T08:06:33.220 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-11-24T08:06:33.218+0000 7fbc11eca640 -1 osd.2 0 waiting for initial osdmap 2023-11-24T08:06:33.228 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-11-24T08:06:33.226+0000 7fbc0a503640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:33.257 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-11-24T08:06:33.254+0000 7f0c100bc640 -1 osd.1 0 waiting for initial osdmap 2023-11-24T08:06:33.269 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-11-24T08:06:33.267+0000 7f0c086f5640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:33.362 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-11-24T08:06:33.360+0000 7f83551af640 -1 osd.3 0 waiting for initial osdmap 2023-11-24T08:06:33.372 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-11-24T08:06:33.369+0000 7f834bfb0640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:33.489 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-24T08:06:33.487+0000 7f530e4ab640 -1 osd.5 0 waiting for initial osdmap 2023-11-24T08:06:33.500 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-11-24T08:06:33.498+0000 7f5306ae4640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:33.532 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-24T08:06:33.530+0000 7f40197b9640 -1 osd.7 0 waiting for initial osdmap 2023-11-24T08:06:33.542 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-11-24T08:06:33.541+0000 7f4011df2640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:33.564 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-24T08:06:33.562+0000 7f91529aa640 -1 osd.4 0 waiting for initial osdmap 2023-11-24T08:06:33.579 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-11-24T08:06:33.577+0000 7f91497ab640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:33.595 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-24T08:06:33.593+0000 7fc2f31f9640 -1 osd.6 0 waiting for initial osdmap 2023-11-24T08:06:33.607 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-11-24T08:06:33.605+0000 7fc2eb832640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:33.707 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-11-24T08:06:33.705+0000 7f1f969b9640 -1 osd.0 0 waiting for initial osdmap 2023-11-24T08:06:33.718 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-11-24T08:06:33.715+0000 7f1f8d7ba640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:06:34.095 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:34.275 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.272+0000 7f7a020da640 1 Processor -- start 2023-11-24T08:06:34.275 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.273+0000 7f7a020da640 1 -- start start 2023-11-24T08:06:34.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.274+0000 7f7a020da640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f79fc144a00 0x7f79fc0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.274+0000 7f7a020da640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc070b30 con 0x7f79fc0cccc0 2023-11-24T08:06:34.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.274+0000 7f7a020da640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc070520 con 0x7f79fc06c8f0 2023-11-24T08:06:34.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.274+0000 7f7a020da640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc0cd470 con 0x7f79fc144a00 2023-11-24T08:06:34.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.274+0000 7f79faffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f79fc0cccc0 0x7f79fc06c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60590/0 (socket says 172.21.15.97:60590) 2023-11-24T08:06:34.277 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.274+0000 7f79faffd640 1 -- 172.21.15.97:0/3750768609 learned_addr learned my addr 172.21.15.97:0/3750768609 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:34.280 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fb7fe640 1 --2- 172.21.15.97:0/3750768609 >> v2:172.21.15.183:3300/0 conn(0x7f79fc144a00 0x7f79fc0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.280 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962130718 0 0) 0x7f79fc070b30 con 0x7f79fc0cccc0 2023-11-24T08:06:34.281 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc003520 con 0x7f79fc0cccc0 2023-11-24T08:06:34.281 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4200313894 0 0) 0x7f79dc003520 con 0x7f79fc0cccc0 2023-11-24T08:06:34.281 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 >> v2:172.21.15.183:3300/0 conn(0x7f79fc144a00 msgr2=0x7f79fc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:34.281 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 --2- 172.21.15.97:0/3750768609 >> v2:172.21.15.183:3300/0 conn(0x7f79fc144a00 0x7f79fc0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.282 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 >> v1:172.21.15.183:6789/0 conn(0x7f79fc06c8f0 legacy=0x7f79fc070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.282 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0cd190 con 0x7f79fc0cccc0 2023-11-24T08:06:34.282 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f79e40019f0 con 0x7f79fc0cccc0 2023-11-24T08:06:34.282 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 >> v1:172.21.15.97:6789/0 conn(0x7f79fc0cccc0 legacy=0x7f79fc06c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.282 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79dc0039c0 0x7f79dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc0047c0 0x7f79dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc005180 0x7f79dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0cd470 con 0x7f79dc0047c0 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc00c080 con 0x7f79dc0039c0 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc00c240 con 0x7f79dc005180 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.275+0000 7f79faffd640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc0047c0 0x7f79dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.276+0000 7f79fb7fe640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79dc0039c0 0x7f79dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.276+0000 7f79faffd640 1 -- 172.21.15.97:0/3750768609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc005180 msgr2=0x7f79dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.276+0000 7f79faffd640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc005180 0x7f79dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.276+0000 7f79faffd640 1 -- 172.21.15.97:0/3750768609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79dc0039c0 msgr2=0x7f79dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:34.283 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.276+0000 7f79faffd640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79dc0039c0 0x7f79dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.276+0000 7f79faffd640 1 -- 172.21.15.97:0/3750768609 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc003520 con 0x7f79dc0047c0 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.276+0000 7f79fbfff640 1 -- 172.21.15.97:0/3750768609 reap_dead start 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f79faffd640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc0047c0 0x7f79dc004c40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79e40013d0 tx=0x7f79dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f73d88bbf74d0d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4034630 con 0x7f79dc0047c0 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e402f070 con 0x7f79dc0047c0 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f79fa7fc640 1 -- 172.21.15.97:0/3750768609 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4034a10 con 0x7f79dc0047c0 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f7a020da640 1 -- 172.21.15.97:0/3750768609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc0047c0 msgr2=0x7f79dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f7a020da640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc0047c0 0x7f79dc004c40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79e40013d0 tx=0x7f79dc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f7a020da640 1 -- 172.21.15.97:0/3750768609 shutdown_connections 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f7a020da640 1 --2- 172.21.15.97:0/3750768609 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79dc0047c0 0x7f79dc004c40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.277+0000 7f7a020da640 1 -- 172.21.15.97:0/3750768609 >> 172.21.15.97:0/3750768609 conn(0x7f79fc06dd50 msgr2=0x7f79fc06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:34.284 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.278+0000 7f7a020da640 1 -- 172.21.15.97:0/3750768609 shutdown_connections 2023-11-24T08:06:34.285 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.278+0000 7f7a020da640 1 -- 172.21.15.97:0/3750768609 wait complete. 2023-11-24T08:06:34.287 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.279+0000 7f7a020da640 1 Processor -- start 2023-11-24T08:06:34.287 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.279+0000 7f7a020da640 1 -- start start 2023-11-24T08:06:34.287 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.280+0000 7f7a020da640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc0047c0 0x7f79fc0b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.287 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.280+0000 7f7a020da640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79fc158970 0x7f79fc1f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.280+0000 7f7a020da640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79fc13ae20 0x7f79fc13c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.280+0000 7f7a020da640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc1f3f80 con 0x7f79fc158970 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.280+0000 7f7a020da640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc158550 con 0x7f79fc13ae20 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.280+0000 7f7a020da640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc13a210 con 0x7f79dc0047c0 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79fc158970 0x7f79fc1f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79fc158970 0x7f79fc1f3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34430/0 (socket says 172.21.15.97:34430) 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 -- 172.21.15.97:0/4280416709 learned_addr learned my addr 172.21.15.97:0/4280416709 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79fbfff640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79fc13ae20 0x7f79fc13c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79fb7fe640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc0047c0 0x7f79fc0b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 -- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc0047c0 msgr2=0x7f79fc0b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc0047c0 0x7f79fc0b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.288 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 -- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79fc13ae20 msgr2=0x7f79fc13c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79fc13ae20 0x7f79fc13c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 -- 172.21.15.97:0/4280416709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc158dd0 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79faffd640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79fc158970 0x7f79fc1f3830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f79e402ca70 tx=0x7f79e4001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79f3fff640 1 -- 172.21.15.97:0/4280416709 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4034630 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79f3fff640 1 -- 172.21.15.97:0/4280416709 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4034790 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.281+0000 7f79f3fff640 1 -- 172.21.15.97:0/4280416709 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4034b20 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.282+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc157bb0 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.282+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc158170 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.283+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc0675d0 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.284+0000 7f79f3fff640 1 -- 172.21.15.97:0/4280416709 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f79e4031030 con 0x7f79fc158970 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.284+0000 7f79f3fff640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f79e006ade0 0x7f79e006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.289 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.285+0000 7f79f3fff640 1 -- 172.21.15.97:0/4280416709 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f79e40ab150 con 0x7f79fc158970 2023-11-24T08:06:34.290 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.285+0000 7f79fb7fe640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f79e006ade0 0x7f79e006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.290 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.285+0000 7f79fb7fe640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f79e006ade0 0x7f79e006d2a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79fc050140 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:34.292 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.290+0000 7f79f3fff640 1 -- 172.21.15.97:0/4280416709 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79e40767a0 con 0x7f79fc158970 2023-11-24T08:06:34.475 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.473+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79fc0675d0 con 0x7f79fc158970 2023-11-24T08:06:34.476 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.474+0000 7f79f3fff640 1 -- 172.21.15.97:0/4280416709 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10908 (secure 0 0 0) 0x7f79e4079dc0 con 0x7f79fc158970 2023-11-24T08:06:34.476 INFO:teuthology.misc.health.smithi097.stdout: 2023-11-24T08:06:34.477 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":14,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:34.217142+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:34.479 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f79e006ade0 msgr2=0x7f79e006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.479 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f79e006ade0 0x7f79e006d2a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79fc050140 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-11-24T08:06:34.479 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79fc158970 msgr2=0x7f79fc1f3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.480 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79fc158970 0x7f79fc1f3830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f79e402ca70 tx=0x7f79e4001360 comp rx=0 tx=0).stop 2023-11-24T08:06:34.480 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 shutdown_connections 2023-11-24T08:06:34.480 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f79e006ade0 0x7f79e006d2a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.480 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79fc13ae20 0x7f79fc13c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.480 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79fc158970 0x7f79fc1f3830 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.480 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 --2- 172.21.15.97:0/4280416709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79dc0047c0 0x7f79fc0b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.480 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.476+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 >> 172.21.15.97:0/4280416709 conn(0x7f79fc06dd50 msgr2=0x7f79fc159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:34.481 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.477+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 shutdown_connections 2023-11-24T08:06:34.481 INFO:teuthology.misc.health.smithi097.stderr:2023-11-24T08:06:34.477+0000 7f7a020da640 1 -- 172.21.15.97:0/4280416709 wait complete. 2023-11-24T08:06:34.493 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T08:06:34.493 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T08:06:34.493 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:06:34.493 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:06:34.502 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:06:34.503 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:06:34.503 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:06:34.510 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:06:34.510 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:06:34.511 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:06:34.520 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:06:34.520 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:06:34.520 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:06:34.530 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:06:34.530 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T08:06:34.530 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:34.652 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-11-24T08:06:34.653 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-11-24T08:06:34.682 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-11-24T08:06:34.685 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-24T08:06:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.710+0000 7f1755973640 1 Processor -- start 2023-11-24T08:06:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.710+0000 7f1755973640 1 -- start start 2023-11-24T08:06:34.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1755973640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1750143c40 0x7f1750071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1755973640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17500717d0 0x7f17500cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1755973640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500cca40 0x7f175015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1755973640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500723c0 con 0x7f17500717d0 2023-11-24T08:06:34.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1755973640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1750070e50 con 0x7f1750143c40 2023-11-24T08:06:34.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1755973640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500cce40 con 0x7f17500cca40 2023-11-24T08:06:34.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17500717d0 0x7f17500cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17500717d0 0x7f17500cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34458/0 (socket says 172.21.15.97:34458) 2023-11-24T08:06:34.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 -- 172.21.15.97:0/1876529446 learned_addr learned my addr 172.21.15.97:0/1876529446 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:34.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1754971640 1 --2- 172.21.15.97:0/1876529446 >> v2:172.21.15.183:3300/0 conn(0x7f1750143c40 0x7f1750071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1755172640 1 --2- 172.21.15.97:0/1876529446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500cca40 0x7f175015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 -- 172.21.15.97:0/1876529446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500cca40 msgr2=0x7f175015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:34.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 --2- 172.21.15.97:0/1876529446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500cca40 0x7f175015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 -- 172.21.15.97:0/1876529446 >> v2:172.21.15.183:3300/0 conn(0x7f1750143c40 msgr2=0x7f1750071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:34.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 --2- 172.21.15.97:0/1876529446 >> v2:172.21.15.183:3300/0 conn(0x7f1750143c40 0x7f1750071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.712+0000 7f1747fff640 1 -- 172.21.15.97:0/1876529446 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750144020 con 0x7f17500717d0 2023-11-24T08:06:34.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.713+0000 7f1747fff640 1 --2- 172.21.15.97:0/1876529446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17500717d0 0x7f17500cc500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f175006e410 tx=0x7f174002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbbf6d367a65309 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:34.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f17477fe640 1 -- 172.21.15.97:0/1876529446 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400317e0 con 0x7f17500717d0 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f17477fe640 1 -- 172.21.15.97:0/1876529446 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740031940 con 0x7f17500717d0 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f17477fe640 1 -- 172.21.15.97:0/1876529446 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740031cd0 con 0x7f17500717d0 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 -- 172.21.15.97:0/1876529446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17500717d0 msgr2=0x7f17500cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 --2- 172.21.15.97:0/1876529446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17500717d0 0x7f17500cc500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f175006e410 tx=0x7f174002b880 comp rx=0 tx=0).stop 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 -- 172.21.15.97:0/1876529446 shutdown_connections 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 --2- 172.21.15.97:0/1876529446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500cca40 0x7f175015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 --2- 172.21.15.97:0/1876529446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17500717d0 0x7f17500cc500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 --2- 172.21.15.97:0/1876529446 >> v2:172.21.15.183:3300/0 conn(0x7f1750143c40 0x7f1750071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 -- 172.21.15.97:0/1876529446 >> 172.21.15.97:0/1876529446 conn(0x7f175006a800 msgr2=0x7f175006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:34.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 -- 172.21.15.97:0/1876529446 shutdown_connections 2023-11-24T08:06:34.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.714+0000 7f1755973640 1 -- 172.21.15.97:0/1876529446 wait complete. 2023-11-24T08:06:34.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.716+0000 7f1755973640 1 Processor -- start 2023-11-24T08:06:34.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.716+0000 7f1755973640 1 -- start start 2023-11-24T08:06:34.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755973640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500717d0 0x7f1750142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755973640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17500cca40 0x7f175013ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755973640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1750143c40 0x7f175015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755973640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175013d730 con 0x7f1750143c40 2023-11-24T08:06:34.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755973640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175013c3b0 con 0x7f17500cca40 2023-11-24T08:06:34.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755973640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175013c690 con 0x7f17500717d0 2023-11-24T08:06:34.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755172640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1750143c40 0x7f175015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755172640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1750143c40 0x7f175015a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34474/0 (socket says 172.21.15.97:34474) 2023-11-24T08:06:34.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1755172640 1 -- 172.21.15.97:0/2929296441 learned_addr learned my addr 172.21.15.97:0/2929296441 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:34.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1754971640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500717d0 0x7f1750142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.717+0000 7f1747fff640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17500cca40 0x7f175013ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755172640 1 -- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500717d0 msgr2=0x7f1750142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755172640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500717d0 0x7f1750142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755172640 1 -- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17500cca40 msgr2=0x7f175013ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755172640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17500cca40 0x7f175013ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755172640 1 -- 172.21.15.97:0/2929296441 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400094d0 con 0x7f1750143c40 2023-11-24T08:06:34.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755172640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1750143c40 0x7f175015a3a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f174800e930 tx=0x7f174800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:34.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f17457fa640 1 -- 172.21.15.97:0/2929296441 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748009690 con 0x7f1750143c40 2023-11-24T08:06:34.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f17457fa640 1 -- 172.21.15.97:0/2929296441 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174800c980 con 0x7f1750143c40 2023-11-24T08:06:34.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f17457fa640 1 -- 172.21.15.97:0/2929296441 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800cd30 con 0x7f1750143c40 2023-11-24T08:06:34.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175013c970 con 0x7f1750143c40 2023-11-24T08:06:34.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.718+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175013cf30 con 0x7f1750143c40 2023-11-24T08:06:34.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.719+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1750140b50 con 0x7f1750143c40 2023-11-24T08:06:34.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.720+0000 7f17457fa640 1 -- 172.21.15.97:0/2929296441 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f1748013470 con 0x7f1750143c40 2023-11-24T08:06:34.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.721+0000 7f17457fa640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173c06adb0 0x7f173c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:34.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.721+0000 7f17457fa640 1 -- 172.21.15.97:0/2929296441 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f1748089380 con 0x7f1750143c40 2023-11-24T08:06:34.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.721+0000 7f1754971640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173c06adb0 0x7f173c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:34.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.722+0000 7f1754971640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173c06adb0 0x7f173c06d270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f174c0113e0 tx=0x7f174c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:34.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.726+0000 7f17457fa640 1 -- 172.21.15.97:0/2929296441 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1748054a20 con 0x7f1750143c40 2023-11-24T08:06:34.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.917+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1750067450 con 0x7f1750143c40 2023-11-24T08:06:34.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.919+0000 7f17457fa640 1 -- 172.21.15.97:0/2929296441 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10908 (secure 0 0 0) 0x7f1748021090 con 0x7f1750143c40 2023-11-24T08:06:34.922 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:34.922 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":14,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:34.217142+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173c06adb0 msgr2=0x7f173c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173c06adb0 0x7f173c06d270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f174c0113e0 tx=0x7f174c00b040 comp rx=0 tx=0).stop 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1750143c40 msgr2=0x7f175015a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1750143c40 0x7f175015a3a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f174800e930 tx=0x7f174800edf0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 shutdown_connections 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173c06adb0 0x7f173c06d270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1750143c40 0x7f175015a3a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17500cca40 0x7f175013ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 --2- 172.21.15.97:0/2929296441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17500717d0 0x7f1750142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:34.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 >> 172.21.15.97:0/2929296441 conn(0x7f175006a800 msgr2=0x7f17500af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:34.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 shutdown_connections 2023-11-24T08:06:34.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:34.922+0000 7f1755973640 1 -- 172.21.15.97:0/2929296441 wait complete. 2023-11-24T08:06:34.943 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-24T08:06:34.943 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:35.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.146+0000 7f55809c8640 1 Processor -- start 2023-11-24T08:06:35.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.146+0000 7f55809c8640 1 -- start start 2023-11-24T08:06:35.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.147+0000 7f55809c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c160920 0x7f557c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:35.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f55809c8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f557c0cfe70 0x7f557c161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:35.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f55809c8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c0d0a10 con 0x7f557c0cf9f0 2023-11-24T08:06:35.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f55809c8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c0d1f50 con 0x7f557c0cfe70 2023-11-24T08:06:35.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f55809c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0cf080 con 0x7f557c160920 2023-11-24T08:06:35.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f557b59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f557c0cfe70 0x7f557c161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f557ad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c160920 0x7f557c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f557b59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f557c0cfe70 0x7f557c161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:33114/0 (socket says 172.21.15.97:33114) 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.148+0000 7f557b59e640 1 -- 172.21.15.97:0/2297325456 learned_addr learned my addr 172.21.15.97:0/2297325456 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.149+0000 7f557b59e640 1 -- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c160920 msgr2=0x7f557c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.149+0000 7f557b59e640 1 --2- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c160920 0x7f557c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.149+0000 7f557b59e640 1 -- 172.21.15.97:0/2297325456 >> v1:172.21.15.183:6789/0 conn(0x7f557c0cf9f0 legacy=0x7f557c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.149+0000 7f557b59e640 1 -- 172.21.15.97:0/2297325456 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0c6be0 con 0x7f557c0cfe70 2023-11-24T08:06:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.149+0000 7f557ad9d640 1 --2- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c160920 0x7f557c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.150+0000 7f557b59e640 1 --2- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c161720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5574009e50 tx=0x7f557402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7febb98c1a185393 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.151+0000 7f5579d9b640 1 -- 172.21.15.97:0/2297325456 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557402cb00 con 0x7f557c0cfe70 2023-11-24T08:06:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.151+0000 7f5579d9b640 1 -- 172.21.15.97:0/2297325456 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557402cc60 con 0x7f557c0cfe70 2023-11-24T08:06:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.151+0000 7f5579d9b640 1 -- 172.21.15.97:0/2297325456 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740343f0 con 0x7f557c0cfe70 2023-11-24T08:06:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.151+0000 7f55809c8640 1 -- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 msgr2=0x7f557c161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.151+0000 7f55809c8640 1 --2- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c161720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5574009e50 tx=0x7f557402bf60 comp rx=0 tx=0).stop 2023-11-24T08:06:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.152+0000 7f55809c8640 1 -- 172.21.15.97:0/2297325456 shutdown_connections 2023-11-24T08:06:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.152+0000 7f55809c8640 1 --2- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c161720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.152+0000 7f55809c8640 1 --2- 172.21.15.97:0/2297325456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c160920 0x7f557c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.152+0000 7f55809c8640 1 -- 172.21.15.97:0/2297325456 >> 172.21.15.97:0/2297325456 conn(0x7f557c0d3090 msgr2=0x7f557c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.152+0000 7f55809c8640 1 -- 172.21.15.97:0/2297325456 shutdown_connections 2023-11-24T08:06:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.152+0000 7f55809c8640 1 -- 172.21.15.97:0/2297325456 wait complete. 2023-11-24T08:06:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.154+0000 7f55809c8640 1 Processor -- start 2023-11-24T08:06:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.154+0000 7f55809c8640 1 -- start start 2023-11-24T08:06:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f55809c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c0cf9f0 0x7f557c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f55809c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f55809c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c160920 0x7f557c0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f55809c8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b7360 con 0x7f557c160920 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f55809c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b66d0 con 0x7f557c0cfe70 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f55809c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b69b0 con 0x7f557c0cf9f0 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f557b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c160920 0x7f557c0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f557b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c160920 0x7f557c0c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34480/0 (socket says 172.21.15.97:34480) 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.155+0000 7f557b59e640 1 -- 172.21.15.97:0/72266696 learned_addr learned my addr 172.21.15.97:0/72266696 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557ad9d640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c0cf9f0 0x7f557c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557a59c640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557b59e640 1 -- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c0cf9f0 msgr2=0x7f557c156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557b59e640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c0cf9f0 0x7f557c156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557b59e640 1 -- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 msgr2=0x7f557c0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557b59e640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c0b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557b59e640 1 -- 172.21.15.97:0/72266696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c009400 con 0x7f557c160920 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557ad9d640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c0cf9f0 0x7f557c156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557a59c640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.156+0000 7f557b59e640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c160920 0x7f557c0c7f60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5574009e50 tx=0x7f5574004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.157+0000 7f55637fe640 1 -- 172.21.15.97:0/72266696 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574009510 con 0x7f557c160920 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.157+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5574009b30 con 0x7f557c160920 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.157+0000 7f55637fe640 1 -- 172.21.15.97:0/72266696 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557403e450 con 0x7f557c160920 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.157+0000 7f55637fe640 1 -- 172.21.15.97:0/72266696 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557403e820 con 0x7f557c160920 2023-11-24T08:06:35.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.157+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c0b6ff0 con 0x7f557c160920 2023-11-24T08:06:35.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.158+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c161d10 con 0x7f557c160920 2023-11-24T08:06:35.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.159+0000 7f55637fe640 1 -- 172.21.15.97:0/72266696 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f557403e980 con 0x7f557c160920 2023-11-24T08:06:35.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.160+0000 7f55637fe640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f556806adb0 0x7f556806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:35.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.160+0000 7f55637fe640 1 -- 172.21.15.97:0/72266696 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f55740abea0 con 0x7f557c160920 2023-11-24T08:06:35.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.160+0000 7f557ad9d640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f556806adb0 0x7f556806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:35.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.160+0000 7f557ad9d640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f556806adb0 0x7f556806d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f556c009d20 tx=0x7f556c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:35.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.164+0000 7f55637fe640 1 -- 172.21.15.97:0/72266696 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55740773e0 con 0x7f557c160920 2023-11-24T08:06:35.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.401+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f557c067450 con 0x7f557c160920 2023-11-24T08:06:35.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.402+0000 7f55637fe640 1 -- 172.21.15.97:0/72266696 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f557407aa00 con 0x7f557c160920 2023-11-24T08:06:35.405 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:35.405 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T08:06:35.405 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 2 2023-11-24T08:06:35.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.404+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f556806adb0 msgr2=0x7f556806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:35.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.404+0000 7f55809c8640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f556806adb0 0x7f556806d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f556c009d20 tx=0x7f556c008040 comp rx=0 tx=0).stop 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.404+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c160920 msgr2=0x7f557c0c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.404+0000 7f55809c8640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c160920 0x7f557c0c7f60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5574009e50 tx=0x7f5574004a40 comp rx=0 tx=0).stop 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 shutdown_connections 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f556806adb0 0x7f556806d270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c160920 0x7f557c0c7f60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f557c0cfe70 0x7f557c0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 --2- 172.21.15.97:0/72266696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f557c0cf9f0 0x7f557c156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 >> 172.21.15.97:0/72266696 conn(0x7f557c0d3090 msgr2=0x7f557c15af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 shutdown_connections 2023-11-24T08:06:35.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:35.405+0000 7f55809c8640 1 -- 172.21.15.97:0/72266696 wait complete. 2023-11-24T08:06:37.428 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.646+0000 7ffad0d16640 1 Processor -- start 2023-11-24T08:06:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.646+0000 7ffad0d16640 1 -- start start 2023-11-24T08:06:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.647+0000 7ffad0d16640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffacc0d0100 0x7ffacc0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.647+0000 7ffad0d16640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffacc0d0f40 0x7ffacc0d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.647+0000 7ffad0d16640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0d0a10 con 0x7ffacc160920 2023-11-24T08:06:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.647+0000 7ffad0d16640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0cf080 con 0x7ffacc0d0100 2023-11-24T08:06:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.647+0000 7ffad0d16640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0c6be0 con 0x7ffacc0d0f40 2023-11-24T08:06:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacaffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffacc0d0100 0x7ffacc0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacaffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffacc0d0100 0x7ffacc0b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39056/0 (socket says 172.21.15.97:39056) 2023-11-24T08:06:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacaffd640 1 -- 172.21.15.97:0/3807046933 learned_addr learned my addr 172.21.15.97:0/3807046933 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacbfff640 1 --2- 172.21.15.97:0/3807046933 >> v2:172.21.15.183:3300/0 conn(0x7ffacc0d0f40 0x7ffacc0d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacaffd640 1 -- 172.21.15.97:0/3807046933 >> v2:172.21.15.183:3300/0 conn(0x7ffacc0d0f40 msgr2=0x7ffacc0d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacaffd640 1 --2- 172.21.15.97:0/3807046933 >> v2:172.21.15.183:3300/0 conn(0x7ffacc0d0f40 0x7ffacc0d1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacaffd640 1 -- 172.21.15.97:0/3807046933 >> v1:172.21.15.183:6789/0 conn(0x7ffacc160920 legacy=0x7ffacc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:37.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacaffd640 1 -- 172.21.15.97:0/3807046933 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0ce7e0 con 0x7ffacc0d0100 2023-11-24T08:06:37.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.648+0000 7ffacbfff640 1 --2- 172.21.15.97:0/3807046933 >> v2:172.21.15.183:3300/0 conn(0x7ffacc0d0f40 0x7ffacc0d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:37.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.649+0000 7ffacaffd640 1 --2- 172.21.15.97:0/3807046933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc0d0100 0x7ffacc0b3f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffacc1620b0 tx=0x7ffac002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943d213f21b13ccf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:37.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffaca7fc640 1 -- 172.21.15.97:0/3807046933 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0031870 con 0x7ffacc0d0100 2023-11-24T08:06:37.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffaca7fc640 1 -- 172.21.15.97:0/3807046933 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac00319d0 con 0x7ffacc0d0100 2023-11-24T08:06:37.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffaca7fc640 1 -- 172.21.15.97:0/3807046933 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0031d60 con 0x7ffacc0d0100 2023-11-24T08:06:37.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 -- 172.21.15.97:0/3807046933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc0d0100 msgr2=0x7ffacc0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:37.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 --2- 172.21.15.97:0/3807046933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc0d0100 0x7ffacc0b3f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffacc1620b0 tx=0x7ffac002b910 comp rx=0 tx=0).stop 2023-11-24T08:06:37.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 -- 172.21.15.97:0/3807046933 shutdown_connections 2023-11-24T08:06:37.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 --2- 172.21.15.97:0/3807046933 >> v2:172.21.15.183:3300/0 conn(0x7ffacc0d0f40 0x7ffacc0d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 --2- 172.21.15.97:0/3807046933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc0d0100 0x7ffacc0b3f30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 -- 172.21.15.97:0/3807046933 >> 172.21.15.97:0/3807046933 conn(0x7ffacc0d3090 msgr2=0x7ffacc0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:37.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 -- 172.21.15.97:0/3807046933 shutdown_connections 2023-11-24T08:06:37.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.650+0000 7ffad0d16640 1 -- 172.21.15.97:0/3807046933 wait complete. 2023-11-24T08:06:37.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.652+0000 7ffad0d16640 1 Processor -- start 2023-11-24T08:06:37.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.652+0000 7ffad0d16640 1 -- start start 2023-11-24T08:06:37.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffad0d16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0d0100 0x7ffacc15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:37.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffad0d16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc0d0f40 0x7ffacc15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:37.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffad0d16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc160920 0x7ffacc15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:37.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffad0d16640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc149cb0 con 0x7ffacc160920 2023-11-24T08:06:37.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffad0d16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1f63f0 con 0x7ffacc0d0100 2023-11-24T08:06:37.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffad0d16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1f66d0 con 0x7ffacc0d0f40 2023-11-24T08:06:37.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffacbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc160920 0x7ffacc15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:37.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.653+0000 7ffacbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc160920 0x7ffacc15f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39064/0 (socket says 172.21.15.97:39064) 2023-11-24T08:06:37.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacbfff640 1 -- 172.21.15.97:0/807959593 learned_addr learned my addr 172.21.15.97:0/807959593 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:37.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacaffd640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc0d0f40 0x7ffacc15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:37.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacb7fe640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0d0100 0x7ffacc15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:37.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacbfff640 1 -- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc0d0f40 msgr2=0x7ffacc15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:37.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacbfff640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc0d0f40 0x7ffacc15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacbfff640 1 -- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0d0100 msgr2=0x7ffacc15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:37.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacbfff640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0d0100 0x7ffacc15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacbfff640 1 -- 172.21.15.97:0/807959593 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00094d0 con 0x7ffacc160920 2023-11-24T08:06:37.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.654+0000 7ffacbfff640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc160920 0x7ffacc15f2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007ef0 tx=0x7ffac400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:37.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.655+0000 7ffab3fff640 1 -- 172.21.15.97:0/807959593 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4003b90 con 0x7ffacc160920 2023-11-24T08:06:37.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.655+0000 7ffab3fff640 1 -- 172.21.15.97:0/807959593 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400f040 con 0x7ffacc160920 2023-11-24T08:06:37.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.655+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc1f69b0 con 0x7ffacc160920 2023-11-24T08:06:37.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.655+0000 7ffab3fff640 1 -- 172.21.15.97:0/807959593 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400de80 con 0x7ffacc160920 2023-11-24T08:06:37.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.655+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc1f6f70 con 0x7ffacc160920 2023-11-24T08:06:37.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.656+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc1f7190 con 0x7ffacc160920 2023-11-24T08:06:37.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.657+0000 7ffab3fff640 1 -- 172.21.15.97:0/807959593 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ffac4004030 con 0x7ffacc160920 2023-11-24T08:06:37.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.658+0000 7ffab3fff640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffab806adb0 0x7ffab806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:37.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.658+0000 7ffab3fff640 1 -- 172.21.15.97:0/807959593 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffac40894d0 con 0x7ffacc160920 2023-11-24T08:06:37.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.658+0000 7ffacb7fe640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffab806adb0 0x7ffab806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:37.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.659+0000 7ffacb7fe640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffab806adb0 0x7ffab806d270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:37.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.668+0000 7ffab3fff640 1 -- 172.21.15.97:0/807959593 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffac40549c0 con 0x7ffacc160920 2023-11-24T08:06:37.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.899+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffacc067450 con 0x7ffacc160920 2023-11-24T08:06:37.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.900+0000 7ffab3fff640 1 -- 172.21.15.97:0/807959593 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7ffac401a090 con 0x7ffacc160920 2023-11-24T08:06:37.903 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:37.903 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-24T08:06:37.903 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 3 2023-11-24T08:06:37.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffab806adb0 msgr2=0x7ffab806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:37.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffab806adb0 0x7ffab806d270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc008040 comp rx=0 tx=0).stop 2023-11-24T08:06:37.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc160920 msgr2=0x7ffacc15f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:37.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc160920 0x7ffacc15f2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007ef0 tx=0x7ffac400d4a0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 shutdown_connections 2023-11-24T08:06:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffab806adb0 0x7ffab806d270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffacc160920 0x7ffacc15f2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc0d0f40 0x7ffacc15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 --2- 172.21.15.97:0/807959593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0d0100 0x7ffacc15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.903+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 >> 172.21.15.97:0/807959593 conn(0x7ffacc0d3090 msgr2=0x7ffacc06b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.904+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 shutdown_connections 2023-11-24T08:06:37.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:37.904+0000 7ffad0d16640 1 -- 172.21.15.97:0/807959593 wait complete. 2023-11-24T08:06:37.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.112+0000 7fae73d1d640 1 Processor -- start 2023-11-24T08:06:38.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.112+0000 7fae73d1d640 1 -- start start 2023-11-24T08:06:38.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.113+0000 7fae73d1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae6c1547a0 0x7fae6c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae73d1d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae6c0715a0 0x7fae6c06b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae73d1d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae73d1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c15e7b0 con 0x7fae6c1547a0 2023-11-24T08:06:38.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae73d1d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c06bda0 con 0x7fae6c0715a0 2023-11-24T08:06:38.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae73d1d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c071d40 con 0x7fae6c06b930 2023-11-24T08:06:38.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae6c1547a0 0x7fae6c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae6c1547a0 0x7fae6c15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39072/0 (socket says 172.21.15.97:39072) 2023-11-24T08:06:38.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 -- 172.21.15.97:0/3306495554 learned_addr learned my addr 172.21.15.97:0/3306495554 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:38.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae722ba640 1 --2- 172.21.15.97:0/3306495554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae712b8640 1 --2- 172.21.15.97:0/3306495554 >> v2:172.21.15.183:3300/0 conn(0x7fae6c0715a0 0x7fae6c06b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 -- 172.21.15.97:0/3306495554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 msgr2=0x7fae6c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:38.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 --2- 172.21.15.97:0/3306495554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c06cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 -- 172.21.15.97:0/3306495554 >> v2:172.21.15.183:3300/0 conn(0x7fae6c0715a0 msgr2=0x7fae6c06b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:38.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 --2- 172.21.15.97:0/3306495554 >> v2:172.21.15.183:3300/0 conn(0x7fae6c0715a0 0x7fae6c06b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae71ab9640 1 -- 172.21.15.97:0/3306495554 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c154b80 con 0x7fae6c1547a0 2023-11-24T08:06:38.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae712b8640 1 --2- 172.21.15.97:0/3306495554 >> v2:172.21.15.183:3300/0 conn(0x7fae6c0715a0 0x7fae6c06b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:38.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.114+0000 7fae722ba640 1 --2- 172.21.15.97:0/3306495554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:38.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.115+0000 7fae71ab9640 1 --2- 172.21.15.97:0/3306495554 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c1547a0 0x7fae6c15b290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae6c06c5a0 tx=0x7fae6802da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8b68220295dcb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.116+0000 7fae70ab7640 1 -- 172.21.15.97:0/3306495554 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6802f840 con 0x7fae6c1547a0 2023-11-24T08:06:38.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.116+0000 7fae70ab7640 1 -- 172.21.15.97:0/3306495554 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6802f9a0 con 0x7fae6c1547a0 2023-11-24T08:06:38.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.116+0000 7fae70ab7640 1 -- 172.21.15.97:0/3306495554 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6802fd30 con 0x7fae6c1547a0 2023-11-24T08:06:38.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.116+0000 7fae73d1d640 1 -- 172.21.15.97:0/3306495554 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c1547a0 msgr2=0x7fae6c15b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.116+0000 7fae73d1d640 1 --2- 172.21.15.97:0/3306495554 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c1547a0 0x7fae6c15b290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae6c06c5a0 tx=0x7fae6802da80 comp rx=0 tx=0).stop 2023-11-24T08:06:38.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.117+0000 7fae73d1d640 1 -- 172.21.15.97:0/3306495554 shutdown_connections 2023-11-24T08:06:38.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.117+0000 7fae73d1d640 1 --2- 172.21.15.97:0/3306495554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.117+0000 7fae73d1d640 1 --2- 172.21.15.97:0/3306495554 >> v2:172.21.15.183:3300/0 conn(0x7fae6c0715a0 0x7fae6c06b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.117+0000 7fae73d1d640 1 --2- 172.21.15.97:0/3306495554 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c1547a0 0x7fae6c15b290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.117+0000 7fae73d1d640 1 -- 172.21.15.97:0/3306495554 >> 172.21.15.97:0/3306495554 conn(0x7fae6c070a80 msgr2=0x7fae6c070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:38.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.117+0000 7fae73d1d640 1 -- 172.21.15.97:0/3306495554 shutdown_connections 2023-11-24T08:06:38.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.117+0000 7fae73d1d640 1 -- 172.21.15.97:0/3306495554 wait complete. 2023-11-24T08:06:38.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.118+0000 7fae73d1d640 1 Processor -- start 2023-11-24T08:06:38.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.119+0000 7fae73d1d640 1 -- start start 2023-11-24T08:06:38.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.119+0000 7fae73d1d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.119+0000 7fae73d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c0715a0 0x7fae6c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.119+0000 7fae73d1d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae6c1547a0 0x7fae6c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.119+0000 7fae73d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c152800 con 0x7fae6c0715a0 2023-11-24T08:06:38.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.119+0000 7fae73d1d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0ca4e0 con 0x7fae6c1547a0 2023-11-24T08:06:38.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.119+0000 7fae73d1d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0cacf0 con 0x7fae6c06b930 2023-11-24T08:06:38.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c0715a0 0x7fae6c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c0715a0 0x7fae6c0cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39082/0 (socket says 172.21.15.97:39082) 2023-11-24T08:06:38.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 -- 172.21.15.97:0/1799892760 learned_addr learned my addr 172.21.15.97:0/1799892760 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:38.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae722ba640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae6c1547a0 0x7fae6c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae71ab9640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 -- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 msgr2=0x7fae6c1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c1522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 -- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae6c1547a0 msgr2=0x7fae6c0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae6c1547a0 0x7fae6c0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae712b8640 1 -- 172.21.15.97:0/1799892760 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680094d0 con 0x7fae6c0715a0 2023-11-24T08:06:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.120+0000 7fae722ba640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae6c1547a0 0x7fae6c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.121+0000 7fae712b8640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c0715a0 0x7fae6c0cb3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c7f0 tx=0x7fae5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.121+0000 7fae627fc640 1 -- 172.21.15.97:0/1799892760 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c007a30 con 0x7fae6c0715a0 2023-11-24T08:06:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.121+0000 7fae627fc640 1 -- 172.21.15.97:0/1799892760 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c007b90 con 0x7fae6c0715a0 2023-11-24T08:06:38.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.121+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c0cb920 con 0x7fae6c0715a0 2023-11-24T08:06:38.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.121+0000 7fae627fc640 1 -- 172.21.15.97:0/1799892760 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00ce40 con 0x7fae6c0715a0 2023-11-24T08:06:38.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.121+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c0caa10 con 0x7fae6c0715a0 2023-11-24T08:06:38.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.122+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c0b4960 con 0x7fae6c0715a0 2023-11-24T08:06:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.124+0000 7fae627fc640 1 -- 172.21.15.97:0/1799892760 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fae5c0113f0 con 0x7fae6c0715a0 2023-11-24T08:06:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.124+0000 7fae627fc640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fae5006adb0 0x7fae5006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.125+0000 7fae627fc640 1 -- 172.21.15.97:0/1799892760 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae5c0893a0 con 0x7fae6c0715a0 2023-11-24T08:06:38.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.125+0000 7fae71ab9640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fae5006adb0 0x7fae5006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.126+0000 7fae71ab9640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fae5006adb0 0x7fae5006d270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae68038000 tx=0x7fae6803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.129+0000 7fae627fc640 1 -- 172.21.15.97:0/1799892760 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae5c0547e0 con 0x7fae6c0715a0 2023-11-24T08:06:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.327+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae6c0cc3f0 con 0x7fae6c0715a0 2023-11-24T08:06:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.328+0000 7fae627fc640 1 -- 172.21.15.97:0/1799892760 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fae5c057e00 con 0x7fae6c0715a0 2023-11-24T08:06:38.331 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:38.332 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":18,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:38.239380+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:38.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fae5006adb0 msgr2=0x7fae5006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fae5006adb0 0x7fae5006d270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae68038000 tx=0x7fae6803b040 comp rx=0 tx=0).stop 2023-11-24T08:06:38.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c0715a0 msgr2=0x7fae6c0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c0715a0 0x7fae6c0cb3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c7f0 tx=0x7fae5c00cbf0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 shutdown_connections 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fae5006adb0 0x7fae5006d270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae6c1547a0 0x7fae6c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae6c0715a0 0x7fae6c0cb3e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 --2- 172.21.15.97:0/1799892760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae6c06b930 0x7fae6c1522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 >> 172.21.15.97:0/1799892760 conn(0x7fae6c070a80 msgr2=0x7fae6c15b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 shutdown_connections 2023-11-24T08:06:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.331+0000 7fae73d1d640 1 -- 172.21.15.97:0/1799892760 wait complete. 2023-11-24T08:06:38.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:06:38.351 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:06:38.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.537+0000 7f5752690640 1 Processor -- start 2023-11-24T08:06:38.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.537+0000 7f5752690640 1 -- start start 2023-11-24T08:06:38.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.538+0000 7f5752690640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f574c160f80 0x7f574c161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.538+0000 7f5752690640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f574c0ced50 0x7f574c0d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f5752690640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c1618a0 con 0x7f574c0ce8f0 2023-11-24T08:06:38.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f5752690640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0cf1e0 con 0x7f574c160f80 2023-11-24T08:06:38.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f5752690640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0d0de0 con 0x7f574c0ced50 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f574bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f574c160f80 0x7f574c161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f574bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f574c160f80 0x7f574c161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39086/0 (socket says 172.21.15.97:39086) 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f574bfff640 1 -- 172.21.15.97:0/1551703927 learned_addr learned my addr 172.21.15.97:0/1551703927 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f5750c2d640 1 --2- 172.21.15.97:0/1551703927 >> v2:172.21.15.183:3300/0 conn(0x7f574c0ced50 0x7f574c0d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f574bfff640 1 -- 172.21.15.97:0/1551703927 >> v2:172.21.15.183:3300/0 conn(0x7f574c0ced50 msgr2=0x7f574c0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f574bfff640 1 --2- 172.21.15.97:0/1551703927 >> v2:172.21.15.183:3300/0 conn(0x7f574c0ced50 0x7f574c0d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f574bfff640 1 -- 172.21.15.97:0/1551703927 >> v1:172.21.15.183:6789/0 conn(0x7f574c0ce8f0 legacy=0x7f574c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:38.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.539+0000 7f574bfff640 1 -- 172.21.15.97:0/1551703927 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0d10c0 con 0x7f574c160f80 2023-11-24T08:06:38.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.541+0000 7f574bfff640 1 --2- 172.21.15.97:0/1551703927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c160f80 0x7f574c161360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f574c0cfb50 tx=0x7f573c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2cc32f16d382e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.541+0000 7f574b7fe640 1 -- 172.21.15.97:0/1551703927 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c02ca80 con 0x7f574c160f80 2023-11-24T08:06:38.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.541+0000 7f574b7fe640 1 -- 172.21.15.97:0/1551703927 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c02cbe0 con 0x7f574c160f80 2023-11-24T08:06:38.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.541+0000 7f574b7fe640 1 -- 172.21.15.97:0/1551703927 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0343f0 con 0x7f574c160f80 2023-11-24T08:06:38.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.541+0000 7f5752690640 1 -- 172.21.15.97:0/1551703927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c160f80 msgr2=0x7f574c161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.541+0000 7f5752690640 1 --2- 172.21.15.97:0/1551703927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c160f80 0x7f574c161360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f574c0cfb50 tx=0x7f573c02bee0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.542+0000 7f5752690640 1 -- 172.21.15.97:0/1551703927 shutdown_connections 2023-11-24T08:06:38.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.542+0000 7f5752690640 1 --2- 172.21.15.97:0/1551703927 >> v2:172.21.15.183:3300/0 conn(0x7f574c0ced50 0x7f574c0d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.542+0000 7f5752690640 1 --2- 172.21.15.97:0/1551703927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c160f80 0x7f574c161360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.542+0000 7f5752690640 1 -- 172.21.15.97:0/1551703927 >> 172.21.15.97:0/1551703927 conn(0x7f574c09c550 msgr2=0x7f574c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:38.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.542+0000 7f5752690640 1 -- 172.21.15.97:0/1551703927 shutdown_connections 2023-11-24T08:06:38.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.542+0000 7f5752690640 1 -- 172.21.15.97:0/1551703927 wait complete. 2023-11-24T08:06:38.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.543+0000 7f5752690640 1 Processor -- start 2023-11-24T08:06:38.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.544+0000 7f5752690640 1 -- start start 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.544+0000 7f5752690640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f574c0ce8f0 0x7f574c15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.544+0000 7f5752690640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c0ced50 0x7f574c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.544+0000 7f5752690640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f574c160f80 0x7f574c0c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.544+0000 7f5752690640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c160600 con 0x7f574c0ced50 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.544+0000 7f5752690640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0b7010 con 0x7f574c160f80 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.544+0000 7f5752690640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c160320 con 0x7f574c0ce8f0 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c0ced50 0x7f574c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c0ced50 0x7f574c0cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39088/0 (socket says 172.21.15.97:39088) 2023-11-24T08:06:38.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 -- 172.21.15.97:0/2530812468 learned_addr learned my addr 172.21.15.97:0/2530812468 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 -- 172.21.15.97:0/2530812468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f574c0ce8f0 msgr2=0x7f574c15f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f574c0ce8f0 0x7f574c15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 -- 172.21.15.97:0/2530812468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f574c160f80 msgr2=0x7f574c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f574c160f80 0x7f574c0c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 -- 172.21.15.97:0/2530812468 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c009b30 con 0x7f574c0ced50 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.545+0000 7f57437fe640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c0ced50 0x7f574c0cfe10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f573400b3e0 tx=0x7f573400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.546+0000 7f57497fa640 1 -- 172.21.15.97:0/2530812468 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734011830 con 0x7f574c0ced50 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.546+0000 7f57497fa640 1 -- 172.21.15.97:0/2530812468 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57340119b0 con 0x7f574c0ced50 2023-11-24T08:06:38.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.546+0000 7f57497fa640 1 -- 172.21.15.97:0/2530812468 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734011d60 con 0x7f574c0ced50 2023-11-24T08:06:38.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.546+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c0b69c0 con 0x7f574c0ced50 2023-11-24T08:06:38.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.546+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c15fb10 con 0x7f574c0ced50 2023-11-24T08:06:38.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.547+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c0675d0 con 0x7f574c0ced50 2023-11-24T08:06:38.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.548+0000 7f57497fa640 1 -- 172.21.15.97:0/2530812468 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f573401a400 con 0x7f574c0ced50 2023-11-24T08:06:38.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.549+0000 7f57497fa640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f572c06adb0 0x7f572c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.549+0000 7f57497fa640 1 -- 172.21.15.97:0/2530812468 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f57340892d0 con 0x7f574c0ced50 2023-11-24T08:06:38.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.549+0000 7f574bfff640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f572c06adb0 0x7f572c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.550+0000 7f574bfff640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f572c06adb0 0x7f572c06d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f573c035000 tx=0x7f573c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.553+0000 7f57497fa640 1 -- 172.21.15.97:0/2530812468 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57340547e0 con 0x7f574c0ced50 2023-11-24T08:06:38.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.737+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f574c0b7180 con 0x7f574c0ced50 2023-11-24T08:06:38.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.738+0000 7f57497fa640 1 -- 172.21.15.97:0/2530812468 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57340150a0 con 0x7f574c0ced50 2023-11-24T08:06:38.741 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:06:38.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f572c06adb0 msgr2=0x7f572c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f572c06adb0 0x7f572c06d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f573c035000 tx=0x7f573c02e000 comp rx=0 tx=0).stop 2023-11-24T08:06:38.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c0ced50 msgr2=0x7f574c0cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c0ced50 0x7f574c0cfe10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f573400b3e0 tx=0x7f573400b8a0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 shutdown_connections 2023-11-24T08:06:38.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f572c06adb0 0x7f572c06d270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f574c160f80 0x7f574c0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f574c0ced50 0x7f574c0cfe10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 --2- 172.21.15.97:0/2530812468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f574c0ce8f0 0x7f574c15f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.740+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 >> 172.21.15.97:0/2530812468 conn(0x7f574c09c550 msgr2=0x7f574c0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:38.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.741+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 shutdown_connections 2023-11-24T08:06:38.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.741+0000 7f5752690640 1 -- 172.21.15.97:0/2530812468 wait complete. 2023-11-24T08:06:38.760 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:06:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.969+0000 7ff603215640 1 Processor -- start 2023-11-24T08:06:38.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.969+0000 7ff603215640 1 -- start start 2023-11-24T08:06:38.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.970+0000 7ff603215640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5fc143ae0 0x7ff5fc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.970+0000 7ff603215640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc0cf7d0 0x7ff5fc15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.970+0000 7ff603215640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5fc15e1e0 0x7ff5fc15a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.970+0000 7ff603215640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc0cfc30 con 0x7ff5fc15e1e0 2023-11-24T08:06:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.970+0000 7ff603215640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc0b1ee0 con 0x7ff5fc143ae0 2023-11-24T08:06:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.970+0000 7ff603215640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0b2780 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5fc15e1e0 0x7ff5fc15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5fc15e1e0 0x7ff5fc15a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39094/0 (socket says 172.21.15.97:39094) 2023-11-24T08:06:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 -- 172.21.15.97:0/3005634382 learned_addr learned my addr 172.21.15.97:0/3005634382 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff5fbfff640 1 --2- 172.21.15.97:0/3005634382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc0cf7d0 0x7ff5fc15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff600fb1640 1 --2- 172.21.15.97:0/3005634382 >> v2:172.21.15.183:3300/0 conn(0x7ff5fc143ae0 0x7ff5fc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 -- 172.21.15.97:0/3005634382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc0cf7d0 msgr2=0x7ff5fc15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:38.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 --2- 172.21.15.97:0/3005634382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc0cf7d0 0x7ff5fc15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 -- 172.21.15.97:0/3005634382 >> v2:172.21.15.183:3300/0 conn(0x7ff5fc143ae0 msgr2=0x7ff5fc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:38.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 --2- 172.21.15.97:0/3005634382 >> v2:172.21.15.183:3300/0 conn(0x7ff5fc143ae0 0x7ff5fc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff6017b2640 1 -- 172.21.15.97:0/3005634382 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc15e990 con 0x7ff5fc15e1e0 2023-11-24T08:06:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff5fbfff640 1 --2- 172.21.15.97:0/3005634382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc0cf7d0 0x7ff5fc15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.971+0000 7ff600fb1640 1 --2- 172.21.15.97:0/3005634382 >> v2:172.21.15.183:3300/0 conn(0x7ff5fc143ae0 0x7ff5fc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.972+0000 7ff6017b2640 1 --2- 172.21.15.97:0/3005634382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc15e1e0 0x7ff5fc15a670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0cfea0 tx=0x7ff5f402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd111641a55d4ca server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff5fb7fe640 1 -- 172.21.15.97:0/3005634382 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f402ea80 con 0x7ff5fc15e1e0 2023-11-24T08:06:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff5fb7fe640 1 -- 172.21.15.97:0/3005634382 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f402ebe0 con 0x7ff5fc15e1e0 2023-11-24T08:06:38.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff5fb7fe640 1 -- 172.21.15.97:0/3005634382 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4009600 con 0x7ff5fc15e1e0 2023-11-24T08:06:38.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 -- 172.21.15.97:0/3005634382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc15e1e0 msgr2=0x7ff5fc15a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 --2- 172.21.15.97:0/3005634382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc15e1e0 0x7ff5fc15a670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0cfea0 tx=0x7ff5f402e0e0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 -- 172.21.15.97:0/3005634382 shutdown_connections 2023-11-24T08:06:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 --2- 172.21.15.97:0/3005634382 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc15e1e0 0x7ff5fc15a670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 --2- 172.21.15.97:0/3005634382 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc0cf7d0 0x7ff5fc15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 --2- 172.21.15.97:0/3005634382 >> v2:172.21.15.183:3300/0 conn(0x7ff5fc143ae0 0x7ff5fc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 -- 172.21.15.97:0/3005634382 >> 172.21.15.97:0/3005634382 conn(0x7ff5fc06a800 msgr2=0x7ff5fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 -- 172.21.15.97:0/3005634382 shutdown_connections 2023-11-24T08:06:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.973+0000 7ff603215640 1 -- 172.21.15.97:0/3005634382 wait complete. 2023-11-24T08:06:38.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.975+0000 7ff603215640 1 Processor -- start 2023-11-24T08:06:38.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.975+0000 7ff603215640 1 -- start start 2023-11-24T08:06:38.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.976+0000 7ff603215640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc0cf7d0 0x7ff5fc159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.976+0000 7ff603215640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5fc143ae0 0x7ff5fc0ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.976+0000 7ff603215640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc15e1e0 0x7ff5fc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.976+0000 7ff603215640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc159eb0 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.976+0000 7ff603215640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0cd2d0 con 0x7ff5fc143ae0 2023-11-24T08:06:38.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.976+0000 7ff603215640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0cd5b0 con 0x7ff5fc15e1e0 2023-11-24T08:06:38.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc0cf7d0 0x7ff5fc159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc0cf7d0 0x7ff5fc159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39098/0 (socket says 172.21.15.97:39098) 2023-11-24T08:06:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 -- 172.21.15.97:0/71092590 learned_addr learned my addr 172.21.15.97:0/71092590 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff6017b2640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc15e1e0 0x7ff5fc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff5fbfff640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5fc143ae0 0x7ff5fc0ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 -- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc15e1e0 msgr2=0x7ff5fc0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc15e1e0 0x7ff5fc0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 -- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5fc143ae0 msgr2=0x7ff5fc0ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5fc143ae0 0x7ff5fc0ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 -- 172.21.15.97:0/71092590 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f400bd40 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.977+0000 7ff600fb1640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc0cf7d0 0x7ff5fc159970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c7f0 tx=0x7ff5f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.978+0000 7ff5f97fa640 1 -- 172.21.15.97:0/71092590 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0007a30 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.978+0000 7ff5f97fa640 1 -- 172.21.15.97:0/71092590 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0007b90 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.978+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc0ac8d0 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.978+0000 7ff5f97fa640 1 -- 172.21.15.97:0/71092590 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000ce40 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.978+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc0ace90 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.979+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc0675d0 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.980+0000 7ff5f97fa640 1 -- 172.21.15.97:0/71092590 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ff5f00113f0 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.981+0000 7ff5f97fa640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff5e006adb0 0x7ff5e006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:38.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.981+0000 7ff5f97fa640 1 -- 172.21.15.97:0/71092590 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5f0089280 con 0x7ff5fc0cf7d0 2023-11-24T08:06:38.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.981+0000 7ff5fbfff640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff5e006adb0 0x7ff5e006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:38.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.982+0000 7ff5fbfff640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff5e006adb0 0x7ff5e006d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8006fd0 tx=0x7ff5e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:38.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:38.985+0000 7ff5f97fa640 1 -- 172.21.15.97:0/71092590 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5f0054880 con 0x7ff5fc0cf7d0 2023-11-24T08:06:39.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.182+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff5fc06ae30 con 0x7ff5fc0cf7d0 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.183+0000 7ff5f97fa640 1 -- 172.21.15.97:0/71092590 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff5f0057ea0 con 0x7ff5fc0cf7d0 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:06:39.186 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-11-24T08:06:39.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff5e006adb0 msgr2=0x7ff5e006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:39.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff5e006adb0 0x7ff5e006d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8006fd0 tx=0x7ff5e8008040 comp rx=0 tx=0).stop 2023-11-24T08:06:39.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc0cf7d0 msgr2=0x7ff5fc159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:39.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc0cf7d0 0x7ff5fc159970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c7f0 tx=0x7ff5f000cbf0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 shutdown_connections 2023-11-24T08:06:39.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff5e006adb0 0x7ff5e006d270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5fc15e1e0 0x7ff5fc0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5fc143ae0 0x7ff5fc0ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 --2- 172.21.15.97:0/71092590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5fc0cf7d0 0x7ff5fc159970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 >> 172.21.15.97:0/71092590 conn(0x7ff5fc06a800 msgr2=0x7ff5fc0b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:39.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 shutdown_connections 2023-11-24T08:06:39.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.186+0000 7ff603215640 1 -- 172.21.15.97:0/71092590 wait complete. 2023-11-24T08:06:39.207 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:06:39.207 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:06:39.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.423+0000 7fd823836640 1 Processor -- start 2023-11-24T08:06:39.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.423+0000 7fd823836640 1 -- start start 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd823836640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd81c160f80 0x7fd81c161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd823836640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd81c0ce8f0 0x7fd81c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd823836640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c1618a0 con 0x7fd81c0cfbe0 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd823836640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81c0d0de0 con 0x7fd81c160f80 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd823836640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81c0d10c0 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd8215d2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd81c160f80 0x7fd81c161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd8215d2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd81c160f80 0x7fd81c161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39110/0 (socket says 172.21.15.97:39110) 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd8215d2640 1 -- 172.21.15.97:0/437500084 learned_addr learned my addr 172.21.15.97:0/437500084 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.425+0000 7fd820dd1640 1 --2- 172.21.15.97:0/437500084 >> v2:172.21.15.183:3300/0 conn(0x7fd81c0ce8f0 0x7fd81c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.426+0000 7fd8215d2640 1 -- 172.21.15.97:0/437500084 >> v2:172.21.15.183:3300/0 conn(0x7fd81c0ce8f0 msgr2=0x7fd81c0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.426+0000 7fd8215d2640 1 --2- 172.21.15.97:0/437500084 >> v2:172.21.15.183:3300/0 conn(0x7fd81c0ce8f0 0x7fd81c0ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.426+0000 7fd8215d2640 1 -- 172.21.15.97:0/437500084 >> v1:172.21.15.97:6789/0 conn(0x7fd81c0cfbe0 legacy=0x7fd81c0d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.426+0000 7fd8215d2640 1 -- 172.21.15.97:0/437500084 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c0d13a0 con 0x7fd81c160f80 2023-11-24T08:06:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.427+0000 7fd8215d2640 1 --2- 172.21.15.97:0/437500084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c160f80 0x7fd81c161360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0b5d10 tx=0x7fd81802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f20a20ff271cd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:39.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.427+0000 7fd813fff640 1 -- 172.21.15.97:0/437500084 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818030870 con 0x7fd81c160f80 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.427+0000 7fd813fff640 1 -- 172.21.15.97:0/437500084 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180309d0 con 0x7fd81c160f80 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.427+0000 7fd813fff640 1 -- 172.21.15.97:0/437500084 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818030d60 con 0x7fd81c160f80 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.427+0000 7fd823836640 1 -- 172.21.15.97:0/437500084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c160f80 msgr2=0x7fd81c161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.427+0000 7fd823836640 1 --2- 172.21.15.97:0/437500084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c160f80 0x7fd81c161360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0b5d10 tx=0x7fd81802b9b0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.428+0000 7fd823836640 1 -- 172.21.15.97:0/437500084 shutdown_connections 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.428+0000 7fd823836640 1 --2- 172.21.15.97:0/437500084 >> v2:172.21.15.183:3300/0 conn(0x7fd81c0ce8f0 0x7fd81c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.428+0000 7fd823836640 1 --2- 172.21.15.97:0/437500084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c160f80 0x7fd81c161360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.428+0000 7fd823836640 1 -- 172.21.15.97:0/437500084 >> 172.21.15.97:0/437500084 conn(0x7fd81c09c550 msgr2=0x7fd81c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:39.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.428+0000 7fd823836640 1 -- 172.21.15.97:0/437500084 shutdown_connections 2023-11-24T08:06:39.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.428+0000 7fd823836640 1 -- 172.21.15.97:0/437500084 wait complete. 2023-11-24T08:06:39.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.429+0000 7fd823836640 1 Processor -- start 2023-11-24T08:06:39.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.429+0000 7fd823836640 1 -- start start 2023-11-24T08:06:39.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.430+0000 7fd823836640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c0ce8f0 0x7fd81c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.430+0000 7fd823836640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c0cfbe0 0x7fd81c0c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.430+0000 7fd823836640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd81c160f80 0x7fd81c15f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.430+0000 7fd823836640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0cad70 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.430+0000 7fd823836640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0ca480 con 0x7fd81c0cfbe0 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.430+0000 7fd823836640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c15fed0 con 0x7fd81c160f80 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c0ce8f0 0x7fd81c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c0ce8f0 0x7fd81c151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39120/0 (socket says 172.21.15.97:39120) 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 -- 172.21.15.97:0/757416613 learned_addr learned my addr 172.21.15.97:0/757416613 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd820dd1640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c0cfbe0 0x7fd81c0c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:39.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 -- 172.21.15.97:0/757416613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd81c160f80 msgr2=0x7fd81c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:39.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd81c160f80 0x7fd81c15f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 -- 172.21.15.97:0/757416613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c0cfbe0 msgr2=0x7fd81c0c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:39.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c0cfbe0 0x7fd81c0c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:39.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 -- 172.21.15.97:0/757416613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8180094d0 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.431+0000 7fd8215d2640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c0ce8f0 0x7fd81c151db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd818000c00 tx=0x7fd818004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:39.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.432+0000 7fd811ffb640 1 -- 172.21.15.97:0/757416613 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818039c10 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.432+0000 7fd811ffb640 1 -- 172.21.15.97:0/757416613 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd818039d70 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.432+0000 7fd811ffb640 1 -- 172.21.15.97:0/757416613 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818043640 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.432+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81c0ca720 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.432+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c1522f0 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.433+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81c0d2160 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.434+0000 7fd811ffb640 1 -- 172.21.15.97:0/757416613 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd8180437a0 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.435+0000 7fd811ffb640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd80006adb0 0x7fd80006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:39.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.435+0000 7fd811ffb640 1 -- 172.21.15.97:0/757416613 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd81803e070 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.436+0000 7fd820dd1640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd80006adb0 0x7fd80006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.436+0000 7fd820dd1640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd80006adb0 0x7fd80006d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0c72d0 tx=0x7fd80c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:39.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.440+0000 7fd811ffb640 1 -- 172.21.15.97:0/757416613 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8180777d0 con 0x7fd81c0ce8f0 2023-11-24T08:06:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:39.631+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd81c0675d0 con 0x7fd81c0ce8f0 2023-11-24T08:06:40.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.584+0000 7fd811ffb640 1 -- 172.21.15.97:0/757416613 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd81807adf0 con 0x7fd81c0ce8f0 2023-11-24T08:06:40.587 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2023-11-24T08:06:40.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.588+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd80006adb0 msgr2=0x7fd80006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:40.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.588+0000 7fd823836640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd80006adb0 0x7fd80006d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0c72d0 tx=0x7fd80c008040 comp rx=0 tx=0).stop 2023-11-24T08:06:40.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.588+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c0ce8f0 msgr2=0x7fd81c151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.588+0000 7fd823836640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c0ce8f0 0x7fd81c151db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd818000c00 tx=0x7fd818004730 comp rx=0 tx=0).stop 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 shutdown_connections 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd80006adb0 0x7fd80006d270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd81c160f80 0x7fd81c15f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd81c0cfbe0 0x7fd81c0c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 --2- 172.21.15.97:0/757416613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd81c0ce8f0 0x7fd81c151db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 >> 172.21.15.97:0/757416613 conn(0x7fd81c09c550 msgr2=0x7fd81c06b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 shutdown_connections 2023-11-24T08:06:40.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.589+0000 7fd823836640 1 -- 172.21.15.97:0/757416613 wait complete. 2023-11-24T08:06:40.626 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:06:40.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.817+0000 7fe0ce1a0640 1 Processor -- start 2023-11-24T08:06:40.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.817+0000 7fe0ce1a0640 1 -- start start 2023-11-24T08:06:40.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0ce1a0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe0c80cc500 0x7fe0c80cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:40.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0ce1a0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0c806d160 0x7fe0c806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:40.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0ce1a0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c8070e50 con 0x7fe0c8143c40 2023-11-24T08:06:40.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0ce1a0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c80723c0 con 0x7fe0c806d160 2023-11-24T08:06:40.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0ce1a0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c80cced0 con 0x7fe0c80cc500 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0cd99f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0c806d160 0x7fe0c806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0cd99f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0c806d160 0x7fe0c806d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39146/0 (socket says 172.21.15.97:39146) 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0cd99f640 1 -- 172.21.15.97:0/3481288628 learned_addr learned my addr 172.21.15.97:0/3481288628 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.819+0000 7fe0cc99d640 1 --2- 172.21.15.97:0/3481288628 >> v2:172.21.15.183:3300/0 conn(0x7fe0c80cc500 0x7fe0c80cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.820+0000 7fe0cd99f640 1 -- 172.21.15.97:0/3481288628 >> v2:172.21.15.183:3300/0 conn(0x7fe0c80cc500 msgr2=0x7fe0c80cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.820+0000 7fe0cd99f640 1 --2- 172.21.15.97:0/3481288628 >> v2:172.21.15.183:3300/0 conn(0x7fe0c80cc500 0x7fe0c80cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.820+0000 7fe0cd99f640 1 -- 172.21.15.97:0/3481288628 >> v1:172.21.15.183:6789/0 conn(0x7fe0c8143c40 legacy=0x7fe0c8071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.820+0000 7fe0cd99f640 1 -- 172.21.15.97:0/3481288628 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c8144020 con 0x7fe0c806d160 2023-11-24T08:06:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.821+0000 7fe0cd99f640 1 --2- 172.21.15.97:0/3481288628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c806d160 0x7fe0c806d560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80b44a0 tx=0x7fe0c002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78db20be111a7522 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.821+0000 7fe0bffff640 1 -- 172.21.15.97:0/3481288628 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c002c9f0 con 0x7fe0c806d160 2023-11-24T08:06:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.821+0000 7fe0bffff640 1 -- 172.21.15.97:0/3481288628 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c002cb50 con 0x7fe0c806d160 2023-11-24T08:06:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.821+0000 7fe0bffff640 1 -- 172.21.15.97:0/3481288628 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00343f0 con 0x7fe0c806d160 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/3481288628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c806d160 msgr2=0x7fe0c806d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/3481288628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c806d160 0x7fe0c806d560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80b44a0 tx=0x7fe0c002be50 comp rx=0 tx=0).stop 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/3481288628 shutdown_connections 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/3481288628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c806d160 0x7fe0c806d560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/3481288628 >> v2:172.21.15.183:3300/0 conn(0x7fe0c80cc500 0x7fe0c80cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/3481288628 >> 172.21.15.97:0/3481288628 conn(0x7fe0c806a800 msgr2=0x7fe0c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/3481288628 shutdown_connections 2023-11-24T08:06:40.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.822+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/3481288628 wait complete. 2023-11-24T08:06:40.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.824+0000 7fe0ce1a0640 1 Processor -- start 2023-11-24T08:06:40.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.824+0000 7fe0ce1a0640 1 -- start start 2023-11-24T08:06:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0ce1a0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c806d160 0x7fe0c813b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0ce1a0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c80cc500 0x7fe0c81f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0ce1a0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c8143c40 0x7fe0c80ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0ce1a0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81f34a0 con 0x7fe0c8143c40 2023-11-24T08:06:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0ce1a0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81f3780 con 0x7fe0c80cc500 2023-11-24T08:06:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0ce1a0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81f3a60 con 0x7fe0c806d160 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c8143c40 0x7fe0c80ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c8143c40 0x7fe0c80ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39148/0 (socket says 172.21.15.97:39148) 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 -- 172.21.15.97:0/2318778418 learned_addr learned my addr 172.21.15.97:0/2318778418 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cc99d640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c80cc500 0x7fe0c81f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd19e640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c806d160 0x7fe0c813b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 -- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c806d160 msgr2=0x7fe0c813b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c806d160 0x7fe0c813b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 -- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c80cc500 msgr2=0x7fe0c81f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c80cc500 0x7fe0c81f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.826+0000 7fe0cd99f640 1 -- 172.21.15.97:0/2318778418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0009b30 con 0x7fe0c8143c40 2023-11-24T08:06:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.827+0000 7fe0cd99f640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c8143c40 0x7fe0c80ad600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0036040 tx=0x7fe0c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:40.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.827+0000 7fe0bdffb640 1 -- 172.21.15.97:0/2318778418 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0009510 con 0x7fe0c8143c40 2023-11-24T08:06:40.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.827+0000 7fe0bdffb640 1 -- 172.21.15.97:0/2318778418 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c003e450 con 0x7fe0c8143c40 2023-11-24T08:06:40.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.827+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c81f3d40 con 0x7fe0c8143c40 2023-11-24T08:06:40.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.827+0000 7fe0bdffb640 1 -- 172.21.15.97:0/2318778418 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c003e7e0 con 0x7fe0c8143c40 2023-11-24T08:06:40.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.827+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c813bef0 con 0x7fe0c8143c40 2023-11-24T08:06:40.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.828+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c80a96f0 con 0x7fe0c8143c40 2023-11-24T08:06:40.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.829+0000 7fe0bdffb640 1 -- 172.21.15.97:0/2318778418 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0c003e940 con 0x7fe0c8143c40 2023-11-24T08:06:40.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.830+0000 7fe0bdffb640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe0ac06ae40 0x7fe0ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:40.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.830+0000 7fe0bdffb640 1 -- 172.21.15.97:0/2318778418 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe0c00ac380 con 0x7fe0c8143c40 2023-11-24T08:06:40.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.831+0000 7fe0cd19e640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe0ac06ae40 0x7fe0ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:40.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.831+0000 7fe0cd19e640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe0ac06ae40 0x7fe0ac06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400a750 tx=0x7fe0c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:40.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:40.836+0000 7fe0bdffb640 1 -- 172.21.15.97:0/2318778418 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0c00774e0 con 0x7fe0c8143c40 2023-11-24T08:06:41.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.027+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe0c8067450 con 0x7fe0c8143c40 2023-11-24T08:06:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.598+0000 7fe0bdffb640 1 -- 172.21.15.97:0/2318778418 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe0c007ab00 con 0x7fe0c8143c40 2023-11-24T08:06:41.601 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2023-11-24T08:06:41.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe0ac06ae40 msgr2=0x7fe0ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe0ac06ae40 0x7fe0ac06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400a750 tx=0x7fe0c4008040 comp rx=0 tx=0).stop 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c8143c40 msgr2=0x7fe0c80ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c8143c40 0x7fe0c80ad600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0036040 tx=0x7fe0c0004a40 comp rx=0 tx=0).stop 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 shutdown_connections 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe0ac06ae40 0x7fe0ac06d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0c8143c40 0x7fe0c80ad600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c80cc500 0x7fe0c81f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 --2- 172.21.15.97:0/2318778418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c806d160 0x7fe0c813b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 >> 172.21.15.97:0/2318778418 conn(0x7fe0c806a800 msgr2=0x7fe0c8140060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 shutdown_connections 2023-11-24T08:06:41.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.602+0000 7fe0ce1a0640 1 -- 172.21.15.97:0/2318778418 wait complete. 2023-11-24T08:06:41.639 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:06:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.823+0000 7fe39322d640 1 Processor -- start 2023-11-24T08:06:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.824+0000 7fe39322d640 1 -- start start 2023-11-24T08:06:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe39322d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe38c0d17e0 0x7fe38c0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe39322d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c0d2180 con 0x7fe38c15d610 2023-11-24T08:06:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe39322d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c0b3400 con 0x7fe38c0b3890 2023-11-24T08:06:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe39322d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38c0d1390 con 0x7fe38c0d17e0 2023-11-24T08:06:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe390fc9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe38c15d610 0x7fe38c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46806/0 (socket says 172.21.15.97:46806) 2023-11-24T08:06:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe390fc9640 1 -- 172.21.15.97:0/3028547920 learned_addr learned my addr 172.21.15.97:0/3028547920 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe38bfff640 1 --2- 172.21.15.97:0/3028547920 >> v2:172.21.15.97:3300/0 conn(0x7fe38c0d17e0 0x7fe38c0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.825+0000 7fe38b7fe640 1 -- 172.21.15.97:0/3028547920 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186381052 0 0) 0x7fe38c0d2180 con 0x7fe38c15d610 2023-11-24T08:06:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.826+0000 7fe38b7fe640 1 -- 172.21.15.97:0/3028547920 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe37c003520 con 0x7fe38c15d610 2023-11-24T08:06:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.826+0000 7fe38bfff640 1 -- 172.21.15.97:0/3028547920 >> v1:172.21.15.183:6789/0 conn(0x7fe38c0b3890 legacy=0x7fe38c0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.826+0000 7fe38bfff640 1 -- 172.21.15.97:0/3028547920 >> v1:172.21.15.97:6789/0 conn(0x7fe38c15d610 legacy=0x7fe38c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.826+0000 7fe38bfff640 1 -- 172.21.15.97:0/3028547920 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c0b27f0 con 0x7fe38c0d17e0 2023-11-24T08:06:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.827+0000 7fe38bfff640 1 --2- 172.21.15.97:0/3028547920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c0d1c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3780097a0 tx=0x7fe37802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a886096d4d9bed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.827+0000 7fe38b7fe640 1 -- 172.21.15.97:0/3028547920 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378031830 con 0x7fe38c0d17e0 2023-11-24T08:06:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.827+0000 7fe38b7fe640 1 -- 172.21.15.97:0/3028547920 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378031990 con 0x7fe38c0d17e0 2023-11-24T08:06:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.827+0000 7fe38b7fe640 1 -- 172.21.15.97:0/3028547920 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378031d20 con 0x7fe38c0d17e0 2023-11-24T08:06:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.828+0000 7fe39322d640 1 -- 172.21.15.97:0/3028547920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 msgr2=0x7fe38c0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.828+0000 7fe39322d640 1 --2- 172.21.15.97:0/3028547920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c0d1c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3780097a0 tx=0x7fe37802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.828+0000 7fe39322d640 1 -- 172.21.15.97:0/3028547920 shutdown_connections 2023-11-24T08:06:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.828+0000 7fe39322d640 1 --2- 172.21.15.97:0/3028547920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c0d1c40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.828+0000 7fe39322d640 1 -- 172.21.15.97:0/3028547920 >> 172.21.15.97:0/3028547920 conn(0x7fe38c09c540 msgr2=0x7fe38c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.828+0000 7fe39322d640 1 -- 172.21.15.97:0/3028547920 shutdown_connections 2023-11-24T08:06:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.828+0000 7fe39322d640 1 -- 172.21.15.97:0/3028547920 wait complete. 2023-11-24T08:06:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.830+0000 7fe39322d640 1 Processor -- start 2023-11-24T08:06:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.830+0000 7fe39322d640 1 -- start start 2023-11-24T08:06:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe39322d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe38c0b3890 0x7fe38c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe39322d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe39322d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe38c15d610 0x7fe38c0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:41.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe39322d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0cbb20 con 0x7fe38c0d17e0 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe39322d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0cbd70 con 0x7fe38c15d610 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe39322d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0cc050 con 0x7fe38c0b3890 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe38bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe38bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39168/0 (socket says 172.21.15.97:39168) 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.831+0000 7fe38bfff640 1 -- 172.21.15.97:0/2831767487 learned_addr learned my addr 172.21.15.97:0/2831767487 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe390fc9640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe38c0b3890 0x7fe38c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe3917ca640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe38c15d610 0x7fe38c0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe38bfff640 1 -- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe38c0b3890 msgr2=0x7fe38c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe38bfff640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe38c0b3890 0x7fe38c0cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe38bfff640 1 -- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe38c15d610 msgr2=0x7fe38c0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe38bfff640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe38c15d610 0x7fe38c0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe38bfff640 1 -- 172.21.15.97:0/2831767487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009400 con 0x7fe38c0d17e0 2023-11-24T08:06:41.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe3917ca640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe38c15d610 0x7fe38c0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe38bfff640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c151fd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3780098c0 tx=0x7fe3780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe3897fa640 1 -- 172.21.15.97:0/2831767487 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37803a6f0 con 0x7fe38c0d17e0 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe3897fa640 1 -- 172.21.15.97:0/2831767487 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37803a870 con 0x7fe38c0d17e0 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe3897fa640 1 -- 172.21.15.97:0/2831767487 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37803ac20 con 0x7fe38c0d17e0 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.832+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c0cc330 con 0x7fe38c0d17e0 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.833+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c0cc8f0 con 0x7fe38c0d17e0 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.834+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c0ccae0 con 0x7fe38c0d17e0 2023-11-24T08:06:41.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.835+0000 7fe3897fa640 1 -- 172.21.15.97:0/2831767487 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe378030380 con 0x7fe38c0d17e0 2023-11-24T08:06:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.836+0000 7fe3897fa640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe37006ae40 0x7fe37006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.836+0000 7fe3897fa640 1 -- 172.21.15.97:0/2831767487 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe3780ab060 con 0x7fe38c0d17e0 2023-11-24T08:06:41.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.836+0000 7fe390fc9640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe37006ae40 0x7fe37006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:41.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.837+0000 7fe390fc9640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe37006ae40 0x7fe37006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3800011e0 tx=0x7fe380009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:41.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:41.840+0000 7fe3897fa640 1 -- 172.21.15.97:0/2831767487 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3780dde90 con 0x7fe38c0d17e0 2023-11-24T08:06:42.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.067+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe38c0675d0 con 0x7fe38c0d17e0 2023-11-24T08:06:42.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.612+0000 7fe3897fa640 1 -- 172.21.15.97:0/2831767487 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe378048020 con 0x7fe38c0d17e0 2023-11-24T08:06:42.615 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T08:06:42.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe37006ae40 msgr2=0x7fe37006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe37006ae40 0x7fe37006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3800011e0 tx=0x7fe380009040 comp rx=0 tx=0).stop 2023-11-24T08:06:42.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 msgr2=0x7fe38c151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c151fd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3780098c0 tx=0x7fe3780046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 shutdown_connections 2023-11-24T08:06:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe37006ae40 0x7fe37006d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe38c15d610 0x7fe38c0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe38c0d17e0 0x7fe38c151fd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 --2- 172.21.15.97:0/2831767487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe38c0b3890 0x7fe38c0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 >> 172.21.15.97:0/2831767487 conn(0x7fe38c09c540 msgr2=0x7fe38c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:42.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 shutdown_connections 2023-11-24T08:06:42.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.615+0000 7fe39322d640 1 -- 172.21.15.97:0/2831767487 wait complete. 2023-11-24T08:06:42.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:42.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.836+0000 7fe4c0636640 1 Processor -- start 2023-11-24T08:06:42.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.836+0000 7fe4c0636640 1 -- start start 2023-11-24T08:06:42.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.837+0000 7fe4c0636640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe4b815da10 0x7fe4b8072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.837+0000 7fe4c0636640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b80b2bd0 0x7fe4b80b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.837+0000 7fe4c0636640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b8071190 con 0x7fe4b8150760 2023-11-24T08:06:42.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.837+0000 7fe4c0636640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b8071470 con 0x7fe4b815da10 2023-11-24T08:06:42.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.837+0000 7fe4c0636640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8071750 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.838+0000 7fe4bdbd1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe4b815da10 0x7fe4b8072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.838+0000 7fe4bebd3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b80b2bd0 0x7fe4b80b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.838+0000 7fe4bdbd1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe4b815da10 0x7fe4b8072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:47298/0 (socket says 172.21.15.97:47298) 2023-11-24T08:06:42.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.838+0000 7fe4bdbd1640 1 -- 172.21.15.97:0/1163365519 learned_addr learned my addr 172.21.15.97:0/1163365519 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:42.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.838+0000 7fe4bebd3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b80b2bd0 0x7fe4b80b3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:44522/0 (socket says 172.21.15.97:44522) 2023-11-24T08:06:42.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.839+0000 7fe4bebd3640 1 -- 172.21.15.97:0/1163365519 >> v2:172.21.15.183:3300/0 conn(0x7fe4b815da10 msgr2=0x7fe4b8072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:42.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.839+0000 7fe4bebd3640 1 --2- 172.21.15.97:0/1163365519 >> v2:172.21.15.183:3300/0 conn(0x7fe4b815da10 0x7fe4b8072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.839+0000 7fe4bebd3640 1 -- 172.21.15.97:0/1163365519 >> v1:172.21.15.183:6789/0 conn(0x7fe4b8150760 legacy=0x7fe4b815d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.839+0000 7fe4bebd3640 1 -- 172.21.15.97:0/1163365519 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8071a30 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.839+0000 7fe4bdbd1640 1 --2- 172.21.15.97:0/1163365519 >> v2:172.21.15.183:3300/0 conn(0x7fe4b815da10 0x7fe4b8072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:42.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.840+0000 7fe4bebd3640 1 --2- 172.21.15.97:0/1163365519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b80b2bd0 0x7fe4b80b3060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00093f0 tx=0x7fe4b00302c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e33c14296dc3b89 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:42.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4bd3d0640 1 -- 172.21.15.97:0/1163365519 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0038640 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4bd3d0640 1 -- 172.21.15.97:0/1163365519 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b00387a0 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4bd3d0640 1 -- 172.21.15.97:0/1163365519 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0038b30 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 -- 172.21.15.97:0/1163365519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b80b2bd0 msgr2=0x7fe4b80b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 --2- 172.21.15.97:0/1163365519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b80b2bd0 0x7fe4b80b3060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00093f0 tx=0x7fe4b00302c0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 -- 172.21.15.97:0/1163365519 shutdown_connections 2023-11-24T08:06:42.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 --2- 172.21.15.97:0/1163365519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b80b2bd0 0x7fe4b80b3060 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 --2- 172.21.15.97:0/1163365519 >> v2:172.21.15.183:3300/0 conn(0x7fe4b815da10 0x7fe4b8072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 -- 172.21.15.97:0/1163365519 >> 172.21.15.97:0/1163365519 conn(0x7fe4b806a800 msgr2=0x7fe4b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:42.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 -- 172.21.15.97:0/1163365519 shutdown_connections 2023-11-24T08:06:42.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.841+0000 7fe4c0636640 1 -- 172.21.15.97:0/1163365519 wait complete. 2023-11-24T08:06:42.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.843+0000 7fe4c0636640 1 Processor -- start 2023-11-24T08:06:42.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.843+0000 7fe4c0636640 1 -- start start 2023-11-24T08:06:42.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4c0636640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b80b2bd0 0x7fe4b81e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4c0636640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b8150760 0x7fe4b8144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4c0636640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4b815da10 0x7fe4b80ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4c0636640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81e4800 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4c0636640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81e4280 con 0x7fe4b815da10 2023-11-24T08:06:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4c0636640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81e4520 con 0x7fe4b8150760 2023-11-24T08:06:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4be3d2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b80b2bd0 0x7fe4b81e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4be3d2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b80b2bd0 0x7fe4b81e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39180/0 (socket says 172.21.15.97:39180) 2023-11-24T08:06:42.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.844+0000 7fe4be3d2640 1 -- 172.21.15.97:0/2750830168 learned_addr learned my addr 172.21.15.97:0/2750830168 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:42.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4bdbd1640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b8150760 0x7fe4b8144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4bebd3640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4b815da10 0x7fe4b80ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4be3d2640 1 -- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b8150760 msgr2=0x7fe4b8144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4be3d2640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b8150760 0x7fe4b8144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4be3d2640 1 -- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4b815da10 msgr2=0x7fe4b80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4be3d2640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4b815da10 0x7fe4b80ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4be3d2640 1 -- 172.21.15.97:0/2750830168 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a80094d0 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4bdbd1640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b8150760 0x7fe4b8144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:42.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4be3d2640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b80b2bd0 0x7fe4b81e3d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c450 tx=0x7fe4b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:42.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4aeffd640 1 -- 172.21.15.97:0/2750830168 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40052d0 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4aeffd640 1 -- 172.21.15.97:0/2750830168 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4005430 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.845+0000 7fe4aeffd640 1 -- 172.21.15.97:0/2750830168 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4012870 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.846+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b000f050 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.846+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b8157d20 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.847+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b81578a0 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.848+0000 7fe4aeffd640 1 -- 172.21.15.97:0/2750830168 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4b40129d0 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.848+0000 7fe4aeffd640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe49c06ae40 0x7fe49c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.849+0000 7fe4aeffd640 1 -- 172.21.15.97:0/2750830168 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4b40891f0 con 0x7fe4b80b2bd0 2023-11-24T08:06:42.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.849+0000 7fe4bdbd1640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe49c06ae40 0x7fe49c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.849+0000 7fe4bdbd1640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe49c06ae40 0x7fe49c06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4b815b4f0 tx=0x7fe4a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:42.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:42.853+0000 7fe4aeffd640 1 -- 172.21.15.97:0/2750830168 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4b81578a0 con 0x7fe4b80b2bd0 2023-11-24T08:06:43.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.042+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4b81578a0 con 0x7fe4b80b2bd0 2023-11-24T08:06:43.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.045+0000 7fe4aeffd640 1 -- 172.21.15.97:0/2750830168 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16518 (secure 0 0 0) 0x7fe4b81578a0 con 0x7fe4b80b2bd0 2023-11-24T08:06:43.049 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:43.049 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":21,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:42.070087+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:43.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe49c06ae40 msgr2=0x7fe49c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe49c06ae40 0x7fe49c06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4b815b4f0 tx=0x7fe4a8008040 comp rx=0 tx=0).stop 2023-11-24T08:06:43.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b80b2bd0 msgr2=0x7fe4b81e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b80b2bd0 0x7fe4b81e3d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c450 tx=0x7fe4b400c910 comp rx=0 tx=0).stop 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 shutdown_connections 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe49c06ae40 0x7fe49c06d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4b815da10 0x7fe4b80ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe4b8150760 0x7fe4b8144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 --2- 172.21.15.97:0/2750830168 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4b80b2bd0 0x7fe4b81e3d40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 >> 172.21.15.97:0/2750830168 conn(0x7fe4b806a800 msgr2=0x7fe4b8159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.048+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 shutdown_connections 2023-11-24T08:06:43.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.049+0000 7fe4c0636640 1 -- 172.21.15.97:0/2750830168 wait complete. 2023-11-24T08:06:43.070 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:43.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.275+0000 7f2bab368640 1 Processor -- start 2023-11-24T08:06:43.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.276+0000 7f2bab368640 1 -- start start 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.277+0000 7f2bab368640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.277+0000 7f2bab368640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2ba40ced60 0x7f2ba40d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.277+0000 7f2bab368640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2ba40d1d20 0x7f2ba40cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.277+0000 7f2bab368640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba40d1390 con 0x7f2ba40ced60 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.277+0000 7f2bab368640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba40d21b0 con 0x7f2ba40d1d20 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.277+0000 7f2bab368640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40b3400 con 0x7f2ba415d610 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.277+0000 7f2ba8903640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2ba40ced60 0x7f2ba40d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba8903640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2ba40ced60 0x7f2ba40d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39196/0 (socket says 172.21.15.97:39196) 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba8903640 1 -- 172.21.15.97:0/255690348 learned_addr learned my addr 172.21.15.97:0/255690348 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba9104640 1 --2- 172.21.15.97:0/255690348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba8903640 1 -- 172.21.15.97:0/255690348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 msgr2=0x7f2ba40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:43.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba8903640 1 --2- 172.21.15.97:0/255690348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba8903640 1 -- 172.21.15.97:0/255690348 >> v2:172.21.15.183:3300/0 conn(0x7f2ba40d1d20 msgr2=0x7f2ba40cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:43.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba9905640 1 --2- 172.21.15.97:0/255690348 >> v2:172.21.15.183:3300/0 conn(0x7f2ba40d1d20 0x7f2ba40cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba8903640 1 --2- 172.21.15.97:0/255690348 >> v2:172.21.15.183:3300/0 conn(0x7f2ba40d1d20 0x7f2ba40cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba8903640 1 -- 172.21.15.97:0/255690348 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40b27f0 con 0x7f2ba40ced60 2023-11-24T08:06:43.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.278+0000 7f2ba9104640 1 --2- 172.21.15.97:0/255690348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.279+0000 7f2ba8903640 1 --2- 172.21.15.97:0/255690348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40ced60 0x7f2ba40d17e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40d42d0 tx=0x7f2b9002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d10962fe3cb052 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.279+0000 7f2ba3fff640 1 -- 172.21.15.97:0/255690348 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90031860 con 0x7f2ba40ced60 2023-11-24T08:06:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.279+0000 7f2ba3fff640 1 -- 172.21.15.97:0/255690348 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b900319c0 con 0x7f2ba40ced60 2023-11-24T08:06:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.279+0000 7f2ba3fff640 1 -- 172.21.15.97:0/255690348 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90031d50 con 0x7f2ba40ced60 2023-11-24T08:06:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 -- 172.21.15.97:0/255690348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40ced60 msgr2=0x7f2ba40d17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 --2- 172.21.15.97:0/255690348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40ced60 0x7f2ba40d17e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40d42d0 tx=0x7f2b9002b900 comp rx=0 tx=0).stop 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 -- 172.21.15.97:0/255690348 shutdown_connections 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 --2- 172.21.15.97:0/255690348 >> v2:172.21.15.183:3300/0 conn(0x7f2ba40d1d20 0x7f2ba40cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 --2- 172.21.15.97:0/255690348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40ced60 0x7f2ba40d17e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 --2- 172.21.15.97:0/255690348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 -- 172.21.15.97:0/255690348 >> 172.21.15.97:0/255690348 conn(0x7f2ba409c540 msgr2=0x7f2ba40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 -- 172.21.15.97:0/255690348 shutdown_connections 2023-11-24T08:06:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.280+0000 7f2bab368640 1 -- 172.21.15.97:0/255690348 wait complete. 2023-11-24T08:06:43.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.283+0000 7f2bab368640 1 Processor -- start 2023-11-24T08:06:43.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.283+0000 7f2bab368640 1 -- start start 2023-11-24T08:06:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2bab368640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba40ced60 0x7f2ba414f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2bab368640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40d1d20 0x7f2ba40b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2bab368640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2bab368640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40cb990 con 0x7f2ba40d1d20 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2bab368640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba414fc10 con 0x7f2ba40ced60 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2bab368640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40cbbc0 con 0x7f2ba415d610 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2ba8903640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40d1d20 0x7f2ba40b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2ba8903640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40d1d20 0x7f2ba40b88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39208/0 (socket says 172.21.15.97:39208) 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.284+0000 7f2ba8903640 1 -- 172.21.15.97:0/534869967 learned_addr learned my addr 172.21.15.97:0/534869967 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba9104640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba40ced60 0x7f2ba414f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba9905640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba8903640 1 -- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 msgr2=0x7f2ba40ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba8903640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba8903640 1 -- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba40ced60 msgr2=0x7f2ba414f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba8903640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba40ced60 0x7f2ba414f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba8903640 1 -- 172.21.15.97:0/534869967 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b900094d0 con 0x7f2ba40d1d20 2023-11-24T08:06:43.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba9905640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:43.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba8903640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40d1d20 0x7f2ba40b88b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b90000c00 tx=0x7f2b900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba1ffb640 1 -- 172.21.15.97:0/534869967 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90031830 con 0x7f2ba40d1d20 2023-11-24T08:06:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba1ffb640 1 -- 172.21.15.97:0/534869967 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b900443f0 con 0x7f2ba40d1d20 2023-11-24T08:06:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2ba1ffb640 1 -- 172.21.15.97:0/534869967 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900447a0 con 0x7f2ba40d1d20 2023-11-24T08:06:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.285+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba40cbea0 con 0x7f2ba40d1d20 2023-11-24T08:06:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.286+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40cc460 con 0x7f2ba40d1d20 2023-11-24T08:06:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.287+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba40675d0 con 0x7f2ba40d1d20 2023-11-24T08:06:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.288+0000 7f2ba1ffb640 1 -- 172.21.15.97:0/534869967 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b9004d450 con 0x7f2ba40d1d20 2023-11-24T08:06:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.289+0000 7f2ba1ffb640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2b8806ae40 0x7f2b8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.289+0000 7f2ba1ffb640 1 -- 172.21.15.97:0/534869967 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b900abe40 con 0x7f2ba40d1d20 2023-11-24T08:06:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.290+0000 7f2ba9104640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2b8806ae40 0x7f2b8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.290+0000 7f2ba9104640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2b8806ae40 0x7f2b8806d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b98007510 tx=0x7f2b980074a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.294+0000 7f2ba1ffb640 1 -- 172.21.15.97:0/534869967 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b90076e50 con 0x7f2ba40d1d20 2023-11-24T08:06:43.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.485+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba40b3f90 con 0x7f2ba40d1d20 2023-11-24T08:06:43.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.488+0000 7f2ba1ffb640 1 -- 172.21.15.97:0/534869967 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f2b90035020 con 0x7f2ba40d1d20 2023-11-24T08:06:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:43.491 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2b8806ae40 msgr2=0x7f2b8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2b8806ae40 0x7f2b8806d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b98007510 tx=0x7f2b980074a0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40d1d20 msgr2=0x7f2ba40b88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40d1d20 0x7f2ba40b88b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b90000c00 tx=0x7f2b900046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 shutdown_connections 2023-11-24T08:06:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2b8806ae40 0x7f2b8806d300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415d610 0x7f2ba40ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ba40d1d20 0x7f2ba40b88b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 --2- 172.21.15.97:0/534869967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba40ced60 0x7f2ba414f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.490+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 >> 172.21.15.97:0/534869967 conn(0x7f2ba409c540 msgr2=0x7f2ba40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.491+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 shutdown_connections 2023-11-24T08:06:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.491+0000 7f2bab368640 1 -- 172.21.15.97:0/534869967 wait complete. 2023-11-24T08:06:43.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:06:43.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.719+0000 7f7bbe8e0640 1 Processor -- start 2023-11-24T08:06:43.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.720+0000 7f7bbe8e0640 1 -- start start 2023-11-24T08:06:43.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.721+0000 7f7bbe8e0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7bb80cfcf0 0x7f7bb8160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.721+0000 7f7bbe8e0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80d4160 con 0x7f7bb80d3910 2023-11-24T08:06:43.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.721+0000 7f7bbe8e0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80b2420 con 0x7f7bb80d00d0 2023-11-24T08:06:43.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.721+0000 7f7bbe8e0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb80ceff0 con 0x7f7bb80cfcf0 2023-11-24T08:06:43.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.721+0000 7f7bb7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7bb80cfcf0 0x7f7bb8160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.721+0000 7f7baffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7bb80d3910 0x7f7bb80b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46822/0 (socket says 172.21.15.97:46822) 2023-11-24T08:06:43.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.721+0000 7f7baffff640 1 -- 172.21.15.97:0/3909280553 learned_addr learned my addr 172.21.15.97:0/3909280553 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.722+0000 7f7bb7fff640 1 -- 172.21.15.97:0/3909280553 >> v1:172.21.15.183:6789/0 conn(0x7f7bb80d00d0 legacy=0x7f7bb80b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.722+0000 7f7bb7fff640 1 -- 172.21.15.97:0/3909280553 >> v1:172.21.15.97:6789/0 conn(0x7f7bb80d3910 legacy=0x7f7bb80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.722+0000 7f7bb7fff640 1 -- 172.21.15.97:0/3909280553 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80b2140 con 0x7f7bb80cfcf0 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.722+0000 7f7bb77fe640 1 -- 172.21.15.97:0/3909280553 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989271950 0 0) 0x7f7bb80d4160 con 0x7f7bb80d3910 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.723+0000 7f7bb7fff640 1 --2- 172.21.15.97:0/3909280553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80cfcf0 0x7f7bb8160700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097a0 tx=0x7f7ba802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efed2447b420db68 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.723+0000 7f7bb77fe640 1 -- 172.21.15.97:0/3909280553 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba802e070 con 0x7f7bb80cfcf0 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.723+0000 7f7bb77fe640 1 -- 172.21.15.97:0/3909280553 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba80315a0 con 0x7f7bb80cfcf0 2023-11-24T08:06:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.723+0000 7f7bb77fe640 1 -- 172.21.15.97:0/3909280553 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8031930 con 0x7f7bb80cfcf0 2023-11-24T08:06:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.724+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/3909280553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80cfcf0 msgr2=0x7f7bb8160700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.724+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/3909280553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80cfcf0 0x7f7bb8160700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097a0 tx=0x7f7ba802b840 comp rx=0 tx=0).stop 2023-11-24T08:06:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.724+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/3909280553 shutdown_connections 2023-11-24T08:06:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.724+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/3909280553 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80cfcf0 0x7f7bb8160700 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.724+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/3909280553 >> 172.21.15.97:0/3909280553 conn(0x7f7bb809c530 msgr2=0x7f7bb80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.724+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/3909280553 shutdown_connections 2023-11-24T08:06:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.724+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/3909280553 wait complete. 2023-11-24T08:06:43.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.726+0000 7f7bbe8e0640 1 Processor -- start 2023-11-24T08:06:43.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.726+0000 7f7bbe8e0640 1 -- start start 2023-11-24T08:06:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbe8e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80cfcf0 0x7f7bb80b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbe8e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80d00d0 0x7f7bb81f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbe8e0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80d3910 0x7f7bb8153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbe8e0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80b74c0 con 0x7f7bb80d3910 2023-11-24T08:06:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbe8e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81f6c60 con 0x7f7bb80d00d0 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbe8e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81f6f00 con 0x7f7bb80cfcf0 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbce7d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80d3910 0x7f7bb8153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbce7d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80d3910 0x7f7bb8153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39226/0 (socket says 172.21.15.97:39226) 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bbce7d640 1 -- 172.21.15.97:0/1049441171 learned_addr learned my addr 172.21.15.97:0/1049441171 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7baffff640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80d00d0 0x7f7bb81f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.727+0000 7f7bb7fff640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80cfcf0 0x7f7bb80b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbce7d640 1 -- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80cfcf0 msgr2=0x7f7bb80b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbce7d640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80cfcf0 0x7f7bb80b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbce7d640 1 -- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80d00d0 msgr2=0x7f7bb81f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbce7d640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80d00d0 0x7f7bb81f6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbce7d640 1 -- 172.21.15.97:0/1049441171 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8009400 con 0x7f7bb80d3910 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbce7d640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80d3910 0x7f7bb8153710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c700 tx=0x7f7bb000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bb57fa640 1 -- 172.21.15.97:0/1049441171 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000aa50 con 0x7f7bb80d3910 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bb57fa640 1 -- 172.21.15.97:0/1049441171 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb000abb0 con 0x7f7bb80d3910 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bb57fa640 1 -- 172.21.15.97:0/1049441171 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000ce10 con 0x7f7bb80d3910 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb81f71e0 con 0x7f7bb80d3910 2023-11-24T08:06:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.728+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb80b76d0 con 0x7f7bb80d3910 2023-11-24T08:06:43.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.729+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb80b78f0 con 0x7f7bb80d3910 2023-11-24T08:06:43.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.730+0000 7f7bb57fa640 1 -- 172.21.15.97:0/1049441171 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7bb0012420 con 0x7f7bb80d3910 2023-11-24T08:06:43.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.731+0000 7f7bb57fa640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b9806ae40 0x7f7b9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:43.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.731+0000 7f7bb57fa640 1 -- 172.21.15.97:0/1049441171 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bb0089ad0 con 0x7f7bb80d3910 2023-11-24T08:06:43.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.731+0000 7f7bb7fff640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b9806ae40 0x7f7b9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:43.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.732+0000 7f7bb7fff640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b9806ae40 0x7f7b9806d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8036000 tx=0x7f7ba803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:43.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.735+0000 7f7bb57fa640 1 -- 172.21.15.97:0/1049441171 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7bb0054b70 con 0x7f7bb80d3910 2023-11-24T08:06:43.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:43.958+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7bb80cf710 con 0x7f7bb80d3910 2023-11-24T08:06:44.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.625+0000 7f7bb57fa640 1 -- 172.21.15.97:0/1049441171 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7bb0016020 con 0x7f7bb80d3910 2023-11-24T08:06:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.628+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b9806ae40 msgr2=0x7f7b9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b9806ae40 0x7f7b9806d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8036000 tx=0x7f7ba803d040 comp rx=0 tx=0).stop 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80d3910 msgr2=0x7f7bb8153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80d3910 0x7f7bb8153710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c700 tx=0x7f7bb000cbc0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 shutdown_connections 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b9806ae40 0x7f7b9806d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb80d3910 0x7f7bb8153710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80d00d0 0x7f7bb81f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 --2- 172.21.15.97:0/1049441171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80cfcf0 0x7f7bb80b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 >> 172.21.15.97:0/1049441171 conn(0x7f7bb809c530 msgr2=0x7f7bb80b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 shutdown_connections 2023-11-24T08:06:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.629+0000 7f7bbe8e0640 1 -- 172.21.15.97:0/1049441171 wait complete. 2023-11-24T08:06:44.651 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:06:44.651 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:06:44.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.848+0000 7f59862b2640 1 Processor -- start 2023-11-24T08:06:44.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.848+0000 7f59862b2640 1 -- start start 2023-11-24T08:06:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.850+0000 7f59862b2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59800cf9a0 0x7f598015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.850+0000 7f59862b2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5980070c40 con 0x7f59800ae5a0 2023-11-24T08:06:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.850+0000 7f59862b2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598006c470 con 0x7f59800b3ae0 2023-11-24T08:06:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.850+0000 7f59862b2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5980071450 con 0x7f59800cf9a0 2023-11-24T08:06:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.850+0000 7f598484f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59800cf9a0 0x7f598015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.851+0000 7f598484f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f59800cf9a0 0x7f598015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39230/0 (socket says 172.21.15.97:39230) 2023-11-24T08:06:44.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.851+0000 7f597ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f59800ae5a0 0x7f598006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46824/0 (socket says 172.21.15.97:46824) 2023-11-24T08:06:44.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.851+0000 7f598484f640 1 -- 172.21.15.97:0/525936675 learned_addr learned my addr 172.21.15.97:0/525936675 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:44.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.851+0000 7f598484f640 1 -- 172.21.15.97:0/525936675 >> v1:172.21.15.183:6789/0 conn(0x7f59800b3ae0 legacy=0x7f59800cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:44.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.851+0000 7f598484f640 1 -- 172.21.15.97:0/525936675 >> v1:172.21.15.97:6789/0 conn(0x7f59800ae5a0 legacy=0x7f598006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.851+0000 7f598484f640 1 -- 172.21.15.97:0/525936675 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598006c750 con 0x7f59800cf9a0 2023-11-24T08:06:44.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.852+0000 7f598484f640 1 --2- 172.21.15.97:0/525936675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800cf9a0 0x7f598015e430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5978009e50 tx=0x7f597802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970495737fcfb456 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:44.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.852+0000 7f597f7fe640 1 -- 172.21.15.97:0/525936675 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597802cbb0 con 0x7f59800cf9a0 2023-11-24T08:06:44.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.852+0000 7f597f7fe640 1 -- 172.21.15.97:0/525936675 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597802cd10 con 0x7f59800cf9a0 2023-11-24T08:06:44.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.852+0000 7f597f7fe640 1 -- 172.21.15.97:0/525936675 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978034610 con 0x7f59800cf9a0 2023-11-24T08:06:44.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.853+0000 7f59862b2640 1 -- 172.21.15.97:0/525936675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800cf9a0 msgr2=0x7f598015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.853+0000 7f59862b2640 1 --2- 172.21.15.97:0/525936675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800cf9a0 0x7f598015e430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5978009e50 tx=0x7f597802c010 comp rx=0 tx=0).stop 2023-11-24T08:06:44.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.853+0000 7f59862b2640 1 -- 172.21.15.97:0/525936675 shutdown_connections 2023-11-24T08:06:44.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.853+0000 7f59862b2640 1 --2- 172.21.15.97:0/525936675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800cf9a0 0x7f598015e430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.853+0000 7f59862b2640 1 -- 172.21.15.97:0/525936675 >> 172.21.15.97:0/525936675 conn(0x7f598006a800 msgr2=0x7f598006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:44.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.853+0000 7f59862b2640 1 -- 172.21.15.97:0/525936675 shutdown_connections 2023-11-24T08:06:44.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.853+0000 7f59862b2640 1 -- 172.21.15.97:0/525936675 wait complete. 2023-11-24T08:06:44.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.855+0000 7f59862b2640 1 Processor -- start 2023-11-24T08:06:44.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.855+0000 7f59862b2640 1 -- start start 2023-11-24T08:06:44.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f59862b2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59800ae5a0 0x7f5980156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:44.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f59862b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800b3ae0 0x7f5980149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:44.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f59862b2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59800cf9a0 0x7f598015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:44.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f59862b2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980158af0 con 0x7f59800b3ae0 2023-11-24T08:06:44.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f59862b2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980156d40 con 0x7f59800ae5a0 2023-11-24T08:06:44.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f59862b2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5980157b80 con 0x7f59800cf9a0 2023-11-24T08:06:44.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800b3ae0 0x7f5980149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:44.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800b3ae0 0x7f5980149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39232/0 (socket says 172.21.15.97:39232) 2023-11-24T08:06:44.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 -- 172.21.15.97:0/2601689882 learned_addr learned my addr 172.21.15.97:0/2601689882 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:44.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 -- 172.21.15.97:0/2601689882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59800cf9a0 msgr2=0x7f598015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59800cf9a0 0x7f598015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 -- 172.21.15.97:0/2601689882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59800ae5a0 msgr2=0x7f5980156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:44.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59800ae5a0 0x7f5980156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:44.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 -- 172.21.15.97:0/2601689882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978009b30 con 0x7f59800b3ae0 2023-11-24T08:06:44.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.856+0000 7f5977fff640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800b3ae0 0x7f5980149c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f596800c430 tx=0x7f596800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:44.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.857+0000 7f597d7fa640 1 -- 172.21.15.97:0/2601689882 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968011790 con 0x7f59800b3ae0 2023-11-24T08:06:44.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.857+0000 7f597d7fa640 1 -- 172.21.15.97:0/2601689882 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680118f0 con 0x7f59800b3ae0 2023-11-24T08:06:44.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.857+0000 7f597d7fa640 1 -- 172.21.15.97:0/2601689882 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968011ce0 con 0x7f59800b3ae0 2023-11-24T08:06:44.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.857+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5980158010 con 0x7f59800b3ae0 2023-11-24T08:06:44.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.857+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5980157250 con 0x7f59800b3ae0 2023-11-24T08:06:44.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.858+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59800675d0 con 0x7f59800b3ae0 2023-11-24T08:06:44.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.859+0000 7f597d7fa640 1 -- 172.21.15.97:0/2601689882 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f596801c460 con 0x7f59800b3ae0 2023-11-24T08:06:44.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.859+0000 7f597d7fa640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f596006ae40 0x7f596006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:44.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.860+0000 7f597d7fa640 1 -- 172.21.15.97:0/2601689882 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5968089540 con 0x7f59800b3ae0 2023-11-24T08:06:44.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.860+0000 7f597ffff640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f596006ae40 0x7f596006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:44.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.860+0000 7f597ffff640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f596006ae40 0x7f596006d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59700015e0 tx=0x7f59700079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:44.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:44.864+0000 7f597d7fa640 1 -- 172.21.15.97:0/2601689882 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5968054680 con 0x7f59800b3ae0 2023-11-24T08:06:45.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.087+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5980157cc0 con 0x7f59800b3ae0 2023-11-24T08:06:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.644+0000 7f597d7fa640 1 -- 172.21.15.97:0/2601689882 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5980157cc0 con 0x7f59800b3ae0 2023-11-24T08:06:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.647+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f596006ae40 msgr2=0x7f596006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.647+0000 7f59862b2640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f596006ae40 0x7f596006d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59700015e0 tx=0x7f59700079c0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.647+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800b3ae0 msgr2=0x7f5980149c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.647+0000 7f59862b2640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800b3ae0 0x7f5980149c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f596800c430 tx=0x7f596800c8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 shutdown_connections 2023-11-24T08:06:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f596006ae40 0x7f596006d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59800cf9a0 0x7f598015fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59800b3ae0 0x7f5980149c50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 --2- 172.21.15.97:0/2601689882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59800ae5a0 0x7f5980156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 >> 172.21.15.97:0/2601689882 conn(0x7f598006a800 msgr2=0x7f598006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:45.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 shutdown_connections 2023-11-24T08:06:45.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.648+0000 7f59862b2640 1 -- 172.21.15.97:0/2601689882 wait complete. 2023-11-24T08:06:45.670 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:06:45.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:45.691 INFO:tasks.ceph.mds.b.smithi183.stderr:2023-11-24T08:06:45.689+0000 7f8bc6b3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:06:45.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.872+0000 7ff418543640 1 Processor -- start 2023-11-24T08:06:45.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.872+0000 7ff418543640 1 -- start start 2023-11-24T08:06:45.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.873+0000 7ff418543640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff4100b3ae0 0x7ff41015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff418543640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff410070c40 con 0x7ff4100cf290 2023-11-24T08:06:45.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff418543640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41006c470 con 0x7ff4100ae5a0 2023-11-24T08:06:45.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff418543640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff410071450 con 0x7ff4100b3ae0 2023-11-24T08:06:45.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff416ae0640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff4100cf290 0x7ff4100b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46832/0 (socket says 172.21.15.97:46832) 2023-11-24T08:06:45.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff416ae0640 1 -- 172.21.15.97:0/2672425851 learned_addr learned my addr 172.21.15.97:0/2672425851 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:45.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff415ade640 1 --2- 172.21.15.97:0/2672425851 >> v2:172.21.15.183:3300/0 conn(0x7ff4100b3ae0 0x7ff41015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804633631 0 0) 0x7ff410070c40 con 0x7ff4100cf290 2023-11-24T08:06:45.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.874+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3fc003520 con 0x7ff4100cf290 2023-11-24T08:06:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 113929339 0 0) 0x7ff3fc003520 con 0x7ff4100cf290 2023-11-24T08:06:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 >> v2:172.21.15.183:3300/0 conn(0x7ff4100b3ae0 msgr2=0x7ff41015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 --2- 172.21.15.97:0/2672425851 >> v2:172.21.15.183:3300/0 conn(0x7ff4100b3ae0 0x7ff41015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 >> v1:172.21.15.183:6789/0 conn(0x7ff4100ae5a0 legacy=0x7ff41006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41006c750 con 0x7ff4100cf290 2023-11-24T08:06:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7ff4080019f0 con 0x7ff4100cf290 2023-11-24T08:06:45.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 >> v1:172.21.15.97:6789/0 conn(0x7ff4100cf290 legacy=0x7ff4100b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3fc003970 0x7ff3fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3fc0047c0 0x7ff3fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff3fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410071450 con 0x7ff3fc005180 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc00c030 con 0x7ff3fc0047c0 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc00c1f0 con 0x7ff3fc003970 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff416ae0640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff3fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff415ade640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3fc0047c0 0x7ff3fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff4162df640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3fc003970 0x7ff3fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff416ae0640 1 -- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3fc003970 msgr2=0x7ff3fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff416ae0640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3fc003970 0x7ff3fc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff416ae0640 1 -- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3fc0047c0 msgr2=0x7ff3fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff416ae0640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3fc0047c0 0x7ff3fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.875+0000 7ff416ae0640 1 -- 172.21.15.97:0/2672425851 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc003520 con 0x7ff3fc005180 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.876+0000 7ff416ae0640 1 -- 172.21.15.97:0/2672425851 reap_dead start 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.876+0000 7ff416ae0640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff3fc00b980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff40800a800 tx=0x7ff3fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63025d77d484d8d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408034630 con 0x7ff3fc005180 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40802f070 con 0x7ff3fc005180 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff4152dd640 1 -- 172.21.15.97:0/2672425851 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408034a10 con 0x7ff3fc005180 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff418543640 1 -- 172.21.15.97:0/2672425851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 msgr2=0x7ff3fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff418543640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff3fc00b980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff40800a800 tx=0x7ff3fc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff418543640 1 -- 172.21.15.97:0/2672425851 shutdown_connections 2023-11-24T08:06:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff418543640 1 --2- 172.21.15.97:0/2672425851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff3fc00b980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff418543640 1 -- 172.21.15.97:0/2672425851 >> 172.21.15.97:0/2672425851 conn(0x7ff41006a800 msgr2=0x7ff41006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:45.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff418543640 1 -- 172.21.15.97:0/2672425851 shutdown_connections 2023-11-24T08:06:45.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.877+0000 7ff418543640 1 -- 172.21.15.97:0/2672425851 wait complete. 2023-11-24T08:06:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.880+0000 7ff418543640 1 Processor -- start 2023-11-24T08:06:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.880+0000 7ff418543640 1 -- start start 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff418543640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff41014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff418543640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff41015bcf0 0x7ff4100ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff418543640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100cc020 0x7ff4100cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff418543640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100cc9f0 con 0x7ff3fc005180 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff418543640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41014be60 con 0x7ff41015bcf0 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff418543640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41015c180 con 0x7ff4100cc020 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff4162df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff41014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff4162df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff41014b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39248/0 (socket says 172.21.15.97:39248) 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff4162df640 1 -- 172.21.15.97:0/2356875565 learned_addr learned my addr 172.21.15.97:0/2356875565 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.881+0000 7ff415ade640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff41015bcf0 0x7ff4100ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff416ae0640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100cc020 0x7ff4100cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff4162df640 1 -- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100cc020 msgr2=0x7ff4100cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff4162df640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100cc020 0x7ff4100cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff4162df640 1 -- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff41015bcf0 msgr2=0x7ff4100ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff4162df640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff41015bcf0 0x7ff4100ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff4162df640 1 -- 172.21.15.97:0/2356875565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41015c460 con 0x7ff3fc005180 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff416ae0640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100cc020 0x7ff4100cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff4162df640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff41014b920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00d490 tx=0x7ff40c00d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff406ffd640 1 -- 172.21.15.97:0/2356875565 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c005480 con 0x7ff3fc005180 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff406ffd640 1 -- 172.21.15.97:0/2356875565 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0035f0 con 0x7ff3fc005180 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff406ffd640 1 -- 172.21.15.97:0/2356875565 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0039e0 con 0x7ff3fc005180 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41015c740 con 0x7ff3fc005180 2023-11-24T08:06:45.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.882+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100ceaa0 con 0x7ff3fc005180 2023-11-24T08:06:45.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.883+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410156540 con 0x7ff3fc005180 2023-11-24T08:06:45.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.884+0000 7ff406ffd640 1 -- 172.21.15.97:0/2356875565 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff40c003b40 con 0x7ff3fc005180 2023-11-24T08:06:45.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.885+0000 7ff406ffd640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff3f406ae40 0x7ff3f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:45.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.885+0000 7ff406ffd640 1 -- 172.21.15.97:0/2356875565 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff40c0894f0 con 0x7ff3fc005180 2023-11-24T08:06:45.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.885+0000 7ff415ade640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff3f406ae40 0x7ff3f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:45.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.886+0000 7ff415ade640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff3f406ae40 0x7ff3f406d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff410158320 tx=0x7ff400008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:45.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:45.890+0000 7ff406ffd640 1 -- 172.21.15.97:0/2356875565 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff40c054590 con 0x7ff3fc005180 2023-11-24T08:06:46.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.110+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4100cec30 con 0x7ff3fc005180 2023-11-24T08:06:46.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.111+0000 7ff406ffd640 1 -- 172.21.15.97:0/2356875565 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff40c057bb0 con 0x7ff3fc005180 2023-11-24T08:06:46.115 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:46.115 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:06:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:06:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.113+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff3f406ae40 msgr2=0x7ff3f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.113+0000 7ff418543640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff3f406ae40 0x7ff3f406d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff410158320 tx=0x7ff400008040 comp rx=0 tx=0).stop 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.113+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 msgr2=0x7ff41014b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.113+0000 7ff418543640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff41014b920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00d490 tx=0x7ff40c00d950 comp rx=0 tx=0).stop 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 shutdown_connections 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff3f406ae40 0x7ff3f406d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100cc020 0x7ff4100cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff41015bcf0 0x7ff4100ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 --2- 172.21.15.97:0/2356875565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3fc005180 0x7ff41014b920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 >> 172.21.15.97:0/2356875565 conn(0x7ff41006a800 msgr2=0x7ff41015aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 shutdown_connections 2023-11-24T08:06:46.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.114+0000 7ff418543640 1 -- 172.21.15.97:0/2356875565 wait complete. 2023-11-24T08:06:46.134 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:46.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.338+0000 7f95c729b640 1 Processor -- start 2023-11-24T08:06:46.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.338+0000 7f95c729b640 1 -- start start 2023-11-24T08:06:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c729b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c0160f80 0x7f95c0161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c729b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00cf1b0 con 0x7f95c00ced50 2023-11-24T08:06:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c729b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c01618a0 con 0x7f95c00ce8f0 2023-11-24T08:06:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c729b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00d0a00 con 0x7f95c0160f80 2023-11-24T08:06:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c5838640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f95c00ced50 0x7f95c00d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43416/0 (socket says 172.21.15.97:43416) 2023-11-24T08:06:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c5838640 1 -- 172.21.15.97:0/4188535426 learned_addr learned my addr 172.21.15.97:0/4188535426 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c5037640 1 --2- 172.21.15.97:0/4188535426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c0160f80 0x7f95c0161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95b7fff640 1 -- 172.21.15.97:0/4188535426 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135846102 0 0) 0x7f95c00cf1b0 con 0x7f95c00ced50 2023-11-24T08:06:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95b7fff640 1 -- 172.21.15.97:0/4188535426 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ac003520 con 0x7f95c00ced50 2023-11-24T08:06:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95b7fff640 1 -- 172.21.15.97:0/4188535426 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829384420 0 0) 0x7f95ac003520 con 0x7f95c00ced50 2023-11-24T08:06:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c5037640 1 -- 172.21.15.97:0/4188535426 >> v1:172.21.15.183:6789/0 conn(0x7f95c00ce8f0 legacy=0x7f95c00cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c5037640 1 -- 172.21.15.97:0/4188535426 >> v1:172.21.15.97:6789/0 conn(0x7f95c00ced50 legacy=0x7f95c00d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.340+0000 7f95c5037640 1 -- 172.21.15.97:0/4188535426 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00d0de0 con 0x7f95c0160f80 2023-11-24T08:06:46.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.342+0000 7f95c5037640 1 --2- 172.21.15.97:0/4188535426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c0160f80 0x7f95c0161360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097d0 tx=0x7f95bc02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f592f2a02ea611ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:46.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.342+0000 7f95b7fff640 1 -- 172.21.15.97:0/4188535426 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80019f0 con 0x7f95c0160f80 2023-11-24T08:06:46.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.342+0000 7f95b7fff640 1 -- 172.21.15.97:0/4188535426 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc02e050 con 0x7f95c0160f80 2023-11-24T08:06:46.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.342+0000 7f95b7fff640 1 -- 172.21.15.97:0/4188535426 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc030710 con 0x7f95c0160f80 2023-11-24T08:06:46.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.343+0000 7f95c729b640 1 -- 172.21.15.97:0/4188535426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c0160f80 msgr2=0x7f95c0161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.343+0000 7f95c729b640 1 --2- 172.21.15.97:0/4188535426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c0160f80 0x7f95c0161360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097d0 tx=0x7f95bc02b800 comp rx=0 tx=0).stop 2023-11-24T08:06:46.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.343+0000 7f95c729b640 1 -- 172.21.15.97:0/4188535426 shutdown_connections 2023-11-24T08:06:46.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.343+0000 7f95c729b640 1 --2- 172.21.15.97:0/4188535426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c0160f80 0x7f95c0161360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.343+0000 7f95c729b640 1 -- 172.21.15.97:0/4188535426 >> 172.21.15.97:0/4188535426 conn(0x7f95c009c550 msgr2=0x7f95c00d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:46.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.343+0000 7f95c729b640 1 -- 172.21.15.97:0/4188535426 shutdown_connections 2023-11-24T08:06:46.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.343+0000 7f95c729b640 1 -- 172.21.15.97:0/4188535426 wait complete. 2023-11-24T08:06:46.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.344+0000 7f95c729b640 1 Processor -- start 2023-11-24T08:06:46.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.345+0000 7f95c729b640 1 -- start start 2023-11-24T08:06:46.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.345+0000 7f95c729b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95c00ce8f0 0x7f95c015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.345+0000 7f95c729b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c00ced50 0x7f95c015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c729b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95c0160f80 0x7f95c01e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c729b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c015fa00 con 0x7f95c0160f80 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c729b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c015e420 con 0x7f95c00ce8f0 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c729b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c015e700 con 0x7f95c00ced50 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95c0160f80 0x7f95c01e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95c0160f80 0x7f95c01e8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56850/0 (socket says 172.21.15.97:56850) 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 -- 172.21.15.97:0/3766602398 learned_addr learned my addr 172.21.15.97:0/3766602398 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5037640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95c00ce8f0 0x7f95c015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c4836640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c00ced50 0x7f95c015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 -- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c00ced50 msgr2=0x7f95c015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c00ced50 0x7f95c015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 -- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95c00ce8f0 msgr2=0x7f95c015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95c00ce8f0 0x7f95c015f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 -- 172.21.15.97:0/3766602398 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc009400 con 0x7f95c0160f80 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c4836640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c00ced50 0x7f95c015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c5838640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95c0160f80 0x7f95c01e8af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95b8001830 tx=0x7f95b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95b5ffb640 1 -- 172.21.15.97:0/3766602398 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8012400 con 0x7f95c0160f80 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95b5ffb640 1 -- 172.21.15.97:0/3766602398 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b8012560 con 0x7f95c0160f80 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c015e9e0 con 0x7f95c0160f80 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95b5ffb640 1 -- 172.21.15.97:0/3766602398 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8012910 con 0x7f95c0160f80 2023-11-24T08:06:46.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.347+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c015efa0 con 0x7f95c0160f80 2023-11-24T08:06:46.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.348+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c00675d0 con 0x7f95c0160f80 2023-11-24T08:06:46.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.349+0000 7f95b5ffb640 1 -- 172.21.15.97:0/3766602398 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95b8012a70 con 0x7f95c0160f80 2023-11-24T08:06:46.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.352+0000 7f95b5ffb640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f95a406ae40 0x7f95a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.352+0000 7f95b5ffb640 1 -- 172.21.15.97:0/3766602398 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95b8089d20 con 0x7f95c0160f80 2023-11-24T08:06:46.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.352+0000 7f95c5037640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f95a406ae40 0x7f95a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.352+0000 7f95c5037640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f95a406ae40 0x7f95a406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95bc034000 tx=0x7f95bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:46.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.356+0000 7f95b5ffb640 1 -- 172.21.15.97:0/3766602398 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95b8054e60 con 0x7f95c0160f80 2023-11-24T08:06:46.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.536+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95c015ccb0 con 0x7f95c0160f80 2023-11-24T08:06:46.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.537+0000 7f95b5ffb640 1 -- 172.21.15.97:0/3766602398 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f95b8058480 con 0x7f95c0160f80 2023-11-24T08:06:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:46.540 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:46.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f95a406ae40 msgr2=0x7f95a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f95a406ae40 0x7f95a406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95bc034000 tx=0x7f95bc008030 comp rx=0 tx=0).stop 2023-11-24T08:06:46.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95c0160f80 msgr2=0x7f95c01e8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95c0160f80 0x7f95c01e8af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95b8001830 tx=0x7f95b800a430 comp rx=0 tx=0).stop 2023-11-24T08:06:46.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 shutdown_connections 2023-11-24T08:06:46.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f95a406ae40 0x7f95a406d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95c0160f80 0x7f95c01e8af0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95c00ced50 0x7f95c015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 --2- 172.21.15.97:0/3766602398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95c00ce8f0 0x7f95c015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 >> 172.21.15.97:0/3766602398 conn(0x7f95c009c550 msgr2=0x7f95c00b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:46.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 shutdown_connections 2023-11-24T08:06:46.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.540+0000 7f95c729b640 1 -- 172.21.15.97:0/3766602398 wait complete. 2023-11-24T08:06:46.559 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:06:46.559 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:06:46.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.763+0000 7f88c7071640 1 Processor -- start 2023-11-24T08:06:46.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.764+0000 7f88c7071640 1 -- start start 2023-11-24T08:06:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c7071640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f88c0160920 0x7f88c00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c7071640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f88c00cfea0 0x7f88c0161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c7071640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c00d0a10 con 0x7f88c00cf9f0 2023-11-24T08:06:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c7071640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00d1f50 con 0x7f88c0160920 2023-11-24T08:06:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c7071640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00cf080 con 0x7f88c00cfea0 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c606f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f88c0160920 0x7f88c00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c586e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f88c00cf9f0 0x7f88c0161010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43420/0 (socket says 172.21.15.97:43420) 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.765+0000 7f88c586e640 1 -- 172.21.15.97:0/2586003399 learned_addr learned my addr 172.21.15.97:0/2586003399 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.766+0000 7f88c6870640 1 --2- 172.21.15.97:0/2586003399 >> v2:172.21.15.183:3300/0 conn(0x7f88c00cfea0 0x7f88c0161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.766+0000 7f88c606f640 1 -- 172.21.15.97:0/2586003399 >> v2:172.21.15.183:3300/0 conn(0x7f88c00cfea0 msgr2=0x7f88c0161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.766+0000 7f88c606f640 1 --2- 172.21.15.97:0/2586003399 >> v2:172.21.15.183:3300/0 conn(0x7f88c00cfea0 0x7f88c0161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.766+0000 7f88c606f640 1 -- 172.21.15.97:0/2586003399 >> v1:172.21.15.97:6789/0 conn(0x7f88c00cf9f0 legacy=0x7f88c0161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.766+0000 7f88c606f640 1 -- 172.21.15.97:0/2586003399 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00d0310 con 0x7f88c0160920 2023-11-24T08:06:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.766+0000 7f88c506d640 1 -- 172.21.15.97:0/2586003399 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379004768 0 0) 0x7f88c00d0a10 con 0x7f88c00cf9f0 2023-11-24T08:06:46.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.767+0000 7f88c606f640 1 --2- 172.21.15.97:0/2586003399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c0160920 0x7f88c00b3f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88c008c2c0 tx=0x7f88b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1981f9ace4ebee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.767+0000 7f88c506d640 1 -- 172.21.15.97:0/2586003399 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b402cc80 con 0x7f88c0160920 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.767+0000 7f88c506d640 1 -- 172.21.15.97:0/2586003399 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b402cde0 con 0x7f88c0160920 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.767+0000 7f88c506d640 1 -- 172.21.15.97:0/2586003399 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4034660 con 0x7f88c0160920 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 -- 172.21.15.97:0/2586003399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c0160920 msgr2=0x7f88c00b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 --2- 172.21.15.97:0/2586003399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c0160920 0x7f88c00b3f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88c008c2c0 tx=0x7f88b402bed0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 -- 172.21.15.97:0/2586003399 shutdown_connections 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 --2- 172.21.15.97:0/2586003399 >> v2:172.21.15.183:3300/0 conn(0x7f88c00cfea0 0x7f88c0161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 --2- 172.21.15.97:0/2586003399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c0160920 0x7f88c00b3f30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 -- 172.21.15.97:0/2586003399 >> 172.21.15.97:0/2586003399 conn(0x7f88c00d3090 msgr2=0x7f88c00d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:46.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 -- 172.21.15.97:0/2586003399 shutdown_connections 2023-11-24T08:06:46.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.768+0000 7f88c7071640 1 -- 172.21.15.97:0/2586003399 wait complete. 2023-11-24T08:06:46.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.770+0000 7f88c7071640 1 Processor -- start 2023-11-24T08:06:46.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.770+0000 7f88c7071640 1 -- start start 2023-11-24T08:06:46.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c7071640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88c00cf9f0 0x7f88c01f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c7071640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c00cfea0 0x7f88c014c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c7071640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88c0160920 0x7f88c00b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c7071640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c015f2d0 con 0x7f88c00cfea0 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c7071640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01f40a0 con 0x7f88c0160920 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c7071640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c015ec80 con 0x7f88c00cf9f0 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c00cfea0 0x7f88c014c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c00cfea0 0x7f88c014c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56878/0 (socket says 172.21.15.97:56878) 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 -- 172.21.15.97:0/2549465796 learned_addr learned my addr 172.21.15.97:0/2549465796 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 -- 172.21.15.97:0/2549465796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88c00cf9f0 msgr2=0x7f88c01f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88c00cf9f0 0x7f88c01f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 -- 172.21.15.97:0/2549465796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88c0160920 msgr2=0x7f88c00b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88c0160920 0x7f88c00b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 -- 172.21.15.97:0/2549465796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009a70 con 0x7f88c00cfea0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.771+0000 7f88c586e640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c00cfea0 0x7f88c014c430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c430 tx=0x7f88ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.772+0000 7f88beffd640 1 -- 172.21.15.97:0/2549465796 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0074e0 con 0x7f88c00cfea0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.772+0000 7f88beffd640 1 -- 172.21.15.97:0/2549465796 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac007660 con 0x7f88c00cfea0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.772+0000 7f88beffd640 1 -- 172.21.15.97:0/2549465796 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac004a20 con 0x7f88c00cfea0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.772+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c015ef60 con 0x7f88c00cfea0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.772+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c014c970 con 0x7f88c00cfea0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.773+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c0067450 con 0x7f88c00cfea0 2023-11-24T08:06:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.774+0000 7f88beffd640 1 -- 172.21.15.97:0/2549465796 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88ac004b80 con 0x7f88c00cfea0 2023-11-24T08:06:46.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.775+0000 7f88beffd640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f88a406ae70 0x7f88a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:46.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.775+0000 7f88beffd640 1 -- 172.21.15.97:0/2549465796 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88ac089430 con 0x7f88c00cfea0 2023-11-24T08:06:46.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.775+0000 7f88c606f640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f88a406ae70 0x7f88a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:46.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.776+0000 7f88c606f640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f88a406ae70 0x7f88a406d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88b4036000 tx=0x7f88b402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:46.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.779+0000 7f88beffd640 1 -- 172.21.15.97:0/2549465796 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88ac0544e0 con 0x7f88c00cfea0 2023-11-24T08:06:46.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.964+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88c00ceac0 con 0x7f88a406ae70 2023-11-24T08:06:46.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.973+0000 7f88beffd640 1 -- 172.21.15.97:0/2549465796 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7f88b40344c0 con 0x7f88a406ae70 2023-11-24T08:06:46.978 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:46.980 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:06:46.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.978+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f88a406ae70 msgr2=0x7f88a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.978+0000 7f88c7071640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f88a406ae70 0x7f88a406d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88b4036000 tx=0x7f88b402e000 comp rx=0 tx=0).stop 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.978+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c00cfea0 msgr2=0x7f88c014c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.978+0000 7f88c7071640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c00cfea0 0x7f88c014c430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c430 tx=0x7f88ac00c8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 shutdown_connections 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f88a406ae70 0x7f88a406d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88c0160920 0x7f88c00b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88c00cfea0 0x7f88c014c430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 --2- 172.21.15.97:0/2549465796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88c00cf9f0 0x7f88c01f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 >> 172.21.15.97:0/2549465796 conn(0x7f88c00d3090 msgr2=0x7f88c015b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 shutdown_connections 2023-11-24T08:06:46.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:46.979+0000 7f88c7071640 1 -- 172.21.15.97:0/2549465796 wait complete. 2023-11-24T08:06:46.999 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-24T08:06:45.266646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223476,"kb_used_data":2972,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751244,"statfs":{"total":773094113280,"available":772865273856,"internally_reserved":0,"allocated":3043328,"data_stored":1810264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.679456"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967929+0000","last_change":"2023-11-24T08:06:42.136230+0000","last_active":"2023-11-24T08:06:43.967929+0000","last_peered":"2023-11-24T08:06:43.967929+0000","last_clean":"2023-11-24T08:06:43.967929+0000","last_became_active":"2023-11-24T08:06:42.133570+0000","last_became_peered":"2023-11-24T08:06:42.133570+0000","last_unstale":"2023-11-24T08:06:43.967929+0000","last_undegraded":"2023-11-24T08:06:43.967929+0000","last_fullsized":"2023-11-24T08:06:43.967929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086899+0000","last_change":"2023-11-24T08:06:42.107193+0000","last_active":"2023-11-24T08:06:43.086899+0000","last_peered":"2023-11-24T08:06:43.086899+0000","last_clean":"2023-11-24T08:06:43.086899+0000","last_became_active":"2023-11-24T08:06:42.106907+0000","last_became_peered":"2023-11-24T08:06:42.106907+0000","last_unstale":"2023-11-24T08:06:43.086899+0000","last_undegraded":"2023-11-24T08:06:43.086899+0000","last_fullsized":"2023-11-24T08:06:43.086899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963992+0000","last_change":"2023-11-24T08:06:42.108263+0000","last_active":"2023-11-24T08:06:43.963992+0000","last_peered":"2023-11-24T08:06:43.963992+0000","last_clean":"2023-11-24T08:06:43.963992+0000","last_became_active":"2023-11-24T08:06:42.107647+0000","last_became_peered":"2023-11-24T08:06:42.107647+0000","last_unstale":"2023-11-24T08:06:43.963992+0000","last_undegraded":"2023-11-24T08:06:43.963992+0000","last_fullsized":"2023-11-24T08:06:43.963992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:27.401933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091686+0000","last_change":"2023-11-24T08:06:42.122069+0000","last_active":"2023-11-24T08:06:43.091686+0000","last_peered":"2023-11-24T08:06:43.091686+0000","last_clean":"2023-11-24T08:06:43.091686+0000","last_became_active":"2023-11-24T08:06:42.121385+0000","last_became_peered":"2023-11-24T08:06:42.121385+0000","last_unstale":"2023-11-24T08:06:43.091686+0000","last_undegraded":"2023-11-24T08:06:43.091686+0000","last_fullsized":"2023-11-24T08:06:43.091686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966552+0000","last_change":"2023-11-24T08:06:42.132197+0000","last_active":"2023-11-24T08:06:43.966552+0000","last_peered":"2023-11-24T08:06:43.966552+0000","last_clean":"2023-11-24T08:06:43.966552+0000","last_became_active":"2023-11-24T08:06:42.131870+0000","last_became_peered":"2023-11-24T08:06:42.131870+0000","last_unstale":"2023-11-24T08:06:43.966552+0000","last_undegraded":"2023-11-24T08:06:43.966552+0000","last_fullsized":"2023-11-24T08:06:43.966552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091338+0000","last_change":"2023-11-24T08:06:42.125563+0000","last_active":"2023-11-24T08:06:43.091338+0000","last_peered":"2023-11-24T08:06:43.091338+0000","last_clean":"2023-11-24T08:06:43.091338+0000","last_became_active":"2023-11-24T08:06:42.125192+0000","last_became_peered":"2023-11-24T08:06:42.125192+0000","last_unstale":"2023-11-24T08:06:43.091338+0000","last_undegraded":"2023-11-24T08:06:43.091338+0000","last_fullsized":"2023-11-24T08:06:43.091338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966278+0000","last_change":"2023-11-24T08:06:42.122907+0000","last_active":"2023-11-24T08:06:43.966278+0000","last_peered":"2023-11-24T08:06:43.966278+0000","last_clean":"2023-11-24T08:06:43.966278+0000","last_became_active":"2023-11-24T08:06:42.122580+0000","last_became_peered":"2023-11-24T08:06:42.122580+0000","last_unstale":"2023-11-24T08:06:43.966278+0000","last_undegraded":"2023-11-24T08:06:43.966278+0000","last_fullsized":"2023-11-24T08:06:43.966278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966567+0000","last_change":"2023-11-24T08:06:42.121885+0000","last_active":"2023-11-24T08:06:43.966567+0000","last_peered":"2023-11-24T08:06:43.966567+0000","last_clean":"2023-11-24T08:06:43.966567+0000","last_became_active":"2023-11-24T08:06:42.121567+0000","last_became_peered":"2023-11-24T08:06:42.121567+0000","last_unstale":"2023-11-24T08:06:43.966567+0000","last_undegraded":"2023-11-24T08:06:43.966567+0000","last_fullsized":"2023-11-24T08:06:43.966567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968008+0000","last_change":"2023-11-24T08:06:42.136825+0000","last_active":"2023-11-24T08:06:43.968008+0000","last_peered":"2023-11-24T08:06:43.968008+0000","last_clean":"2023-11-24T08:06:43.968008+0000","last_became_active":"2023-11-24T08:06:42.136570+0000","last_became_peered":"2023-11-24T08:06:42.136570+0000","last_unstale":"2023-11-24T08:06:43.968008+0000","last_undegraded":"2023-11-24T08:06:43.968008+0000","last_fullsized":"2023-11-24T08:06:43.968008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476754+0000","last_change":"2023-11-24T08:06:42.133333+0000","last_active":"2023-11-24T08:06:43.476754+0000","last_peered":"2023-11-24T08:06:43.476754+0000","last_clean":"2023-11-24T08:06:43.476754+0000","last_became_active":"2023-11-24T08:06:42.133051+0000","last_became_peered":"2023-11-24T08:06:42.133051+0000","last_unstale":"2023-11-24T08:06:43.476754+0000","last_undegraded":"2023-11-24T08:06:43.476754+0000","last_fullsized":"2023-11-24T08:06:43.476754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476581+0000","last_change":"2023-11-24T08:06:42.130796+0000","last_active":"2023-11-24T08:06:43.476581+0000","last_peered":"2023-11-24T08:06:43.476581+0000","last_clean":"2023-11-24T08:06:43.476581+0000","last_became_active":"2023-11-24T08:06:42.130502+0000","last_became_peered":"2023-11-24T08:06:42.130502+0000","last_unstale":"2023-11-24T08:06:43.476581+0000","last_undegraded":"2023-11-24T08:06:43.476581+0000","last_fullsized":"2023-11-24T08:06:43.476581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966612+0000","last_change":"2023-11-24T08:06:42.126261+0000","last_active":"2023-11-24T08:06:43.966612+0000","last_peered":"2023-11-24T08:06:43.966612+0000","last_clean":"2023-11-24T08:06:43.966612+0000","last_became_active":"2023-11-24T08:06:42.125771+0000","last_became_peered":"2023-11-24T08:06:42.125771+0000","last_unstale":"2023-11-24T08:06:43.966612+0000","last_undegraded":"2023-11-24T08:06:43.966612+0000","last_fullsized":"2023-11-24T08:06:43.966612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:16.965524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966004+0000","last_change":"2023-11-24T08:06:42.122706+0000","last_active":"2023-11-24T08:06:43.966004+0000","last_peered":"2023-11-24T08:06:43.966004+0000","last_clean":"2023-11-24T08:06:43.966004+0000","last_became_active":"2023-11-24T08:06:42.122378+0000","last_became_peered":"2023-11-24T08:06:42.122378+0000","last_unstale":"2023-11-24T08:06:43.966004+0000","last_undegraded":"2023-11-24T08:06:43.966004+0000","last_fullsized":"2023-11-24T08:06:43.966004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963516+0000","last_change":"2023-11-24T08:06:42.106916+0000","last_active":"2023-11-24T08:06:43.963516+0000","last_peered":"2023-11-24T08:06:43.963516+0000","last_clean":"2023-11-24T08:06:43.963516+0000","last_became_active":"2023-11-24T08:06:42.106633+0000","last_became_peered":"2023-11-24T08:06:42.106633+0000","last_unstale":"2023-11-24T08:06:43.963516+0000","last_undegraded":"2023-11-24T08:06:43.963516+0000","last_fullsized":"2023-11-24T08:06:43.963516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:48:07.993924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086431+0000","last_change":"2023-11-24T08:06:42.099238+0000","last_active":"2023-11-24T08:06:43.086431+0000","last_peered":"2023-11-24T08:06:43.086431+0000","last_clean":"2023-11-24T08:06:43.086431+0000","last_became_active":"2023-11-24T08:06:42.098972+0000","last_became_peered":"2023-11-24T08:06:42.098972+0000","last_unstale":"2023-11-24T08:06:43.086431+0000","last_undegraded":"2023-11-24T08:06:43.086431+0000","last_fullsized":"2023-11-24T08:06:43.086431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090638+0000","last_change":"2023-11-24T08:06:42.127641+0000","last_active":"2023-11-24T08:06:43.090638+0000","last_peered":"2023-11-24T08:06:43.090638+0000","last_clean":"2023-11-24T08:06:43.090638+0000","last_became_active":"2023-11-24T08:06:42.127276+0000","last_became_peered":"2023-11-24T08:06:42.127276+0000","last_unstale":"2023-11-24T08:06:43.090638+0000","last_undegraded":"2023-11-24T08:06:43.090638+0000","last_fullsized":"2023-11-24T08:06:43.090638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092315+0000","last_change":"2023-11-24T08:06:42.129079+0000","last_active":"2023-11-24T08:06:43.092315+0000","last_peered":"2023-11-24T08:06:43.092315+0000","last_clean":"2023-11-24T08:06:43.092315+0000","last_became_active":"2023-11-24T08:06:42.128796+0000","last_became_peered":"2023-11-24T08:06:42.128796+0000","last_unstale":"2023-11-24T08:06:43.092315+0000","last_undegraded":"2023-11-24T08:06:43.092315+0000","last_fullsized":"2023-11-24T08:06:43.092315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346604+0000","last_change":"2023-11-24T08:06:42.122648+0000","last_active":"2023-11-24T08:06:43.346604+0000","last_peered":"2023-11-24T08:06:43.346604+0000","last_clean":"2023-11-24T08:06:43.346604+0000","last_became_active":"2023-11-24T08:06:42.122184+0000","last_became_peered":"2023-11-24T08:06:42.122184+0000","last_unstale":"2023-11-24T08:06:43.346604+0000","last_undegraded":"2023-11-24T08:06:43.346604+0000","last_fullsized":"2023-11-24T08:06:43.346604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:47.554125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968216+0000","last_change":"2023-11-24T08:06:42.136398+0000","last_active":"2023-11-24T08:06:43.968216+0000","last_peered":"2023-11-24T08:06:43.968216+0000","last_clean":"2023-11-24T08:06:43.968216+0000","last_became_active":"2023-11-24T08:06:42.133633+0000","last_became_peered":"2023-11-24T08:06:42.133633+0000","last_unstale":"2023-11-24T08:06:43.968216+0000","last_undegraded":"2023-11-24T08:06:43.968216+0000","last_fullsized":"2023-11-24T08:06:43.968216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:45:50.299537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476680+0000","last_change":"2023-11-24T08:06:42.134200+0000","last_active":"2023-11-24T08:06:43.476680+0000","last_peered":"2023-11-24T08:06:43.476680+0000","last_clean":"2023-11-24T08:06:43.476680+0000","last_became_active":"2023-11-24T08:06:42.133905+0000","last_became_peered":"2023-11-24T08:06:42.133905+0000","last_unstale":"2023-11-24T08:06:43.476680+0000","last_undegraded":"2023-11-24T08:06:43.476680+0000","last_fullsized":"2023-11-24T08:06:43.476680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963640+0000","last_change":"2023-11-24T08:06:42.117257+0000","last_active":"2023-11-24T08:06:43.963640+0000","last_peered":"2023-11-24T08:06:43.963640+0000","last_clean":"2023-11-24T08:06:43.963640+0000","last_became_active":"2023-11-24T08:06:42.116917+0000","last_became_peered":"2023-11-24T08:06:42.116917+0000","last_unstale":"2023-11-24T08:06:43.963640+0000","last_undegraded":"2023-11-24T08:06:43.963640+0000","last_fullsized":"2023-11-24T08:06:43.963640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:56.791724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091695+0000","last_change":"2023-11-24T08:06:42.136875+0000","last_active":"2023-11-24T08:06:43.091695+0000","last_peered":"2023-11-24T08:06:43.091695+0000","last_clean":"2023-11-24T08:06:43.091695+0000","last_became_active":"2023-11-24T08:06:42.136572+0000","last_became_peered":"2023-11-24T08:06:42.136572+0000","last_unstale":"2023-11-24T08:06:43.091695+0000","last_undegraded":"2023-11-24T08:06:43.091695+0000","last_fullsized":"2023-11-24T08:06:43.091695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.120702+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.120446+0000","last_became_peered":"2023-11-24T08:06:42.120446+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:06.281138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090758+0000","last_change":"2023-11-24T08:06:42.117026+0000","last_active":"2023-11-24T08:06:43.090758+0000","last_peered":"2023-11-24T08:06:43.090758+0000","last_clean":"2023-11-24T08:06:43.090758+0000","last_became_active":"2023-11-24T08:06:42.115990+0000","last_became_peered":"2023-11-24T08:06:42.115990+0000","last_unstale":"2023-11-24T08:06:43.090758+0000","last_undegraded":"2023-11-24T08:06:43.090758+0000","last_fullsized":"2023-11-24T08:06:43.090758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966398+0000","last_change":"2023-11-24T08:06:42.107007+0000","last_active":"2023-11-24T08:06:43.966398+0000","last_peered":"2023-11-24T08:06:43.966398+0000","last_clean":"2023-11-24T08:06:43.966398+0000","last_became_active":"2023-11-24T08:06:42.103402+0000","last_became_peered":"2023-11-24T08:06:42.103402+0000","last_unstale":"2023-11-24T08:06:43.966398+0000","last_undegraded":"2023-11-24T08:06:43.966398+0000","last_fullsized":"2023-11-24T08:06:43.966398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476753+0000","last_change":"2023-11-24T08:06:42.126780+0000","last_active":"2023-11-24T08:06:43.476753+0000","last_peered":"2023-11-24T08:06:43.476753+0000","last_clean":"2023-11-24T08:06:43.476753+0000","last_became_active":"2023-11-24T08:06:42.126540+0000","last_became_peered":"2023-11-24T08:06:42.126540+0000","last_unstale":"2023-11-24T08:06:43.476753+0000","last_undegraded":"2023-11-24T08:06:43.476753+0000","last_fullsized":"2023-11-24T08:06:43.476753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086799+0000","last_change":"2023-11-24T08:06:42.100776+0000","last_active":"2023-11-24T08:06:43.086799+0000","last_peered":"2023-11-24T08:06:43.086799+0000","last_clean":"2023-11-24T08:06:43.086799+0000","last_became_active":"2023-11-24T08:06:42.098840+0000","last_became_peered":"2023-11-24T08:06:42.098840+0000","last_unstale":"2023-11-24T08:06:43.086799+0000","last_undegraded":"2023-11-24T08:06:43.086799+0000","last_fullsized":"2023-11-24T08:06:43.086799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966796+0000","last_change":"2023-11-24T08:06:42.114236+0000","last_active":"2023-11-24T08:06:43.966796+0000","last_peered":"2023-11-24T08:06:43.966796+0000","last_clean":"2023-11-24T08:06:43.966796+0000","last_became_active":"2023-11-24T08:06:42.113925+0000","last_became_peered":"2023-11-24T08:06:42.113925+0000","last_unstale":"2023-11-24T08:06:43.966796+0000","last_undegraded":"2023-11-24T08:06:43.966796+0000","last_fullsized":"2023-11-24T08:06:43.966796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964102+0000","last_change":"2023-11-24T08:06:42.110806+0000","last_active":"2023-11-24T08:06:43.964102+0000","last_peered":"2023-11-24T08:06:43.964102+0000","last_clean":"2023-11-24T08:06:43.964102+0000","last_became_active":"2023-11-24T08:06:42.110398+0000","last_became_peered":"2023-11-24T08:06:42.110398+0000","last_unstale":"2023-11-24T08:06:43.964102+0000","last_undegraded":"2023-11-24T08:06:43.964102+0000","last_fullsized":"2023-11-24T08:06:43.964102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:11.994031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092483+0000","last_change":"2023-11-24T08:06:42.119038+0000","last_active":"2023-11-24T08:06:43.092483+0000","last_peered":"2023-11-24T08:06:43.092483+0000","last_clean":"2023-11-24T08:06:43.092483+0000","last_became_active":"2023-11-24T08:06:42.116791+0000","last_became_peered":"2023-11-24T08:06:42.116791+0000","last_unstale":"2023-11-24T08:06:43.092483+0000","last_undegraded":"2023-11-24T08:06:43.092483+0000","last_fullsized":"2023-11-24T08:06:43.092483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346553+0000","last_change":"2023-11-24T08:06:42.118075+0000","last_active":"2023-11-24T08:06:43.346553+0000","last_peered":"2023-11-24T08:06:43.346553+0000","last_clean":"2023-11-24T08:06:43.346553+0000","last_became_active":"2023-11-24T08:06:42.117879+0000","last_became_peered":"2023-11-24T08:06:42.117879+0000","last_unstale":"2023-11-24T08:06:43.346553+0000","last_undegraded":"2023-11-24T08:06:43.346553+0000","last_fullsized":"2023-11-24T08:06:43.346553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475999+0000","last_change":"2023-11-24T08:06:42.118534+0000","last_active":"2023-11-24T08:06:43.475999+0000","last_peered":"2023-11-24T08:06:43.475999+0000","last_clean":"2023-11-24T08:06:43.475999+0000","last_became_active":"2023-11-24T08:06:42.118081+0000","last_became_peered":"2023-11-24T08:06:42.118081+0000","last_unstale":"2023-11-24T08:06:43.475999+0000","last_undegraded":"2023-11-24T08:06:43.475999+0000","last_fullsized":"2023-11-24T08:06:43.475999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966118+0000","last_change":"2023-11-24T08:06:42.105896+0000","last_active":"2023-11-24T08:06:43.966118+0000","last_peered":"2023-11-24T08:06:43.966118+0000","last_clean":"2023-11-24T08:06:43.966118+0000","last_became_active":"2023-11-24T08:06:42.105293+0000","last_became_peered":"2023-11-24T08:06:42.105293+0000","last_unstale":"2023-11-24T08:06:43.966118+0000","last_undegraded":"2023-11-24T08:06:43.966118+0000","last_fullsized":"2023-11-24T08:06:43.966118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:10.645249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966071+0000","last_change":"2023-11-24T08:06:41.631971+0000","last_active":"2023-11-24T08:06:43.966071+0000","last_peered":"2023-11-24T08:06:43.966071+0000","last_clean":"2023-11-24T08:06:43.966071+0000","last_became_active":"2023-11-24T08:06:41.631383+0000","last_became_peered":"2023-11-24T08:06:41.631383+0000","last_unstale":"2023-11-24T08:06:43.966071+0000","last_undegraded":"2023-11-24T08:06:43.966071+0000","last_fullsized":"2023-11-24T08:06:43.966071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963857+0000","last_change":"2023-11-24T08:06:42.118716+0000","last_active":"2023-11-24T08:06:43.963857+0000","last_peered":"2023-11-24T08:06:43.963857+0000","last_clean":"2023-11-24T08:06:43.963857+0000","last_became_active":"2023-11-24T08:06:42.118356+0000","last_became_peered":"2023-11-24T08:06:42.118356+0000","last_unstale":"2023-11-24T08:06:43.963857+0000","last_undegraded":"2023-11-24T08:06:43.963857+0000","last_fullsized":"2023-11-24T08:06:43.963857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:29:52.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475919+0000","last_change":"2023-11-24T08:06:41.639457+0000","last_active":"2023-11-24T08:06:43.475919+0000","last_peered":"2023-11-24T08:06:43.475919+0000","last_clean":"2023-11-24T08:06:43.475919+0000","last_became_active":"2023-11-24T08:06:41.638910+0000","last_became_peered":"2023-11-24T08:06:41.638910+0000","last_unstale":"2023-11-24T08:06:43.475919+0000","last_undegraded":"2023-11-24T08:06:43.475919+0000","last_fullsized":"2023-11-24T08:06:43.475919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965906+0000","last_change":"2023-11-24T08:06:41.639144+0000","last_active":"2023-11-24T08:06:43.965906+0000","last_peered":"2023-11-24T08:06:43.965906+0000","last_clean":"2023-11-24T08:06:43.965906+0000","last_became_active":"2023-11-24T08:06:41.638849+0000","last_became_peered":"2023-11-24T08:06:41.638849+0000","last_unstale":"2023-11-24T08:06:43.965906+0000","last_undegraded":"2023-11-24T08:06:43.965906+0000","last_fullsized":"2023-11-24T08:06:43.965906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966325+0000","last_change":"2023-11-24T08:06:42.107129+0000","last_active":"2023-11-24T08:06:43.966325+0000","last_peered":"2023-11-24T08:06:43.966325+0000","last_clean":"2023-11-24T08:06:43.966325+0000","last_became_active":"2023-11-24T08:06:42.106875+0000","last_became_peered":"2023-11-24T08:06:42.106875+0000","last_unstale":"2023-11-24T08:06:43.966325+0000","last_undegraded":"2023-11-24T08:06:43.966325+0000","last_fullsized":"2023-11-24T08:06:43.966325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090871+0000","last_change":"2023-11-24T08:06:41.643162+0000","last_active":"2023-11-24T08:06:43.090871+0000","last_peered":"2023-11-24T08:06:43.090871+0000","last_clean":"2023-11-24T08:06:43.090871+0000","last_became_active":"2023-11-24T08:06:41.642111+0000","last_became_peered":"2023-11-24T08:06:41.642111+0000","last_unstale":"2023-11-24T08:06:43.090871+0000","last_undegraded":"2023-11-24T08:06:43.090871+0000","last_fullsized":"2023-11-24T08:06:43.090871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086444+0000","last_change":"2023-11-24T08:06:42.102972+0000","last_active":"2023-11-24T08:06:43.086444+0000","last_peered":"2023-11-24T08:06:43.086444+0000","last_clean":"2023-11-24T08:06:43.086444+0000","last_became_active":"2023-11-24T08:06:42.102488+0000","last_became_peered":"2023-11-24T08:06:42.102488+0000","last_unstale":"2023-11-24T08:06:43.086444+0000","last_undegraded":"2023-11-24T08:06:43.086444+0000","last_fullsized":"2023-11-24T08:06:43.086444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476748+0000","last_change":"2023-11-24T08:06:41.644502+0000","last_active":"2023-11-24T08:06:43.476748+0000","last_peered":"2023-11-24T08:06:43.476748+0000","last_clean":"2023-11-24T08:06:43.476748+0000","last_became_active":"2023-11-24T08:06:41.644195+0000","last_became_peered":"2023-11-24T08:06:41.644195+0000","last_unstale":"2023-11-24T08:06:43.476748+0000","last_undegraded":"2023-11-24T08:06:43.476748+0000","last_fullsized":"2023-11-24T08:06:43.476748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091370+0000","last_change":"2023-11-24T08:06:42.128953+0000","last_active":"2023-11-24T08:06:43.091370+0000","last_peered":"2023-11-24T08:06:43.091370+0000","last_clean":"2023-11-24T08:06:43.091370+0000","last_became_active":"2023-11-24T08:06:42.128626+0000","last_became_peered":"2023-11-24T08:06:42.128626+0000","last_unstale":"2023-11-24T08:06:43.091370+0000","last_undegraded":"2023-11-24T08:06:43.091370+0000","last_fullsized":"2023-11-24T08:06:43.091370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091492+0000","last_change":"2023-11-24T08:06:41.640464+0000","last_active":"2023-11-24T08:06:43.091492+0000","last_peered":"2023-11-24T08:06:43.091492+0000","last_clean":"2023-11-24T08:06:43.091492+0000","last_became_active":"2023-11-24T08:06:41.640192+0000","last_became_peered":"2023-11-24T08:06:41.640192+0000","last_unstale":"2023-11-24T08:06:43.091492+0000","last_undegraded":"2023-11-24T08:06:43.091492+0000","last_fullsized":"2023-11-24T08:06:43.091492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:40.469927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963979+0000","last_change":"2023-11-24T08:06:42.132751+0000","last_active":"2023-11-24T08:06:43.963979+0000","last_peered":"2023-11-24T08:06:43.963979+0000","last_clean":"2023-11-24T08:06:43.963979+0000","last_became_active":"2023-11-24T08:06:42.132521+0000","last_became_peered":"2023-11-24T08:06:42.132521+0000","last_unstale":"2023-11-24T08:06:43.963979+0000","last_undegraded":"2023-11-24T08:06:43.963979+0000","last_fullsized":"2023-11-24T08:06:43.963979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:57.695423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086753+0000","last_change":"2023-11-24T08:06:41.639732+0000","last_active":"2023-11-24T08:06:43.086753+0000","last_peered":"2023-11-24T08:06:43.086753+0000","last_clean":"2023-11-24T08:06:43.086753+0000","last_became_active":"2023-11-24T08:06:41.639425+0000","last_became_peered":"2023-11-24T08:06:41.639425+0000","last_unstale":"2023-11-24T08:06:43.086753+0000","last_undegraded":"2023-11-24T08:06:43.086753+0000","last_fullsized":"2023-11-24T08:06:43.086753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966735+0000","last_change":"2023-11-24T08:06:42.128585+0000","last_active":"2023-11-24T08:06:43.966735+0000","last_peered":"2023-11-24T08:06:43.966735+0000","last_clean":"2023-11-24T08:06:43.966735+0000","last_became_active":"2023-11-24T08:06:42.125584+0000","last_became_peered":"2023-11-24T08:06:42.125584+0000","last_unstale":"2023-11-24T08:06:43.966735+0000","last_undegraded":"2023-11-24T08:06:43.966735+0000","last_fullsized":"2023-11-24T08:06:43.966735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:49.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476560+0000","last_change":"2023-11-24T08:06:41.633239+0000","last_active":"2023-11-24T08:06:43.476560+0000","last_peered":"2023-11-24T08:06:43.476560+0000","last_clean":"2023-11-24T08:06:43.476560+0000","last_became_active":"2023-11-24T08:06:41.632918+0000","last_became_peered":"2023-11-24T08:06:41.632918+0000","last_unstale":"2023-11-24T08:06:43.476560+0000","last_undegraded":"2023-11-24T08:06:43.476560+0000","last_fullsized":"2023-11-24T08:06:43.476560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:46.220387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967524+0000","last_change":"2023-11-24T08:06:42.132872+0000","last_active":"2023-11-24T08:06:43.967524+0000","last_peered":"2023-11-24T08:06:43.967524+0000","last_clean":"2023-11-24T08:06:43.967524+0000","last_became_active":"2023-11-24T08:06:42.124186+0000","last_became_peered":"2023-11-24T08:06:42.124186+0000","last_unstale":"2023-11-24T08:06:43.967524+0000","last_undegraded":"2023-11-24T08:06:43.967524+0000","last_fullsized":"2023-11-24T08:06:43.967524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963962+0000","last_change":"2023-11-24T08:06:41.628869+0000","last_active":"2023-11-24T08:06:43.963962+0000","last_peered":"2023-11-24T08:06:43.963962+0000","last_clean":"2023-11-24T08:06:43.963962+0000","last_became_active":"2023-11-24T08:06:41.628535+0000","last_became_peered":"2023-11-24T08:06:41.628535+0000","last_unstale":"2023-11-24T08:06:43.963962+0000","last_undegraded":"2023-11-24T08:06:43.963962+0000","last_fullsized":"2023-11-24T08:06:43.963962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:03:24.083142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963641+0000","last_change":"2023-11-24T08:06:42.124842+0000","last_active":"2023-11-24T08:06:43.963641+0000","last_peered":"2023-11-24T08:06:43.963641+0000","last_clean":"2023-11-24T08:06:43.963641+0000","last_became_active":"2023-11-24T08:06:42.124506+0000","last_became_peered":"2023-11-24T08:06:42.124506+0000","last_unstale":"2023-11-24T08:06:43.963641+0000","last_undegraded":"2023-11-24T08:06:43.963641+0000","last_fullsized":"2023-11-24T08:06:43.963641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:39.047223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092249+0000","last_change":"2023-11-24T08:06:41.643552+0000","last_active":"2023-11-24T08:06:43.092249+0000","last_peered":"2023-11-24T08:06:43.092249+0000","last_clean":"2023-11-24T08:06:43.092249+0000","last_became_active":"2023-11-24T08:06:41.641818+0000","last_became_peered":"2023-11-24T08:06:41.641818+0000","last_unstale":"2023-11-24T08:06:43.092249+0000","last_undegraded":"2023-11-24T08:06:43.092249+0000","last_fullsized":"2023-11-24T08:06:43.092249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:01.271650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966965+0000","last_change":"2023-11-24T08:06:42.132641+0000","last_active":"2023-11-24T08:06:43.966965+0000","last_peered":"2023-11-24T08:06:43.966965+0000","last_clean":"2023-11-24T08:06:43.966965+0000","last_became_active":"2023-11-24T08:06:42.132319+0000","last_became_peered":"2023-11-24T08:06:42.132319+0000","last_unstale":"2023-11-24T08:06:43.966965+0000","last_undegraded":"2023-11-24T08:06:43.966965+0000","last_fullsized":"2023-11-24T08:06:43.966965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475880+0000","last_change":"2023-11-24T08:06:41.639310+0000","last_active":"2023-11-24T08:06:43.475880+0000","last_peered":"2023-11-24T08:06:43.475880+0000","last_clean":"2023-11-24T08:06:43.475880+0000","last_became_active":"2023-11-24T08:06:41.638938+0000","last_became_peered":"2023-11-24T08:06:41.638938+0000","last_unstale":"2023-11-24T08:06:43.475880+0000","last_undegraded":"2023-11-24T08:06:43.475880+0000","last_fullsized":"2023-11-24T08:06:43.475880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476046+0000","last_change":"2023-11-24T08:06:42.109812+0000","last_active":"2023-11-24T08:06:43.476046+0000","last_peered":"2023-11-24T08:06:43.476046+0000","last_clean":"2023-11-24T08:06:43.476046+0000","last_became_active":"2023-11-24T08:06:42.109207+0000","last_became_peered":"2023-11-24T08:06:42.109207+0000","last_unstale":"2023-11-24T08:06:43.476046+0000","last_undegraded":"2023-11-24T08:06:43.476046+0000","last_fullsized":"2023-11-24T08:06:43.476046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346250+0000","last_change":"2023-11-24T08:06:41.632992+0000","last_active":"2023-11-24T08:06:43.346250+0000","last_peered":"2023-11-24T08:06:43.346250+0000","last_clean":"2023-11-24T08:06:43.346250+0000","last_became_active":"2023-11-24T08:06:41.632700+0000","last_became_peered":"2023-11-24T08:06:41.632700+0000","last_unstale":"2023-11-24T08:06:43.346250+0000","last_undegraded":"2023-11-24T08:06:43.346250+0000","last_fullsized":"2023-11-24T08:06:43.346250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:12.440430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966636+0000","last_change":"2023-11-24T08:06:42.132583+0000","last_active":"2023-11-24T08:06:43.966636+0000","last_peered":"2023-11-24T08:06:43.966636+0000","last_clean":"2023-11-24T08:06:43.966636+0000","last_became_active":"2023-11-24T08:06:42.132277+0000","last_became_peered":"2023-11-24T08:06:42.132277+0000","last_unstale":"2023-11-24T08:06:43.966636+0000","last_undegraded":"2023-11-24T08:06:43.966636+0000","last_fullsized":"2023-11-24T08:06:43.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967404+0000","last_change":"2023-11-24T08:06:41.625650+0000","last_active":"2023-11-24T08:06:43.967404+0000","last_peered":"2023-11-24T08:06:43.967404+0000","last_clean":"2023-11-24T08:06:43.967404+0000","last_became_active":"2023-11-24T08:06:41.625353+0000","last_became_peered":"2023-11-24T08:06:41.625353+0000","last_unstale":"2023-11-24T08:06:43.967404+0000","last_undegraded":"2023-11-24T08:06:43.967404+0000","last_fullsized":"2023-11-24T08:06:43.967404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:18:14.524913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966991+0000","last_change":"2023-11-24T08:06:42.134924+0000","last_active":"2023-11-24T08:06:43.966991+0000","last_peered":"2023-11-24T08:06:43.966991+0000","last_clean":"2023-11-24T08:06:43.966991+0000","last_became_active":"2023-11-24T08:06:42.134575+0000","last_became_peered":"2023-11-24T08:06:42.134575+0000","last_unstale":"2023-11-24T08:06:43.966991+0000","last_undegraded":"2023-11-24T08:06:43.966991+0000","last_fullsized":"2023-11-24T08:06:43.966991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346717+0000","last_change":"2023-11-24T08:06:41.629479+0000","last_active":"2023-11-24T08:06:43.346717+0000","last_peered":"2023-11-24T08:06:43.346717+0000","last_clean":"2023-11-24T08:06:43.346717+0000","last_became_active":"2023-11-24T08:06:41.629108+0000","last_became_peered":"2023-11-24T08:06:41.629108+0000","last_unstale":"2023-11-24T08:06:43.346717+0000","last_undegraded":"2023-11-24T08:06:43.346717+0000","last_fullsized":"2023-11-24T08:06:43.346717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:15.631786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968280+0000","last_change":"2023-11-24T08:06:42.135144+0000","last_active":"2023-11-24T08:06:43.968280+0000","last_peered":"2023-11-24T08:06:43.968280+0000","last_clean":"2023-11-24T08:06:43.968280+0000","last_became_active":"2023-11-24T08:06:42.134822+0000","last_became_peered":"2023-11-24T08:06:42.134822+0000","last_unstale":"2023-11-24T08:06:43.968280+0000","last_undegraded":"2023-11-24T08:06:43.968280+0000","last_fullsized":"2023-11-24T08:06:43.968280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:07.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086868+0000","last_change":"2023-11-24T08:06:41.628750+0000","last_active":"2023-11-24T08:06:43.086868+0000","last_peered":"2023-11-24T08:06:43.086868+0000","last_clean":"2023-11-24T08:06:43.086868+0000","last_became_active":"2023-11-24T08:06:41.628251+0000","last_became_peered":"2023-11-24T08:06:41.628251+0000","last_unstale":"2023-11-24T08:06:43.086868+0000","last_undegraded":"2023-11-24T08:06:43.086868+0000","last_fullsized":"2023-11-24T08:06:43.086868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092304+0000","last_change":"2023-11-24T08:06:42.120468+0000","last_active":"2023-11-24T08:06:43.092304+0000","last_peered":"2023-11-24T08:06:43.092304+0000","last_clean":"2023-11-24T08:06:43.092304+0000","last_became_active":"2023-11-24T08:06:42.116425+0000","last_became_peered":"2023-11-24T08:06:42.116425+0000","last_unstale":"2023-11-24T08:06:43.092304+0000","last_undegraded":"2023-11-24T08:06:43.092304+0000","last_fullsized":"2023-11-24T08:06:43.092304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346545+0000","last_change":"2023-11-24T08:06:41.644211+0000","last_active":"2023-11-24T08:06:43.346545+0000","last_peered":"2023-11-24T08:06:43.346545+0000","last_clean":"2023-11-24T08:06:43.346545+0000","last_became_active":"2023-11-24T08:06:41.643571+0000","last_became_peered":"2023-11-24T08:06:41.643571+0000","last_unstale":"2023-11-24T08:06:43.346545+0000","last_undegraded":"2023-11-24T08:06:43.346545+0000","last_fullsized":"2023-11-24T08:06:43.346545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:26.632317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967813+0000","last_change":"2023-11-24T08:06:42.134167+0000","last_active":"2023-11-24T08:06:43.967813+0000","last_peered":"2023-11-24T08:06:43.967813+0000","last_clean":"2023-11-24T08:06:43.967813+0000","last_became_active":"2023-11-24T08:06:42.133214+0000","last_became_peered":"2023-11-24T08:06:42.133214+0000","last_unstale":"2023-11-24T08:06:43.967813+0000","last_undegraded":"2023-11-24T08:06:43.967813+0000","last_fullsized":"2023-11-24T08:06:43.967813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:06:42.117866+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:06:42.117866+0000","last_peered":"2023-11-24T08:06:42.117866+0000","last_clean":"2023-11-24T08:06:42.117866+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:06:42.117866+0000","last_undegraded":"2023-11-24T08:06:42.117866+0000","last_fullsized":"2023-11-24T08:06:42.117866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090597+0000","last_change":"2023-11-24T08:06:41.643269+0000","last_active":"2023-11-24T08:06:43.090597+0000","last_peered":"2023-11-24T08:06:43.090597+0000","last_clean":"2023-11-24T08:06:43.090597+0000","last_became_active":"2023-11-24T08:06:41.642053+0000","last_became_peered":"2023-11-24T08:06:41.642053+0000","last_unstale":"2023-11-24T08:06:43.090597+0000","last_undegraded":"2023-11-24T08:06:43.090597+0000","last_fullsized":"2023-11-24T08:06:43.090597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:26.168539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.127685+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.127439+0000","last_became_peered":"2023-11-24T08:06:42.127439+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965579+0000","last_change":"2023-11-24T08:06:41.633662+0000","last_active":"2023-11-24T08:06:43.965579+0000","last_peered":"2023-11-24T08:06:43.965579+0000","last_clean":"2023-11-24T08:06:43.965579+0000","last_became_active":"2023-11-24T08:06:41.633379+0000","last_became_peered":"2023-11-24T08:06:41.633379+0000","last_unstale":"2023-11-24T08:06:43.965579+0000","last_undegraded":"2023-11-24T08:06:43.965579+0000","last_fullsized":"2023-11-24T08:06:43.965579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963412+0000","last_change":"2023-11-24T08:06:42.115320+0000","last_active":"2023-11-24T08:06:43.963412+0000","last_peered":"2023-11-24T08:06:43.963412+0000","last_clean":"2023-11-24T08:06:43.963412+0000","last_became_active":"2023-11-24T08:06:42.115112+0000","last_became_peered":"2023-11-24T08:06:42.115112+0000","last_unstale":"2023-11-24T08:06:43.963412+0000","last_undegraded":"2023-11-24T08:06:43.963412+0000","last_fullsized":"2023-11-24T08:06:43.963412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:57:01.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346517+0000","last_change":"2023-11-24T08:06:41.626881+0000","last_active":"2023-11-24T08:06:43.346517+0000","last_peered":"2023-11-24T08:06:43.346517+0000","last_clean":"2023-11-24T08:06:43.346517+0000","last_became_active":"2023-11-24T08:06:41.626584+0000","last_became_peered":"2023-11-24T08:06:41.626584+0000","last_unstale":"2023-11-24T08:06:43.346517+0000","last_undegraded":"2023-11-24T08:06:43.346517+0000","last_fullsized":"2023-11-24T08:06:43.346517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086532+0000","last_change":"2023-11-24T08:06:42.098608+0000","last_active":"2023-11-24T08:06:43.086532+0000","last_peered":"2023-11-24T08:06:43.086532+0000","last_clean":"2023-11-24T08:06:43.086532+0000","last_became_active":"2023-11-24T08:06:42.097283+0000","last_became_peered":"2023-11-24T08:06:42.097283+0000","last_unstale":"2023-11-24T08:06:43.086532+0000","last_undegraded":"2023-11-24T08:06:43.086532+0000","last_fullsized":"2023-11-24T08:06:43.086532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092482+0000","last_change":"2023-11-24T08:06:41.642174+0000","last_active":"2023-11-24T08:06:43.092482+0000","last_peered":"2023-11-24T08:06:43.092482+0000","last_clean":"2023-11-24T08:06:43.092482+0000","last_became_active":"2023-11-24T08:06:41.639506+0000","last_became_peered":"2023-11-24T08:06:41.639506+0000","last_unstale":"2023-11-24T08:06:43.092482+0000","last_undegraded":"2023-11-24T08:06:43.092482+0000","last_fullsized":"2023-11-24T08:06:43.092482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:25.898898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966317+0000","last_change":"2023-11-24T08:06:42.113349+0000","last_active":"2023-11-24T08:06:43.966317+0000","last_peered":"2023-11-24T08:06:43.966317+0000","last_clean":"2023-11-24T08:06:43.966317+0000","last_became_active":"2023-11-24T08:06:42.112363+0000","last_became_peered":"2023-11-24T08:06:42.112363+0000","last_unstale":"2023-11-24T08:06:43.966317+0000","last_undegraded":"2023-11-24T08:06:43.966317+0000","last_fullsized":"2023-11-24T08:06:43.966317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:39.659839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086651+0000","last_change":"2023-11-24T08:06:41.628541+0000","last_active":"2023-11-24T08:06:43.086651+0000","last_peered":"2023-11-24T08:06:43.086651+0000","last_clean":"2023-11-24T08:06:43.086651+0000","last_became_active":"2023-11-24T08:06:41.627852+0000","last_became_peered":"2023-11-24T08:06:41.627852+0000","last_unstale":"2023-11-24T08:06:43.086651+0000","last_undegraded":"2023-11-24T08:06:43.086651+0000","last_fullsized":"2023-11-24T08:06:43.086651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:47.669843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091336+0000","last_change":"2023-11-24T08:06:42.123280+0000","last_active":"2023-11-24T08:06:43.091336+0000","last_peered":"2023-11-24T08:06:43.091336+0000","last_clean":"2023-11-24T08:06:43.091336+0000","last_became_active":"2023-11-24T08:06:42.122955+0000","last_became_peered":"2023-11-24T08:06:42.122955+0000","last_unstale":"2023-11-24T08:06:43.091336+0000","last_undegraded":"2023-11-24T08:06:43.091336+0000","last_fullsized":"2023-11-24T08:06:43.091336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968092+0000","last_change":"2023-11-24T08:06:41.640956+0000","last_active":"2023-11-24T08:06:43.968092+0000","last_peered":"2023-11-24T08:06:43.968092+0000","last_clean":"2023-11-24T08:06:43.968092+0000","last_became_active":"2023-11-24T08:06:41.640647+0000","last_became_peered":"2023-11-24T08:06:41.640647+0000","last_unstale":"2023-11-24T08:06:43.968092+0000","last_undegraded":"2023-11-24T08:06:43.968092+0000","last_fullsized":"2023-11-24T08:06:43.968092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:01.459437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086672+0000","last_change":"2023-11-24T08:06:42.101030+0000","last_active":"2023-11-24T08:06:43.086672+0000","last_peered":"2023-11-24T08:06:43.086672+0000","last_clean":"2023-11-24T08:06:43.086672+0000","last_became_active":"2023-11-24T08:06:42.100750+0000","last_became_peered":"2023-11-24T08:06:42.100750+0000","last_unstale":"2023-11-24T08:06:43.086672+0000","last_undegraded":"2023-11-24T08:06:43.086672+0000","last_fullsized":"2023-11-24T08:06:43.086672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086852+0000","last_change":"2023-11-24T08:06:41.639221+0000","last_active":"2023-11-24T08:06:43.086852+0000","last_peered":"2023-11-24T08:06:43.086852+0000","last_clean":"2023-11-24T08:06:43.086852+0000","last_became_active":"2023-11-24T08:06:41.638888+0000","last_became_peered":"2023-11-24T08:06:41.638888+0000","last_unstale":"2023-11-24T08:06:43.086852+0000","last_undegraded":"2023-11-24T08:06:43.086852+0000","last_fullsized":"2023-11-24T08:06:43.086852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:38.326101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966489+0000","last_change":"2023-11-24T08:06:42.123237+0000","last_active":"2023-11-24T08:06:43.966489+0000","last_peered":"2023-11-24T08:06:43.966489+0000","last_clean":"2023-11-24T08:06:43.966489+0000","last_became_active":"2023-11-24T08:06:42.122966+0000","last_became_peered":"2023-11-24T08:06:42.122966+0000","last_unstale":"2023-11-24T08:06:43.966489+0000","last_undegraded":"2023-11-24T08:06:43.966489+0000","last_fullsized":"2023-11-24T08:06:43.966489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476853+0000","last_change":"2023-11-24T08:06:41.635985+0000","last_active":"2023-11-24T08:06:43.476853+0000","last_peered":"2023-11-24T08:06:43.476853+0000","last_clean":"2023-11-24T08:06:43.476853+0000","last_became_active":"2023-11-24T08:06:41.634284+0000","last_became_peered":"2023-11-24T08:06:41.634284+0000","last_unstale":"2023-11-24T08:06:43.476853+0000","last_undegraded":"2023-11-24T08:06:43.476853+0000","last_fullsized":"2023-11-24T08:06:43.476853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963977+0000","last_change":"2023-11-24T08:06:42.104357+0000","last_active":"2023-11-24T08:06:43.963977+0000","last_peered":"2023-11-24T08:06:43.963977+0000","last_clean":"2023-11-24T08:06:43.963977+0000","last_became_active":"2023-11-24T08:06:42.103319+0000","last_became_peered":"2023-11-24T08:06:42.103319+0000","last_unstale":"2023-11-24T08:06:43.963977+0000","last_undegraded":"2023-11-24T08:06:43.963977+0000","last_fullsized":"2023-11-24T08:06:43.963977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:25.354171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966408+0000","last_change":"2023-11-24T08:06:41.635130+0000","last_active":"2023-11-24T08:06:43.966408+0000","last_peered":"2023-11-24T08:06:43.966408+0000","last_clean":"2023-11-24T08:06:43.966408+0000","last_became_active":"2023-11-24T08:06:41.634857+0000","last_became_peered":"2023-11-24T08:06:41.634857+0000","last_unstale":"2023-11-24T08:06:43.966408+0000","last_undegraded":"2023-11-24T08:06:43.966408+0000","last_fullsized":"2023-11-24T08:06:43.966408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967411+0000","last_change":"2023-11-24T08:06:42.109364+0000","last_active":"2023-11-24T08:06:43.967411+0000","last_peered":"2023-11-24T08:06:43.967411+0000","last_clean":"2023-11-24T08:06:43.967411+0000","last_became_active":"2023-11-24T08:06:42.108977+0000","last_became_peered":"2023-11-24T08:06:42.108977+0000","last_unstale":"2023-11-24T08:06:43.967411+0000","last_undegraded":"2023-11-24T08:06:43.967411+0000","last_fullsized":"2023-11-24T08:06:43.967411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086495+0000","last_change":"2023-11-24T08:06:41.630908+0000","last_active":"2023-11-24T08:06:43.086495+0000","last_peered":"2023-11-24T08:06:43.086495+0000","last_clean":"2023-11-24T08:06:43.086495+0000","last_became_active":"2023-11-24T08:06:41.630585+0000","last_became_peered":"2023-11-24T08:06:41.630585+0000","last_unstale":"2023-11-24T08:06:43.086495+0000","last_undegraded":"2023-11-24T08:06:43.086495+0000","last_fullsized":"2023-11-24T08:06:43.086495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966678+0000","last_change":"2023-11-24T08:06:42.102831+0000","last_active":"2023-11-24T08:06:43.966678+0000","last_peered":"2023-11-24T08:06:43.966678+0000","last_clean":"2023-11-24T08:06:43.966678+0000","last_became_active":"2023-11-24T08:06:42.100929+0000","last_became_peered":"2023-11-24T08:06:42.100929+0000","last_unstale":"2023-11-24T08:06:43.966678+0000","last_undegraded":"2023-11-24T08:06:43.966678+0000","last_fullsized":"2023-11-24T08:06:43.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086955+0000","last_change":"2023-11-24T08:06:41.628964+0000","last_active":"2023-11-24T08:06:43.086955+0000","last_peered":"2023-11-24T08:06:43.086955+0000","last_clean":"2023-11-24T08:06:43.086955+0000","last_became_active":"2023-11-24T08:06:41.628682+0000","last_became_peered":"2023-11-24T08:06:41.628682+0000","last_unstale":"2023-11-24T08:06:43.086955+0000","last_undegraded":"2023-11-24T08:06:43.086955+0000","last_fullsized":"2023-11-24T08:06:43.086955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966228+0000","last_change":"2023-11-24T08:06:42.108598+0000","last_active":"2023-11-24T08:06:43.966228+0000","last_peered":"2023-11-24T08:06:43.966228+0000","last_clean":"2023-11-24T08:06:43.966228+0000","last_became_active":"2023-11-24T08:06:42.107835+0000","last_became_peered":"2023-11-24T08:06:42.107835+0000","last_unstale":"2023-11-24T08:06:43.966228+0000","last_undegraded":"2023-11-24T08:06:43.966228+0000","last_fullsized":"2023-11-24T08:06:43.966228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967014+0000","last_change":"2023-11-24T08:06:41.636550+0000","last_active":"2023-11-24T08:06:43.967014+0000","last_peered":"2023-11-24T08:06:43.967014+0000","last_clean":"2023-11-24T08:06:43.967014+0000","last_became_active":"2023-11-24T08:06:41.635883+0000","last_became_peered":"2023-11-24T08:06:41.635883+0000","last_unstale":"2023-11-24T08:06:43.967014+0000","last_undegraded":"2023-11-24T08:06:43.967014+0000","last_fullsized":"2023-11-24T08:06:43.967014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476030+0000","last_change":"2023-11-24T08:06:42.120896+0000","last_active":"2023-11-24T08:06:43.476030+0000","last_peered":"2023-11-24T08:06:43.476030+0000","last_clean":"2023-11-24T08:06:43.476030+0000","last_became_active":"2023-11-24T08:06:42.120699+0000","last_became_peered":"2023-11-24T08:06:42.120699+0000","last_unstale":"2023-11-24T08:06:43.476030+0000","last_undegraded":"2023-11-24T08:06:43.476030+0000","last_fullsized":"2023-11-24T08:06:43.476030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091224+0000","last_change":"2023-11-24T08:06:42.127564+0000","last_active":"2023-11-24T08:06:43.091224+0000","last_peered":"2023-11-24T08:06:43.091224+0000","last_clean":"2023-11-24T08:06:43.091224+0000","last_became_active":"2023-11-24T08:06:42.127280+0000","last_became_peered":"2023-11-24T08:06:42.127280+0000","last_unstale":"2023-11-24T08:06:43.091224+0000","last_undegraded":"2023-11-24T08:06:43.091224+0000","last_fullsized":"2023-11-24T08:06:43.091224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967373+0000","last_change":"2023-11-24T08:06:41.640662+0000","last_active":"2023-11-24T08:06:43.967373+0000","last_peered":"2023-11-24T08:06:43.967373+0000","last_clean":"2023-11-24T08:06:43.967373+0000","last_became_active":"2023-11-24T08:06:41.640349+0000","last_became_peered":"2023-11-24T08:06:41.640349+0000","last_unstale":"2023-11-24T08:06:43.967373+0000","last_undegraded":"2023-11-24T08:06:43.967373+0000","last_fullsized":"2023-11-24T08:06:43.967373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092068+0000","last_change":"2023-11-24T08:06:42.122723+0000","last_active":"2023-11-24T08:06:43.092068+0000","last_peered":"2023-11-24T08:06:43.092068+0000","last_clean":"2023-11-24T08:06:43.092068+0000","last_became_active":"2023-11-24T08:06:42.122440+0000","last_became_peered":"2023-11-24T08:06:42.122440+0000","last_unstale":"2023-11-24T08:06:43.092068+0000","last_undegraded":"2023-11-24T08:06:43.092068+0000","last_fullsized":"2023-11-24T08:06:43.092068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967777+0000","last_change":"2023-11-24T08:06:41.643783+0000","last_active":"2023-11-24T08:06:43.967777+0000","last_peered":"2023-11-24T08:06:43.967777+0000","last_clean":"2023-11-24T08:06:43.967777+0000","last_became_active":"2023-11-24T08:06:41.643547+0000","last_became_peered":"2023-11-24T08:06:41.643547+0000","last_unstale":"2023-11-24T08:06:43.967777+0000","last_undegraded":"2023-11-24T08:06:43.967777+0000","last_fullsized":"2023-11-24T08:06:43.967777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963856+0000","last_change":"2023-11-24T08:06:42.132774+0000","last_active":"2023-11-24T08:06:43.963856+0000","last_peered":"2023-11-24T08:06:43.963856+0000","last_clean":"2023-11-24T08:06:43.963856+0000","last_became_active":"2023-11-24T08:06:42.132564+0000","last_became_peered":"2023-11-24T08:06:42.132564+0000","last_unstale":"2023-11-24T08:06:43.963856+0000","last_undegraded":"2023-11-24T08:06:43.963856+0000","last_fullsized":"2023-11-24T08:06:43.963856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:39:33.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966291+0000","last_change":"2023-11-24T08:06:41.626427+0000","last_active":"2023-11-24T08:06:43.966291+0000","last_peered":"2023-11-24T08:06:43.966291+0000","last_clean":"2023-11-24T08:06:43.966291+0000","last_became_active":"2023-11-24T08:06:41.625025+0000","last_became_peered":"2023-11-24T08:06:41.625025+0000","last_unstale":"2023-11-24T08:06:43.966291+0000","last_undegraded":"2023-11-24T08:06:43.966291+0000","last_fullsized":"2023-11-24T08:06:43.966291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966230+0000","last_change":"2023-11-24T08:06:42.122014+0000","last_active":"2023-11-24T08:06:43.966230+0000","last_peered":"2023-11-24T08:06:43.966230+0000","last_clean":"2023-11-24T08:06:43.966230+0000","last_became_active":"2023-11-24T08:06:42.121753+0000","last_became_peered":"2023-11-24T08:06:42.121753+0000","last_unstale":"2023-11-24T08:06:43.966230+0000","last_undegraded":"2023-11-24T08:06:43.966230+0000","last_fullsized":"2023-11-24T08:06:43.966230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964226+0000","last_change":"2023-11-24T08:06:41.633665+0000","last_active":"2023-11-24T08:06:43.964226+0000","last_peered":"2023-11-24T08:06:43.964226+0000","last_clean":"2023-11-24T08:06:43.964226+0000","last_became_active":"2023-11-24T08:06:41.633430+0000","last_became_peered":"2023-11-24T08:06:41.633430+0000","last_unstale":"2023-11-24T08:06:43.964226+0000","last_undegraded":"2023-11-24T08:06:43.964226+0000","last_fullsized":"2023-11-24T08:06:43.964226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:05:34.192369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":811008,"data_stored":663526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7090000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9690000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1269999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2690000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1970000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2490000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":78876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0720000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":669882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.917}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.982}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:06:47.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:06:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.258+0000 7fdcc090f640 1 Processor -- start 2023-11-24T08:06:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.258+0000 7fdcc090f640 1 -- start start 2023-11-24T08:06:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.259+0000 7fdcc090f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdcbc13e360 0x7fdcbc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.259+0000 7fdcc090f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdcbc15f9c0 0x7fdcbc0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.259+0000 7fdcc090f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc15c5f0 con 0x7fdcbc13df80 2023-11-24T08:06:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.259+0000 7fdcc090f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc06c470 con 0x7fdcbc15f9c0 2023-11-24T08:06:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.259+0000 7fdcc090f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc06c750 con 0x7fdcbc13e360 2023-11-24T08:06:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcbad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdcbc15f9c0 0x7fdcbc0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcba59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdcbc13df80 0x7fdcbc15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43426/0 (socket says 172.21.15.97:43426) 2023-11-24T08:06:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcba59c640 1 -- 172.21.15.97:0/4244528251 learned_addr learned my addr 172.21.15.97:0/4244528251 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcb1d9b640 1 --2- 172.21.15.97:0/4244528251 >> v2:172.21.15.183:3300/0 conn(0x7fdcbc13e360 0x7fdcbc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcbad9d640 1 -- 172.21.15.97:0/4244528251 >> v2:172.21.15.183:3300/0 conn(0x7fdcbc13e360 msgr2=0x7fdcbc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcbad9d640 1 --2- 172.21.15.97:0/4244528251 >> v2:172.21.15.183:3300/0 conn(0x7fdcbc13e360 0x7fdcbc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcbad9d640 1 -- 172.21.15.97:0/4244528251 >> v1:172.21.15.97:6789/0 conn(0x7fdcbc13df80 legacy=0x7fdcbc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.260+0000 7fdcbad9d640 1 -- 172.21.15.97:0/4244528251 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc06ca30 con 0x7fdcbc15f9c0 2023-11-24T08:06:47.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.261+0000 7fdcbad9d640 1 --2- 172.21.15.97:0/4244528251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc0cf7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc06ded0 tx=0x7fdcb402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3483e7e4ae097c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.261+0000 7fdcb9d9b640 1 -- 172.21.15.97:0/4244528251 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb402cc80 con 0x7fdcbc15f9c0 2023-11-24T08:06:47.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.261+0000 7fdcb9d9b640 1 -- 172.21.15.97:0/4244528251 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb402cde0 con 0x7fdcbc15f9c0 2023-11-24T08:06:47.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.261+0000 7fdcb9d9b640 1 -- 172.21.15.97:0/4244528251 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4034660 con 0x7fdcbc15f9c0 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 -- 172.21.15.97:0/4244528251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc15f9c0 msgr2=0x7fdcbc0cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 --2- 172.21.15.97:0/4244528251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc0cf7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc06ded0 tx=0x7fdcb402bed0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 -- 172.21.15.97:0/4244528251 shutdown_connections 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 --2- 172.21.15.97:0/4244528251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc0cf7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 --2- 172.21.15.97:0/4244528251 >> v2:172.21.15.183:3300/0 conn(0x7fdcbc13e360 0x7fdcbc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 -- 172.21.15.97:0/4244528251 >> 172.21.15.97:0/4244528251 conn(0x7fdcbc06a800 msgr2=0x7fdcbc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 -- 172.21.15.97:0/4244528251 shutdown_connections 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.262+0000 7fdcc090f640 1 -- 172.21.15.97:0/4244528251 wait complete. 2023-11-24T08:06:47.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.264+0000 7fdcc090f640 1 Processor -- start 2023-11-24T08:06:47.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.264+0000 7fdcc090f640 1 -- start start 2023-11-24T08:06:47.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcc090f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc13df80 0x7fdcbc0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcc090f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcbc13e360 0x7fdcbc1f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcc090f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc15a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcc090f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc152850 con 0x7fdcbc13df80 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcc090f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0a9410 con 0x7fdcbc15f9c0 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcc090f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc151bd0 con 0x7fdcbc13e360 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcba59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc13df80 0x7fdcbc0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcba59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc13df80 0x7fdcbc0a8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56896/0 (socket says 172.21.15.97:56896) 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.265+0000 7fdcba59c640 1 -- 172.21.15.97:0/850317416 learned_addr learned my addr 172.21.15.97:0/850317416 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcbad9d640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcb1d9b640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcbc13e360 0x7fdcbc1f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcba59c640 1 -- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcbc13e360 msgr2=0x7fdcbc1f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcba59c640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcbc13e360 0x7fdcbc1f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcba59c640 1 -- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcbc15f9c0 msgr2=0x7fdcbc15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcba59c640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcba59c640 1 -- 172.21.15.97:0/850317416 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009a70 con 0x7fdcbc13df80 2023-11-24T08:06:47.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcbad9d640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:47.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcba59c640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc13df80 0x7fdcbc0a8ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c400 tx=0x7fdcac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcb37fe640 1 -- 172.21.15.97:0/850317416 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac005ce0 con 0x7fdcbc13df80 2023-11-24T08:06:47.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcb37fe640 1 -- 172.21.15.97:0/850317416 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac005e40 con 0x7fdcbc13df80 2023-11-24T08:06:47.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcb37fe640 1 -- 172.21.15.97:0/850317416 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac007310 con 0x7fdcbc13df80 2023-11-24T08:06:47.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc151eb0 con 0x7fdcbc13df80 2023-11-24T08:06:47.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.266+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc152470 con 0x7fdcbc13df80 2023-11-24T08:06:47.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.268+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc0675d0 con 0x7fdcbc13df80 2023-11-24T08:06:47.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.268+0000 7fdcb37fe640 1 -- 172.21.15.97:0/850317416 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcac007470 con 0x7fdcbc13df80 2023-11-24T08:06:47.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.270+0000 7fdcb37fe640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdca006ae40 0x7fdca006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.270+0000 7fdcb37fe640 1 -- 172.21.15.97:0/850317416 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcac088b90 con 0x7fdcbc13df80 2023-11-24T08:06:47.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.270+0000 7fdcb1d9b640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdca006ae40 0x7fdca006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.270+0000 7fdcb1d9b640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdca006ae40 0x7fdca006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006fd0 tx=0x7fdca4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.274+0000 7fdcb37fe640 1 -- 172.21.15.97:0/850317416 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdcac053c30 con 0x7fdcbc13df80 2023-11-24T08:06:47.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.461+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcbc06cff0 con 0x7fdca006ae40 2023-11-24T08:06:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.481+0000 7fdcb37fe640 1 -- 172.21.15.97:0/850317416 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7fdca4009d60 con 0x7fdca006ae40 2023-11-24T08:06:47.485 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:47.488 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.487+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdca006ae40 msgr2=0x7fdca006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.487+0000 7fdcc090f640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdca006ae40 0x7fdca006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006fd0 tx=0x7fdca4008040 comp rx=0 tx=0).stop 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc13df80 msgr2=0x7fdcbc0a8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc13df80 0x7fdcbc0a8ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c400 tx=0x7fdcac00c8c0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 shutdown_connections 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdca006ae40 0x7fdca006d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcbc15f9c0 0x7fdcbc15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcbc13e360 0x7fdcbc1f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 --2- 172.21.15.97:0/850317416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcbc13df80 0x7fdcbc0a8ed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 >> 172.21.15.97:0/850317416 conn(0x7fdcbc06a800 msgr2=0x7fdcbc070880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 shutdown_connections 2023-11-24T08:06:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.488+0000 7fdcc090f640 1 -- 172.21.15.97:0/850317416 wait complete. 2023-11-24T08:06:47.509 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-24T08:06:47.267586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223476,"kb_used_data":2972,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751244,"statfs":{"total":773094113280,"available":772865273856,"internally_reserved":0,"allocated":3043328,"data_stored":1810264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001942"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967929+0000","last_change":"2023-11-24T08:06:42.136230+0000","last_active":"2023-11-24T08:06:43.967929+0000","last_peered":"2023-11-24T08:06:43.967929+0000","last_clean":"2023-11-24T08:06:43.967929+0000","last_became_active":"2023-11-24T08:06:42.133570+0000","last_became_peered":"2023-11-24T08:06:42.133570+0000","last_unstale":"2023-11-24T08:06:43.967929+0000","last_undegraded":"2023-11-24T08:06:43.967929+0000","last_fullsized":"2023-11-24T08:06:43.967929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086899+0000","last_change":"2023-11-24T08:06:42.107193+0000","last_active":"2023-11-24T08:06:43.086899+0000","last_peered":"2023-11-24T08:06:43.086899+0000","last_clean":"2023-11-24T08:06:43.086899+0000","last_became_active":"2023-11-24T08:06:42.106907+0000","last_became_peered":"2023-11-24T08:06:42.106907+0000","last_unstale":"2023-11-24T08:06:43.086899+0000","last_undegraded":"2023-11-24T08:06:43.086899+0000","last_fullsized":"2023-11-24T08:06:43.086899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963992+0000","last_change":"2023-11-24T08:06:42.108263+0000","last_active":"2023-11-24T08:06:43.963992+0000","last_peered":"2023-11-24T08:06:43.963992+0000","last_clean":"2023-11-24T08:06:43.963992+0000","last_became_active":"2023-11-24T08:06:42.107647+0000","last_became_peered":"2023-11-24T08:06:42.107647+0000","last_unstale":"2023-11-24T08:06:43.963992+0000","last_undegraded":"2023-11-24T08:06:43.963992+0000","last_fullsized":"2023-11-24T08:06:43.963992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:27.401933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091686+0000","last_change":"2023-11-24T08:06:42.122069+0000","last_active":"2023-11-24T08:06:43.091686+0000","last_peered":"2023-11-24T08:06:43.091686+0000","last_clean":"2023-11-24T08:06:43.091686+0000","last_became_active":"2023-11-24T08:06:42.121385+0000","last_became_peered":"2023-11-24T08:06:42.121385+0000","last_unstale":"2023-11-24T08:06:43.091686+0000","last_undegraded":"2023-11-24T08:06:43.091686+0000","last_fullsized":"2023-11-24T08:06:43.091686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966552+0000","last_change":"2023-11-24T08:06:42.132197+0000","last_active":"2023-11-24T08:06:43.966552+0000","last_peered":"2023-11-24T08:06:43.966552+0000","last_clean":"2023-11-24T08:06:43.966552+0000","last_became_active":"2023-11-24T08:06:42.131870+0000","last_became_peered":"2023-11-24T08:06:42.131870+0000","last_unstale":"2023-11-24T08:06:43.966552+0000","last_undegraded":"2023-11-24T08:06:43.966552+0000","last_fullsized":"2023-11-24T08:06:43.966552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091338+0000","last_change":"2023-11-24T08:06:42.125563+0000","last_active":"2023-11-24T08:06:43.091338+0000","last_peered":"2023-11-24T08:06:43.091338+0000","last_clean":"2023-11-24T08:06:43.091338+0000","last_became_active":"2023-11-24T08:06:42.125192+0000","last_became_peered":"2023-11-24T08:06:42.125192+0000","last_unstale":"2023-11-24T08:06:43.091338+0000","last_undegraded":"2023-11-24T08:06:43.091338+0000","last_fullsized":"2023-11-24T08:06:43.091338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966278+0000","last_change":"2023-11-24T08:06:42.122907+0000","last_active":"2023-11-24T08:06:43.966278+0000","last_peered":"2023-11-24T08:06:43.966278+0000","last_clean":"2023-11-24T08:06:43.966278+0000","last_became_active":"2023-11-24T08:06:42.122580+0000","last_became_peered":"2023-11-24T08:06:42.122580+0000","last_unstale":"2023-11-24T08:06:43.966278+0000","last_undegraded":"2023-11-24T08:06:43.966278+0000","last_fullsized":"2023-11-24T08:06:43.966278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966567+0000","last_change":"2023-11-24T08:06:42.121885+0000","last_active":"2023-11-24T08:06:43.966567+0000","last_peered":"2023-11-24T08:06:43.966567+0000","last_clean":"2023-11-24T08:06:43.966567+0000","last_became_active":"2023-11-24T08:06:42.121567+0000","last_became_peered":"2023-11-24T08:06:42.121567+0000","last_unstale":"2023-11-24T08:06:43.966567+0000","last_undegraded":"2023-11-24T08:06:43.966567+0000","last_fullsized":"2023-11-24T08:06:43.966567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968008+0000","last_change":"2023-11-24T08:06:42.136825+0000","last_active":"2023-11-24T08:06:43.968008+0000","last_peered":"2023-11-24T08:06:43.968008+0000","last_clean":"2023-11-24T08:06:43.968008+0000","last_became_active":"2023-11-24T08:06:42.136570+0000","last_became_peered":"2023-11-24T08:06:42.136570+0000","last_unstale":"2023-11-24T08:06:43.968008+0000","last_undegraded":"2023-11-24T08:06:43.968008+0000","last_fullsized":"2023-11-24T08:06:43.968008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476754+0000","last_change":"2023-11-24T08:06:42.133333+0000","last_active":"2023-11-24T08:06:43.476754+0000","last_peered":"2023-11-24T08:06:43.476754+0000","last_clean":"2023-11-24T08:06:43.476754+0000","last_became_active":"2023-11-24T08:06:42.133051+0000","last_became_peered":"2023-11-24T08:06:42.133051+0000","last_unstale":"2023-11-24T08:06:43.476754+0000","last_undegraded":"2023-11-24T08:06:43.476754+0000","last_fullsized":"2023-11-24T08:06:43.476754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476581+0000","last_change":"2023-11-24T08:06:42.130796+0000","last_active":"2023-11-24T08:06:43.476581+0000","last_peered":"2023-11-24T08:06:43.476581+0000","last_clean":"2023-11-24T08:06:43.476581+0000","last_became_active":"2023-11-24T08:06:42.130502+0000","last_became_peered":"2023-11-24T08:06:42.130502+0000","last_unstale":"2023-11-24T08:06:43.476581+0000","last_undegraded":"2023-11-24T08:06:43.476581+0000","last_fullsized":"2023-11-24T08:06:43.476581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966612+0000","last_change":"2023-11-24T08:06:42.126261+0000","last_active":"2023-11-24T08:06:43.966612+0000","last_peered":"2023-11-24T08:06:43.966612+0000","last_clean":"2023-11-24T08:06:43.966612+0000","last_became_active":"2023-11-24T08:06:42.125771+0000","last_became_peered":"2023-11-24T08:06:42.125771+0000","last_unstale":"2023-11-24T08:06:43.966612+0000","last_undegraded":"2023-11-24T08:06:43.966612+0000","last_fullsized":"2023-11-24T08:06:43.966612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:16.965524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966004+0000","last_change":"2023-11-24T08:06:42.122706+0000","last_active":"2023-11-24T08:06:43.966004+0000","last_peered":"2023-11-24T08:06:43.966004+0000","last_clean":"2023-11-24T08:06:43.966004+0000","last_became_active":"2023-11-24T08:06:42.122378+0000","last_became_peered":"2023-11-24T08:06:42.122378+0000","last_unstale":"2023-11-24T08:06:43.966004+0000","last_undegraded":"2023-11-24T08:06:43.966004+0000","last_fullsized":"2023-11-24T08:06:43.966004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963516+0000","last_change":"2023-11-24T08:06:42.106916+0000","last_active":"2023-11-24T08:06:43.963516+0000","last_peered":"2023-11-24T08:06:43.963516+0000","last_clean":"2023-11-24T08:06:43.963516+0000","last_became_active":"2023-11-24T08:06:42.106633+0000","last_became_peered":"2023-11-24T08:06:42.106633+0000","last_unstale":"2023-11-24T08:06:43.963516+0000","last_undegraded":"2023-11-24T08:06:43.963516+0000","last_fullsized":"2023-11-24T08:06:43.963516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:48:07.993924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086431+0000","last_change":"2023-11-24T08:06:42.099238+0000","last_active":"2023-11-24T08:06:43.086431+0000","last_peered":"2023-11-24T08:06:43.086431+0000","last_clean":"2023-11-24T08:06:43.086431+0000","last_became_active":"2023-11-24T08:06:42.098972+0000","last_became_peered":"2023-11-24T08:06:42.098972+0000","last_unstale":"2023-11-24T08:06:43.086431+0000","last_undegraded":"2023-11-24T08:06:43.086431+0000","last_fullsized":"2023-11-24T08:06:43.086431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090638+0000","last_change":"2023-11-24T08:06:42.127641+0000","last_active":"2023-11-24T08:06:43.090638+0000","last_peered":"2023-11-24T08:06:43.090638+0000","last_clean":"2023-11-24T08:06:43.090638+0000","last_became_active":"2023-11-24T08:06:42.127276+0000","last_became_peered":"2023-11-24T08:06:42.127276+0000","last_unstale":"2023-11-24T08:06:43.090638+0000","last_undegraded":"2023-11-24T08:06:43.090638+0000","last_fullsized":"2023-11-24T08:06:43.090638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092315+0000","last_change":"2023-11-24T08:06:42.129079+0000","last_active":"2023-11-24T08:06:43.092315+0000","last_peered":"2023-11-24T08:06:43.092315+0000","last_clean":"2023-11-24T08:06:43.092315+0000","last_became_active":"2023-11-24T08:06:42.128796+0000","last_became_peered":"2023-11-24T08:06:42.128796+0000","last_unstale":"2023-11-24T08:06:43.092315+0000","last_undegraded":"2023-11-24T08:06:43.092315+0000","last_fullsized":"2023-11-24T08:06:43.092315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346604+0000","last_change":"2023-11-24T08:06:42.122648+0000","last_active":"2023-11-24T08:06:43.346604+0000","last_peered":"2023-11-24T08:06:43.346604+0000","last_clean":"2023-11-24T08:06:43.346604+0000","last_became_active":"2023-11-24T08:06:42.122184+0000","last_became_peered":"2023-11-24T08:06:42.122184+0000","last_unstale":"2023-11-24T08:06:43.346604+0000","last_undegraded":"2023-11-24T08:06:43.346604+0000","last_fullsized":"2023-11-24T08:06:43.346604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:47.554125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968216+0000","last_change":"2023-11-24T08:06:42.136398+0000","last_active":"2023-11-24T08:06:43.968216+0000","last_peered":"2023-11-24T08:06:43.968216+0000","last_clean":"2023-11-24T08:06:43.968216+0000","last_became_active":"2023-11-24T08:06:42.133633+0000","last_became_peered":"2023-11-24T08:06:42.133633+0000","last_unstale":"2023-11-24T08:06:43.968216+0000","last_undegraded":"2023-11-24T08:06:43.968216+0000","last_fullsized":"2023-11-24T08:06:43.968216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:45:50.299537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476680+0000","last_change":"2023-11-24T08:06:42.134200+0000","last_active":"2023-11-24T08:06:43.476680+0000","last_peered":"2023-11-24T08:06:43.476680+0000","last_clean":"2023-11-24T08:06:43.476680+0000","last_became_active":"2023-11-24T08:06:42.133905+0000","last_became_peered":"2023-11-24T08:06:42.133905+0000","last_unstale":"2023-11-24T08:06:43.476680+0000","last_undegraded":"2023-11-24T08:06:43.476680+0000","last_fullsized":"2023-11-24T08:06:43.476680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963640+0000","last_change":"2023-11-24T08:06:42.117257+0000","last_active":"2023-11-24T08:06:43.963640+0000","last_peered":"2023-11-24T08:06:43.963640+0000","last_clean":"2023-11-24T08:06:43.963640+0000","last_became_active":"2023-11-24T08:06:42.116917+0000","last_became_peered":"2023-11-24T08:06:42.116917+0000","last_unstale":"2023-11-24T08:06:43.963640+0000","last_undegraded":"2023-11-24T08:06:43.963640+0000","last_fullsized":"2023-11-24T08:06:43.963640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:56.791724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091695+0000","last_change":"2023-11-24T08:06:42.136875+0000","last_active":"2023-11-24T08:06:43.091695+0000","last_peered":"2023-11-24T08:06:43.091695+0000","last_clean":"2023-11-24T08:06:43.091695+0000","last_became_active":"2023-11-24T08:06:42.136572+0000","last_became_peered":"2023-11-24T08:06:42.136572+0000","last_unstale":"2023-11-24T08:06:43.091695+0000","last_undegraded":"2023-11-24T08:06:43.091695+0000","last_fullsized":"2023-11-24T08:06:43.091695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.120702+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.120446+0000","last_became_peered":"2023-11-24T08:06:42.120446+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:06.281138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090758+0000","last_change":"2023-11-24T08:06:42.117026+0000","last_active":"2023-11-24T08:06:43.090758+0000","last_peered":"2023-11-24T08:06:43.090758+0000","last_clean":"2023-11-24T08:06:43.090758+0000","last_became_active":"2023-11-24T08:06:42.115990+0000","last_became_peered":"2023-11-24T08:06:42.115990+0000","last_unstale":"2023-11-24T08:06:43.090758+0000","last_undegraded":"2023-11-24T08:06:43.090758+0000","last_fullsized":"2023-11-24T08:06:43.090758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966398+0000","last_change":"2023-11-24T08:06:42.107007+0000","last_active":"2023-11-24T08:06:43.966398+0000","last_peered":"2023-11-24T08:06:43.966398+0000","last_clean":"2023-11-24T08:06:43.966398+0000","last_became_active":"2023-11-24T08:06:42.103402+0000","last_became_peered":"2023-11-24T08:06:42.103402+0000","last_unstale":"2023-11-24T08:06:43.966398+0000","last_undegraded":"2023-11-24T08:06:43.966398+0000","last_fullsized":"2023-11-24T08:06:43.966398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476753+0000","last_change":"2023-11-24T08:06:42.126780+0000","last_active":"2023-11-24T08:06:43.476753+0000","last_peered":"2023-11-24T08:06:43.476753+0000","last_clean":"2023-11-24T08:06:43.476753+0000","last_became_active":"2023-11-24T08:06:42.126540+0000","last_became_peered":"2023-11-24T08:06:42.126540+0000","last_unstale":"2023-11-24T08:06:43.476753+0000","last_undegraded":"2023-11-24T08:06:43.476753+0000","last_fullsized":"2023-11-24T08:06:43.476753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086799+0000","last_change":"2023-11-24T08:06:42.100776+0000","last_active":"2023-11-24T08:06:43.086799+0000","last_peered":"2023-11-24T08:06:43.086799+0000","last_clean":"2023-11-24T08:06:43.086799+0000","last_became_active":"2023-11-24T08:06:42.098840+0000","last_became_peered":"2023-11-24T08:06:42.098840+0000","last_unstale":"2023-11-24T08:06:43.086799+0000","last_undegraded":"2023-11-24T08:06:43.086799+0000","last_fullsized":"2023-11-24T08:06:43.086799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966796+0000","last_change":"2023-11-24T08:06:42.114236+0000","last_active":"2023-11-24T08:06:43.966796+0000","last_peered":"2023-11-24T08:06:43.966796+0000","last_clean":"2023-11-24T08:06:43.966796+0000","last_became_active":"2023-11-24T08:06:42.113925+0000","last_became_peered":"2023-11-24T08:06:42.113925+0000","last_unstale":"2023-11-24T08:06:43.966796+0000","last_undegraded":"2023-11-24T08:06:43.966796+0000","last_fullsized":"2023-11-24T08:06:43.966796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964102+0000","last_change":"2023-11-24T08:06:42.110806+0000","last_active":"2023-11-24T08:06:43.964102+0000","last_peered":"2023-11-24T08:06:43.964102+0000","last_clean":"2023-11-24T08:06:43.964102+0000","last_became_active":"2023-11-24T08:06:42.110398+0000","last_became_peered":"2023-11-24T08:06:42.110398+0000","last_unstale":"2023-11-24T08:06:43.964102+0000","last_undegraded":"2023-11-24T08:06:43.964102+0000","last_fullsized":"2023-11-24T08:06:43.964102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:11.994031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092483+0000","last_change":"2023-11-24T08:06:42.119038+0000","last_active":"2023-11-24T08:06:43.092483+0000","last_peered":"2023-11-24T08:06:43.092483+0000","last_clean":"2023-11-24T08:06:43.092483+0000","last_became_active":"2023-11-24T08:06:42.116791+0000","last_became_peered":"2023-11-24T08:06:42.116791+0000","last_unstale":"2023-11-24T08:06:43.092483+0000","last_undegraded":"2023-11-24T08:06:43.092483+0000","last_fullsized":"2023-11-24T08:06:43.092483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346553+0000","last_change":"2023-11-24T08:06:42.118075+0000","last_active":"2023-11-24T08:06:43.346553+0000","last_peered":"2023-11-24T08:06:43.346553+0000","last_clean":"2023-11-24T08:06:43.346553+0000","last_became_active":"2023-11-24T08:06:42.117879+0000","last_became_peered":"2023-11-24T08:06:42.117879+0000","last_unstale":"2023-11-24T08:06:43.346553+0000","last_undegraded":"2023-11-24T08:06:43.346553+0000","last_fullsized":"2023-11-24T08:06:43.346553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475999+0000","last_change":"2023-11-24T08:06:42.118534+0000","last_active":"2023-11-24T08:06:43.475999+0000","last_peered":"2023-11-24T08:06:43.475999+0000","last_clean":"2023-11-24T08:06:43.475999+0000","last_became_active":"2023-11-24T08:06:42.118081+0000","last_became_peered":"2023-11-24T08:06:42.118081+0000","last_unstale":"2023-11-24T08:06:43.475999+0000","last_undegraded":"2023-11-24T08:06:43.475999+0000","last_fullsized":"2023-11-24T08:06:43.475999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966118+0000","last_change":"2023-11-24T08:06:42.105896+0000","last_active":"2023-11-24T08:06:43.966118+0000","last_peered":"2023-11-24T08:06:43.966118+0000","last_clean":"2023-11-24T08:06:43.966118+0000","last_became_active":"2023-11-24T08:06:42.105293+0000","last_became_peered":"2023-11-24T08:06:42.105293+0000","last_unstale":"2023-11-24T08:06:43.966118+0000","last_undegraded":"2023-11-24T08:06:43.966118+0000","last_fullsized":"2023-11-24T08:06:43.966118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:10.645249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966071+0000","last_change":"2023-11-24T08:06:41.631971+0000","last_active":"2023-11-24T08:06:43.966071+0000","last_peered":"2023-11-24T08:06:43.966071+0000","last_clean":"2023-11-24T08:06:43.966071+0000","last_became_active":"2023-11-24T08:06:41.631383+0000","last_became_peered":"2023-11-24T08:06:41.631383+0000","last_unstale":"2023-11-24T08:06:43.966071+0000","last_undegraded":"2023-11-24T08:06:43.966071+0000","last_fullsized":"2023-11-24T08:06:43.966071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963857+0000","last_change":"2023-11-24T08:06:42.118716+0000","last_active":"2023-11-24T08:06:43.963857+0000","last_peered":"2023-11-24T08:06:43.963857+0000","last_clean":"2023-11-24T08:06:43.963857+0000","last_became_active":"2023-11-24T08:06:42.118356+0000","last_became_peered":"2023-11-24T08:06:42.118356+0000","last_unstale":"2023-11-24T08:06:43.963857+0000","last_undegraded":"2023-11-24T08:06:43.963857+0000","last_fullsized":"2023-11-24T08:06:43.963857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:29:52.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475919+0000","last_change":"2023-11-24T08:06:41.639457+0000","last_active":"2023-11-24T08:06:43.475919+0000","last_peered":"2023-11-24T08:06:43.475919+0000","last_clean":"2023-11-24T08:06:43.475919+0000","last_became_active":"2023-11-24T08:06:41.638910+0000","last_became_peered":"2023-11-24T08:06:41.638910+0000","last_unstale":"2023-11-24T08:06:43.475919+0000","last_undegraded":"2023-11-24T08:06:43.475919+0000","last_fullsized":"2023-11-24T08:06:43.475919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965906+0000","last_change":"2023-11-24T08:06:41.639144+0000","last_active":"2023-11-24T08:06:43.965906+0000","last_peered":"2023-11-24T08:06:43.965906+0000","last_clean":"2023-11-24T08:06:43.965906+0000","last_became_active":"2023-11-24T08:06:41.638849+0000","last_became_peered":"2023-11-24T08:06:41.638849+0000","last_unstale":"2023-11-24T08:06:43.965906+0000","last_undegraded":"2023-11-24T08:06:43.965906+0000","last_fullsized":"2023-11-24T08:06:43.965906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966325+0000","last_change":"2023-11-24T08:06:42.107129+0000","last_active":"2023-11-24T08:06:43.966325+0000","last_peered":"2023-11-24T08:06:43.966325+0000","last_clean":"2023-11-24T08:06:43.966325+0000","last_became_active":"2023-11-24T08:06:42.106875+0000","last_became_peered":"2023-11-24T08:06:42.106875+0000","last_unstale":"2023-11-24T08:06:43.966325+0000","last_undegraded":"2023-11-24T08:06:43.966325+0000","last_fullsized":"2023-11-24T08:06:43.966325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090871+0000","last_change":"2023-11-24T08:06:41.643162+0000","last_active":"2023-11-24T08:06:43.090871+0000","last_peered":"2023-11-24T08:06:43.090871+0000","last_clean":"2023-11-24T08:06:43.090871+0000","last_became_active":"2023-11-24T08:06:41.642111+0000","last_became_peered":"2023-11-24T08:06:41.642111+0000","last_unstale":"2023-11-24T08:06:43.090871+0000","last_undegraded":"2023-11-24T08:06:43.090871+0000","last_fullsized":"2023-11-24T08:06:43.090871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086444+0000","last_change":"2023-11-24T08:06:42.102972+0000","last_active":"2023-11-24T08:06:43.086444+0000","last_peered":"2023-11-24T08:06:43.086444+0000","last_clean":"2023-11-24T08:06:43.086444+0000","last_became_active":"2023-11-24T08:06:42.102488+0000","last_became_peered":"2023-11-24T08:06:42.102488+0000","last_unstale":"2023-11-24T08:06:43.086444+0000","last_undegraded":"2023-11-24T08:06:43.086444+0000","last_fullsized":"2023-11-24T08:06:43.086444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476748+0000","last_change":"2023-11-24T08:06:41.644502+0000","last_active":"2023-11-24T08:06:43.476748+0000","last_peered":"2023-11-24T08:06:43.476748+0000","last_clean":"2023-11-24T08:06:43.476748+0000","last_became_active":"2023-11-24T08:06:41.644195+0000","last_became_peered":"2023-11-24T08:06:41.644195+0000","last_unstale":"2023-11-24T08:06:43.476748+0000","last_undegraded":"2023-11-24T08:06:43.476748+0000","last_fullsized":"2023-11-24T08:06:43.476748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091370+0000","last_change":"2023-11-24T08:06:42.128953+0000","last_active":"2023-11-24T08:06:43.091370+0000","last_peered":"2023-11-24T08:06:43.091370+0000","last_clean":"2023-11-24T08:06:43.091370+0000","last_became_active":"2023-11-24T08:06:42.128626+0000","last_became_peered":"2023-11-24T08:06:42.128626+0000","last_unstale":"2023-11-24T08:06:43.091370+0000","last_undegraded":"2023-11-24T08:06:43.091370+0000","last_fullsized":"2023-11-24T08:06:43.091370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091492+0000","last_change":"2023-11-24T08:06:41.640464+0000","last_active":"2023-11-24T08:06:43.091492+0000","last_peered":"2023-11-24T08:06:43.091492+0000","last_clean":"2023-11-24T08:06:43.091492+0000","last_became_active":"2023-11-24T08:06:41.640192+0000","last_became_peered":"2023-11-24T08:06:41.640192+0000","last_unstale":"2023-11-24T08:06:43.091492+0000","last_undegraded":"2023-11-24T08:06:43.091492+0000","last_fullsized":"2023-11-24T08:06:43.091492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:40.469927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963979+0000","last_change":"2023-11-24T08:06:42.132751+0000","last_active":"2023-11-24T08:06:43.963979+0000","last_peered":"2023-11-24T08:06:43.963979+0000","last_clean":"2023-11-24T08:06:43.963979+0000","last_became_active":"2023-11-24T08:06:42.132521+0000","last_became_peered":"2023-11-24T08:06:42.132521+0000","last_unstale":"2023-11-24T08:06:43.963979+0000","last_undegraded":"2023-11-24T08:06:43.963979+0000","last_fullsized":"2023-11-24T08:06:43.963979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:57.695423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086753+0000","last_change":"2023-11-24T08:06:41.639732+0000","last_active":"2023-11-24T08:06:43.086753+0000","last_peered":"2023-11-24T08:06:43.086753+0000","last_clean":"2023-11-24T08:06:43.086753+0000","last_became_active":"2023-11-24T08:06:41.639425+0000","last_became_peered":"2023-11-24T08:06:41.639425+0000","last_unstale":"2023-11-24T08:06:43.086753+0000","last_undegraded":"2023-11-24T08:06:43.086753+0000","last_fullsized":"2023-11-24T08:06:43.086753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966735+0000","last_change":"2023-11-24T08:06:42.128585+0000","last_active":"2023-11-24T08:06:43.966735+0000","last_peered":"2023-11-24T08:06:43.966735+0000","last_clean":"2023-11-24T08:06:43.966735+0000","last_became_active":"2023-11-24T08:06:42.125584+0000","last_became_peered":"2023-11-24T08:06:42.125584+0000","last_unstale":"2023-11-24T08:06:43.966735+0000","last_undegraded":"2023-11-24T08:06:43.966735+0000","last_fullsized":"2023-11-24T08:06:43.966735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:49.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476560+0000","last_change":"2023-11-24T08:06:41.633239+0000","last_active":"2023-11-24T08:06:43.476560+0000","last_peered":"2023-11-24T08:06:43.476560+0000","last_clean":"2023-11-24T08:06:43.476560+0000","last_became_active":"2023-11-24T08:06:41.632918+0000","last_became_peered":"2023-11-24T08:06:41.632918+0000","last_unstale":"2023-11-24T08:06:43.476560+0000","last_undegraded":"2023-11-24T08:06:43.476560+0000","last_fullsized":"2023-11-24T08:06:43.476560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:46.220387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967524+0000","last_change":"2023-11-24T08:06:42.132872+0000","last_active":"2023-11-24T08:06:43.967524+0000","last_peered":"2023-11-24T08:06:43.967524+0000","last_clean":"2023-11-24T08:06:43.967524+0000","last_became_active":"2023-11-24T08:06:42.124186+0000","last_became_peered":"2023-11-24T08:06:42.124186+0000","last_unstale":"2023-11-24T08:06:43.967524+0000","last_undegraded":"2023-11-24T08:06:43.967524+0000","last_fullsized":"2023-11-24T08:06:43.967524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963962+0000","last_change":"2023-11-24T08:06:41.628869+0000","last_active":"2023-11-24T08:06:43.963962+0000","last_peered":"2023-11-24T08:06:43.963962+0000","last_clean":"2023-11-24T08:06:43.963962+0000","last_became_active":"2023-11-24T08:06:41.628535+0000","last_became_peered":"2023-11-24T08:06:41.628535+0000","last_unstale":"2023-11-24T08:06:43.963962+0000","last_undegraded":"2023-11-24T08:06:43.963962+0000","last_fullsized":"2023-11-24T08:06:43.963962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:03:24.083142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963641+0000","last_change":"2023-11-24T08:06:42.124842+0000","last_active":"2023-11-24T08:06:43.963641+0000","last_peered":"2023-11-24T08:06:43.963641+0000","last_clean":"2023-11-24T08:06:43.963641+0000","last_became_active":"2023-11-24T08:06:42.124506+0000","last_became_peered":"2023-11-24T08:06:42.124506+0000","last_unstale":"2023-11-24T08:06:43.963641+0000","last_undegraded":"2023-11-24T08:06:43.963641+0000","last_fullsized":"2023-11-24T08:06:43.963641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:39.047223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092249+0000","last_change":"2023-11-24T08:06:41.643552+0000","last_active":"2023-11-24T08:06:43.092249+0000","last_peered":"2023-11-24T08:06:43.092249+0000","last_clean":"2023-11-24T08:06:43.092249+0000","last_became_active":"2023-11-24T08:06:41.641818+0000","last_became_peered":"2023-11-24T08:06:41.641818+0000","last_unstale":"2023-11-24T08:06:43.092249+0000","last_undegraded":"2023-11-24T08:06:43.092249+0000","last_fullsized":"2023-11-24T08:06:43.092249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:01.271650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966965+0000","last_change":"2023-11-24T08:06:42.132641+0000","last_active":"2023-11-24T08:06:43.966965+0000","last_peered":"2023-11-24T08:06:43.966965+0000","last_clean":"2023-11-24T08:06:43.966965+0000","last_became_active":"2023-11-24T08:06:42.132319+0000","last_became_peered":"2023-11-24T08:06:42.132319+0000","last_unstale":"2023-11-24T08:06:43.966965+0000","last_undegraded":"2023-11-24T08:06:43.966965+0000","last_fullsized":"2023-11-24T08:06:43.966965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475880+0000","last_change":"2023-11-24T08:06:41.639310+0000","last_active":"2023-11-24T08:06:43.475880+0000","last_peered":"2023-11-24T08:06:43.475880+0000","last_clean":"2023-11-24T08:06:43.475880+0000","last_became_active":"2023-11-24T08:06:41.638938+0000","last_became_peered":"2023-11-24T08:06:41.638938+0000","last_unstale":"2023-11-24T08:06:43.475880+0000","last_undegraded":"2023-11-24T08:06:43.475880+0000","last_fullsized":"2023-11-24T08:06:43.475880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476046+0000","last_change":"2023-11-24T08:06:42.109812+0000","last_active":"2023-11-24T08:06:43.476046+0000","last_peered":"2023-11-24T08:06:43.476046+0000","last_clean":"2023-11-24T08:06:43.476046+0000","last_became_active":"2023-11-24T08:06:42.109207+0000","last_became_peered":"2023-11-24T08:06:42.109207+0000","last_unstale":"2023-11-24T08:06:43.476046+0000","last_undegraded":"2023-11-24T08:06:43.476046+0000","last_fullsized":"2023-11-24T08:06:43.476046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346250+0000","last_change":"2023-11-24T08:06:41.632992+0000","last_active":"2023-11-24T08:06:43.346250+0000","last_peered":"2023-11-24T08:06:43.346250+0000","last_clean":"2023-11-24T08:06:43.346250+0000","last_became_active":"2023-11-24T08:06:41.632700+0000","last_became_peered":"2023-11-24T08:06:41.632700+0000","last_unstale":"2023-11-24T08:06:43.346250+0000","last_undegraded":"2023-11-24T08:06:43.346250+0000","last_fullsized":"2023-11-24T08:06:43.346250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:12.440430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966636+0000","last_change":"2023-11-24T08:06:42.132583+0000","last_active":"2023-11-24T08:06:43.966636+0000","last_peered":"2023-11-24T08:06:43.966636+0000","last_clean":"2023-11-24T08:06:43.966636+0000","last_became_active":"2023-11-24T08:06:42.132277+0000","last_became_peered":"2023-11-24T08:06:42.132277+0000","last_unstale":"2023-11-24T08:06:43.966636+0000","last_undegraded":"2023-11-24T08:06:43.966636+0000","last_fullsized":"2023-11-24T08:06:43.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967404+0000","last_change":"2023-11-24T08:06:41.625650+0000","last_active":"2023-11-24T08:06:43.967404+0000","last_peered":"2023-11-24T08:06:43.967404+0000","last_clean":"2023-11-24T08:06:43.967404+0000","last_became_active":"2023-11-24T08:06:41.625353+0000","last_became_peered":"2023-11-24T08:06:41.625353+0000","last_unstale":"2023-11-24T08:06:43.967404+0000","last_undegraded":"2023-11-24T08:06:43.967404+0000","last_fullsized":"2023-11-24T08:06:43.967404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:18:14.524913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966991+0000","last_change":"2023-11-24T08:06:42.134924+0000","last_active":"2023-11-24T08:06:43.966991+0000","last_peered":"2023-11-24T08:06:43.966991+0000","last_clean":"2023-11-24T08:06:43.966991+0000","last_became_active":"2023-11-24T08:06:42.134575+0000","last_became_peered":"2023-11-24T08:06:42.134575+0000","last_unstale":"2023-11-24T08:06:43.966991+0000","last_undegraded":"2023-11-24T08:06:43.966991+0000","last_fullsized":"2023-11-24T08:06:43.966991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346717+0000","last_change":"2023-11-24T08:06:41.629479+0000","last_active":"2023-11-24T08:06:43.346717+0000","last_peered":"2023-11-24T08:06:43.346717+0000","last_clean":"2023-11-24T08:06:43.346717+0000","last_became_active":"2023-11-24T08:06:41.629108+0000","last_became_peered":"2023-11-24T08:06:41.629108+0000","last_unstale":"2023-11-24T08:06:43.346717+0000","last_undegraded":"2023-11-24T08:06:43.346717+0000","last_fullsized":"2023-11-24T08:06:43.346717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:15.631786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968280+0000","last_change":"2023-11-24T08:06:42.135144+0000","last_active":"2023-11-24T08:06:43.968280+0000","last_peered":"2023-11-24T08:06:43.968280+0000","last_clean":"2023-11-24T08:06:43.968280+0000","last_became_active":"2023-11-24T08:06:42.134822+0000","last_became_peered":"2023-11-24T08:06:42.134822+0000","last_unstale":"2023-11-24T08:06:43.968280+0000","last_undegraded":"2023-11-24T08:06:43.968280+0000","last_fullsized":"2023-11-24T08:06:43.968280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:07.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086868+0000","last_change":"2023-11-24T08:06:41.628750+0000","last_active":"2023-11-24T08:06:43.086868+0000","last_peered":"2023-11-24T08:06:43.086868+0000","last_clean":"2023-11-24T08:06:43.086868+0000","last_became_active":"2023-11-24T08:06:41.628251+0000","last_became_peered":"2023-11-24T08:06:41.628251+0000","last_unstale":"2023-11-24T08:06:43.086868+0000","last_undegraded":"2023-11-24T08:06:43.086868+0000","last_fullsized":"2023-11-24T08:06:43.086868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092304+0000","last_change":"2023-11-24T08:06:42.120468+0000","last_active":"2023-11-24T08:06:43.092304+0000","last_peered":"2023-11-24T08:06:43.092304+0000","last_clean":"2023-11-24T08:06:43.092304+0000","last_became_active":"2023-11-24T08:06:42.116425+0000","last_became_peered":"2023-11-24T08:06:42.116425+0000","last_unstale":"2023-11-24T08:06:43.092304+0000","last_undegraded":"2023-11-24T08:06:43.092304+0000","last_fullsized":"2023-11-24T08:06:43.092304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346545+0000","last_change":"2023-11-24T08:06:41.644211+0000","last_active":"2023-11-24T08:06:43.346545+0000","last_peered":"2023-11-24T08:06:43.346545+0000","last_clean":"2023-11-24T08:06:43.346545+0000","last_became_active":"2023-11-24T08:06:41.643571+0000","last_became_peered":"2023-11-24T08:06:41.643571+0000","last_unstale":"2023-11-24T08:06:43.346545+0000","last_undegraded":"2023-11-24T08:06:43.346545+0000","last_fullsized":"2023-11-24T08:06:43.346545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:26.632317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967813+0000","last_change":"2023-11-24T08:06:42.134167+0000","last_active":"2023-11-24T08:06:43.967813+0000","last_peered":"2023-11-24T08:06:43.967813+0000","last_clean":"2023-11-24T08:06:43.967813+0000","last_became_active":"2023-11-24T08:06:42.133214+0000","last_became_peered":"2023-11-24T08:06:42.133214+0000","last_unstale":"2023-11-24T08:06:43.967813+0000","last_undegraded":"2023-11-24T08:06:43.967813+0000","last_fullsized":"2023-11-24T08:06:43.967813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:06:42.117866+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:06:42.117866+0000","last_peered":"2023-11-24T08:06:42.117866+0000","last_clean":"2023-11-24T08:06:42.117866+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:06:42.117866+0000","last_undegraded":"2023-11-24T08:06:42.117866+0000","last_fullsized":"2023-11-24T08:06:42.117866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090597+0000","last_change":"2023-11-24T08:06:41.643269+0000","last_active":"2023-11-24T08:06:43.090597+0000","last_peered":"2023-11-24T08:06:43.090597+0000","last_clean":"2023-11-24T08:06:43.090597+0000","last_became_active":"2023-11-24T08:06:41.642053+0000","last_became_peered":"2023-11-24T08:06:41.642053+0000","last_unstale":"2023-11-24T08:06:43.090597+0000","last_undegraded":"2023-11-24T08:06:43.090597+0000","last_fullsized":"2023-11-24T08:06:43.090597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:26.168539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.127685+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.127439+0000","last_became_peered":"2023-11-24T08:06:42.127439+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965579+0000","last_change":"2023-11-24T08:06:41.633662+0000","last_active":"2023-11-24T08:06:43.965579+0000","last_peered":"2023-11-24T08:06:43.965579+0000","last_clean":"2023-11-24T08:06:43.965579+0000","last_became_active":"2023-11-24T08:06:41.633379+0000","last_became_peered":"2023-11-24T08:06:41.633379+0000","last_unstale":"2023-11-24T08:06:43.965579+0000","last_undegraded":"2023-11-24T08:06:43.965579+0000","last_fullsized":"2023-11-24T08:06:43.965579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963412+0000","last_change":"2023-11-24T08:06:42.115320+0000","last_active":"2023-11-24T08:06:43.963412+0000","last_peered":"2023-11-24T08:06:43.963412+0000","last_clean":"2023-11-24T08:06:43.963412+0000","last_became_active":"2023-11-24T08:06:42.115112+0000","last_became_peered":"2023-11-24T08:06:42.115112+0000","last_unstale":"2023-11-24T08:06:43.963412+0000","last_undegraded":"2023-11-24T08:06:43.963412+0000","last_fullsized":"2023-11-24T08:06:43.963412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:57:01.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346517+0000","last_change":"2023-11-24T08:06:41.626881+0000","last_active":"2023-11-24T08:06:43.346517+0000","last_peered":"2023-11-24T08:06:43.346517+0000","last_clean":"2023-11-24T08:06:43.346517+0000","last_became_active":"2023-11-24T08:06:41.626584+0000","last_became_peered":"2023-11-24T08:06:41.626584+0000","last_unstale":"2023-11-24T08:06:43.346517+0000","last_undegraded":"2023-11-24T08:06:43.346517+0000","last_fullsized":"2023-11-24T08:06:43.346517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086532+0000","last_change":"2023-11-24T08:06:42.098608+0000","last_active":"2023-11-24T08:06:43.086532+0000","last_peered":"2023-11-24T08:06:43.086532+0000","last_clean":"2023-11-24T08:06:43.086532+0000","last_became_active":"2023-11-24T08:06:42.097283+0000","last_became_peered":"2023-11-24T08:06:42.097283+0000","last_unstale":"2023-11-24T08:06:43.086532+0000","last_undegraded":"2023-11-24T08:06:43.086532+0000","last_fullsized":"2023-11-24T08:06:43.086532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092482+0000","last_change":"2023-11-24T08:06:41.642174+0000","last_active":"2023-11-24T08:06:43.092482+0000","last_peered":"2023-11-24T08:06:43.092482+0000","last_clean":"2023-11-24T08:06:43.092482+0000","last_became_active":"2023-11-24T08:06:41.639506+0000","last_became_peered":"2023-11-24T08:06:41.639506+0000","last_unstale":"2023-11-24T08:06:43.092482+0000","last_undegraded":"2023-11-24T08:06:43.092482+0000","last_fullsized":"2023-11-24T08:06:43.092482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:25.898898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966317+0000","last_change":"2023-11-24T08:06:42.113349+0000","last_active":"2023-11-24T08:06:43.966317+0000","last_peered":"2023-11-24T08:06:43.966317+0000","last_clean":"2023-11-24T08:06:43.966317+0000","last_became_active":"2023-11-24T08:06:42.112363+0000","last_became_peered":"2023-11-24T08:06:42.112363+0000","last_unstale":"2023-11-24T08:06:43.966317+0000","last_undegraded":"2023-11-24T08:06:43.966317+0000","last_fullsized":"2023-11-24T08:06:43.966317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:39.659839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086651+0000","last_change":"2023-11-24T08:06:41.628541+0000","last_active":"2023-11-24T08:06:43.086651+0000","last_peered":"2023-11-24T08:06:43.086651+0000","last_clean":"2023-11-24T08:06:43.086651+0000","last_became_active":"2023-11-24T08:06:41.627852+0000","last_became_peered":"2023-11-24T08:06:41.627852+0000","last_unstale":"2023-11-24T08:06:43.086651+0000","last_undegraded":"2023-11-24T08:06:43.086651+0000","last_fullsized":"2023-11-24T08:06:43.086651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:47.669843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091336+0000","last_change":"2023-11-24T08:06:42.123280+0000","last_active":"2023-11-24T08:06:43.091336+0000","last_peered":"2023-11-24T08:06:43.091336+0000","last_clean":"2023-11-24T08:06:43.091336+0000","last_became_active":"2023-11-24T08:06:42.122955+0000","last_became_peered":"2023-11-24T08:06:42.122955+0000","last_unstale":"2023-11-24T08:06:43.091336+0000","last_undegraded":"2023-11-24T08:06:43.091336+0000","last_fullsized":"2023-11-24T08:06:43.091336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968092+0000","last_change":"2023-11-24T08:06:41.640956+0000","last_active":"2023-11-24T08:06:43.968092+0000","last_peered":"2023-11-24T08:06:43.968092+0000","last_clean":"2023-11-24T08:06:43.968092+0000","last_became_active":"2023-11-24T08:06:41.640647+0000","last_became_peered":"2023-11-24T08:06:41.640647+0000","last_unstale":"2023-11-24T08:06:43.968092+0000","last_undegraded":"2023-11-24T08:06:43.968092+0000","last_fullsized":"2023-11-24T08:06:43.968092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:01.459437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086672+0000","last_change":"2023-11-24T08:06:42.101030+0000","last_active":"2023-11-24T08:06:43.086672+0000","last_peered":"2023-11-24T08:06:43.086672+0000","last_clean":"2023-11-24T08:06:43.086672+0000","last_became_active":"2023-11-24T08:06:42.100750+0000","last_became_peered":"2023-11-24T08:06:42.100750+0000","last_unstale":"2023-11-24T08:06:43.086672+0000","last_undegraded":"2023-11-24T08:06:43.086672+0000","last_fullsized":"2023-11-24T08:06:43.086672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086852+0000","last_change":"2023-11-24T08:06:41.639221+0000","last_active":"2023-11-24T08:06:43.086852+0000","last_peered":"2023-11-24T08:06:43.086852+0000","last_clean":"2023-11-24T08:06:43.086852+0000","last_became_active":"2023-11-24T08:06:41.638888+0000","last_became_peered":"2023-11-24T08:06:41.638888+0000","last_unstale":"2023-11-24T08:06:43.086852+0000","last_undegraded":"2023-11-24T08:06:43.086852+0000","last_fullsized":"2023-11-24T08:06:43.086852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:38.326101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966489+0000","last_change":"2023-11-24T08:06:42.123237+0000","last_active":"2023-11-24T08:06:43.966489+0000","last_peered":"2023-11-24T08:06:43.966489+0000","last_clean":"2023-11-24T08:06:43.966489+0000","last_became_active":"2023-11-24T08:06:42.122966+0000","last_became_peered":"2023-11-24T08:06:42.122966+0000","last_unstale":"2023-11-24T08:06:43.966489+0000","last_undegraded":"2023-11-24T08:06:43.966489+0000","last_fullsized":"2023-11-24T08:06:43.966489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476853+0000","last_change":"2023-11-24T08:06:41.635985+0000","last_active":"2023-11-24T08:06:43.476853+0000","last_peered":"2023-11-24T08:06:43.476853+0000","last_clean":"2023-11-24T08:06:43.476853+0000","last_became_active":"2023-11-24T08:06:41.634284+0000","last_became_peered":"2023-11-24T08:06:41.634284+0000","last_unstale":"2023-11-24T08:06:43.476853+0000","last_undegraded":"2023-11-24T08:06:43.476853+0000","last_fullsized":"2023-11-24T08:06:43.476853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963977+0000","last_change":"2023-11-24T08:06:42.104357+0000","last_active":"2023-11-24T08:06:43.963977+0000","last_peered":"2023-11-24T08:06:43.963977+0000","last_clean":"2023-11-24T08:06:43.963977+0000","last_became_active":"2023-11-24T08:06:42.103319+0000","last_became_peered":"2023-11-24T08:06:42.103319+0000","last_unstale":"2023-11-24T08:06:43.963977+0000","last_undegraded":"2023-11-24T08:06:43.963977+0000","last_fullsized":"2023-11-24T08:06:43.963977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:25.354171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966408+0000","last_change":"2023-11-24T08:06:41.635130+0000","last_active":"2023-11-24T08:06:43.966408+0000","last_peered":"2023-11-24T08:06:43.966408+0000","last_clean":"2023-11-24T08:06:43.966408+0000","last_became_active":"2023-11-24T08:06:41.634857+0000","last_became_peered":"2023-11-24T08:06:41.634857+0000","last_unstale":"2023-11-24T08:06:43.966408+0000","last_undegraded":"2023-11-24T08:06:43.966408+0000","last_fullsized":"2023-11-24T08:06:43.966408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967411+0000","last_change":"2023-11-24T08:06:42.109364+0000","last_active":"2023-11-24T08:06:43.967411+0000","last_peered":"2023-11-24T08:06:43.967411+0000","last_clean":"2023-11-24T08:06:43.967411+0000","last_became_active":"2023-11-24T08:06:42.108977+0000","last_became_peered":"2023-11-24T08:06:42.108977+0000","last_unstale":"2023-11-24T08:06:43.967411+0000","last_undegraded":"2023-11-24T08:06:43.967411+0000","last_fullsized":"2023-11-24T08:06:43.967411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086495+0000","last_change":"2023-11-24T08:06:41.630908+0000","last_active":"2023-11-24T08:06:43.086495+0000","last_peered":"2023-11-24T08:06:43.086495+0000","last_clean":"2023-11-24T08:06:43.086495+0000","last_became_active":"2023-11-24T08:06:41.630585+0000","last_became_peered":"2023-11-24T08:06:41.630585+0000","last_unstale":"2023-11-24T08:06:43.086495+0000","last_undegraded":"2023-11-24T08:06:43.086495+0000","last_fullsized":"2023-11-24T08:06:43.086495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966678+0000","last_change":"2023-11-24T08:06:42.102831+0000","last_active":"2023-11-24T08:06:43.966678+0000","last_peered":"2023-11-24T08:06:43.966678+0000","last_clean":"2023-11-24T08:06:43.966678+0000","last_became_active":"2023-11-24T08:06:42.100929+0000","last_became_peered":"2023-11-24T08:06:42.100929+0000","last_unstale":"2023-11-24T08:06:43.966678+0000","last_undegraded":"2023-11-24T08:06:43.966678+0000","last_fullsized":"2023-11-24T08:06:43.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086955+0000","last_change":"2023-11-24T08:06:41.628964+0000","last_active":"2023-11-24T08:06:43.086955+0000","last_peered":"2023-11-24T08:06:43.086955+0000","last_clean":"2023-11-24T08:06:43.086955+0000","last_became_active":"2023-11-24T08:06:41.628682+0000","last_became_peered":"2023-11-24T08:06:41.628682+0000","last_unstale":"2023-11-24T08:06:43.086955+0000","last_undegraded":"2023-11-24T08:06:43.086955+0000","last_fullsized":"2023-11-24T08:06:43.086955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966228+0000","last_change":"2023-11-24T08:06:42.108598+0000","last_active":"2023-11-24T08:06:43.966228+0000","last_peered":"2023-11-24T08:06:43.966228+0000","last_clean":"2023-11-24T08:06:43.966228+0000","last_became_active":"2023-11-24T08:06:42.107835+0000","last_became_peered":"2023-11-24T08:06:42.107835+0000","last_unstale":"2023-11-24T08:06:43.966228+0000","last_undegraded":"2023-11-24T08:06:43.966228+0000","last_fullsized":"2023-11-24T08:06:43.966228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967014+0000","last_change":"2023-11-24T08:06:41.636550+0000","last_active":"2023-11-24T08:06:43.967014+0000","last_peered":"2023-11-24T08:06:43.967014+0000","last_clean":"2023-11-24T08:06:43.967014+0000","last_became_active":"2023-11-24T08:06:41.635883+0000","last_became_peered":"2023-11-24T08:06:41.635883+0000","last_unstale":"2023-11-24T08:06:43.967014+0000","last_undegraded":"2023-11-24T08:06:43.967014+0000","last_fullsized":"2023-11-24T08:06:43.967014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476030+0000","last_change":"2023-11-24T08:06:42.120896+0000","last_active":"2023-11-24T08:06:43.476030+0000","last_peered":"2023-11-24T08:06:43.476030+0000","last_clean":"2023-11-24T08:06:43.476030+0000","last_became_active":"2023-11-24T08:06:42.120699+0000","last_became_peered":"2023-11-24T08:06:42.120699+0000","last_unstale":"2023-11-24T08:06:43.476030+0000","last_undegraded":"2023-11-24T08:06:43.476030+0000","last_fullsized":"2023-11-24T08:06:43.476030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091224+0000","last_change":"2023-11-24T08:06:42.127564+0000","last_active":"2023-11-24T08:06:43.091224+0000","last_peered":"2023-11-24T08:06:43.091224+0000","last_clean":"2023-11-24T08:06:43.091224+0000","last_became_active":"2023-11-24T08:06:42.127280+0000","last_became_peered":"2023-11-24T08:06:42.127280+0000","last_unstale":"2023-11-24T08:06:43.091224+0000","last_undegraded":"2023-11-24T08:06:43.091224+0000","last_fullsized":"2023-11-24T08:06:43.091224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967373+0000","last_change":"2023-11-24T08:06:41.640662+0000","last_active":"2023-11-24T08:06:43.967373+0000","last_peered":"2023-11-24T08:06:43.967373+0000","last_clean":"2023-11-24T08:06:43.967373+0000","last_became_active":"2023-11-24T08:06:41.640349+0000","last_became_peered":"2023-11-24T08:06:41.640349+0000","last_unstale":"2023-11-24T08:06:43.967373+0000","last_undegraded":"2023-11-24T08:06:43.967373+0000","last_fullsized":"2023-11-24T08:06:43.967373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092068+0000","last_change":"2023-11-24T08:06:42.122723+0000","last_active":"2023-11-24T08:06:43.092068+0000","last_peered":"2023-11-24T08:06:43.092068+0000","last_clean":"2023-11-24T08:06:43.092068+0000","last_became_active":"2023-11-24T08:06:42.122440+0000","last_became_peered":"2023-11-24T08:06:42.122440+0000","last_unstale":"2023-11-24T08:06:43.092068+0000","last_undegraded":"2023-11-24T08:06:43.092068+0000","last_fullsized":"2023-11-24T08:06:43.092068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967777+0000","last_change":"2023-11-24T08:06:41.643783+0000","last_active":"2023-11-24T08:06:43.967777+0000","last_peered":"2023-11-24T08:06:43.967777+0000","last_clean":"2023-11-24T08:06:43.967777+0000","last_became_active":"2023-11-24T08:06:41.643547+0000","last_became_peered":"2023-11-24T08:06:41.643547+0000","last_unstale":"2023-11-24T08:06:43.967777+0000","last_undegraded":"2023-11-24T08:06:43.967777+0000","last_fullsized":"2023-11-24T08:06:43.967777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963856+0000","last_change":"2023-11-24T08:06:42.132774+0000","last_active":"2023-11-24T08:06:43.963856+0000","last_peered":"2023-11-24T08:06:43.963856+0000","last_clean":"2023-11-24T08:06:43.963856+0000","last_became_active":"2023-11-24T08:06:42.132564+0000","last_became_peered":"2023-11-24T08:06:42.132564+0000","last_unstale":"2023-11-24T08:06:43.963856+0000","last_undegraded":"2023-11-24T08:06:43.963856+0000","last_fullsized":"2023-11-24T08:06:43.963856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:39:33.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966291+0000","last_change":"2023-11-24T08:06:41.626427+0000","last_active":"2023-11-24T08:06:43.966291+0000","last_peered":"2023-11-24T08:06:43.966291+0000","last_clean":"2023-11-24T08:06:43.966291+0000","last_became_active":"2023-11-24T08:06:41.625025+0000","last_became_peered":"2023-11-24T08:06:41.625025+0000","last_unstale":"2023-11-24T08:06:43.966291+0000","last_undegraded":"2023-11-24T08:06:43.966291+0000","last_fullsized":"2023-11-24T08:06:43.966291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966230+0000","last_change":"2023-11-24T08:06:42.122014+0000","last_active":"2023-11-24T08:06:43.966230+0000","last_peered":"2023-11-24T08:06:43.966230+0000","last_clean":"2023-11-24T08:06:43.966230+0000","last_became_active":"2023-11-24T08:06:42.121753+0000","last_became_peered":"2023-11-24T08:06:42.121753+0000","last_unstale":"2023-11-24T08:06:43.966230+0000","last_undegraded":"2023-11-24T08:06:43.966230+0000","last_fullsized":"2023-11-24T08:06:43.966230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964226+0000","last_change":"2023-11-24T08:06:41.633665+0000","last_active":"2023-11-24T08:06:43.964226+0000","last_peered":"2023-11-24T08:06:43.964226+0000","last_clean":"2023-11-24T08:06:43.964226+0000","last_became_active":"2023-11-24T08:06:41.633430+0000","last_became_peered":"2023-11-24T08:06:41.633430+0000","last_unstale":"2023-11-24T08:06:43.964226+0000","last_undegraded":"2023-11-24T08:06:43.964226+0000","last_fullsized":"2023-11-24T08:06:43.964226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:05:34.192369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":811008,"data_stored":663526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7090000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9690000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1269999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2690000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1970000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2490000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":78876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0720000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":669882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.917}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.982}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:06:47.514 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:06:47.514 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T08:06:47.514 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T08:06:47.514 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T08:06:47.515 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T08:06:47.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.768+0000 7f0189caa640 1 Processor -- start 2023-11-24T08:06:47.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.768+0000 7f0189caa640 1 -- start start 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.769+0000 7f0189caa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0184143c40 0x7f0184071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.769+0000 7f0189caa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f01840717d0 0x7f01840cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.769+0000 7f0189caa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0184070e50 con 0x7f01840cca40 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.769+0000 7f0189caa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01840723c0 con 0x7f01840717d0 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.769+0000 7f0189caa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01840cce70 con 0x7f0184143c40 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0183fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f01840717d0 0x7f01840cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0183fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f01840717d0 0x7f01840cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56898/0 (socket says 172.21.15.97:56898) 2023-11-24T08:06:47.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f01894a9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f01840cca40 0x7f018415eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43428/0 (socket says 172.21.15.97:43428) 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0183fff640 1 -- 172.21.15.97:0/978386070 learned_addr learned my addr 172.21.15.97:0/978386070 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0188ca8640 1 --2- 172.21.15.97:0/978386070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0184143c40 0x7f0184071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0183fff640 1 -- 172.21.15.97:0/978386070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0184143c40 msgr2=0x7f0184071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0183fff640 1 --2- 172.21.15.97:0/978386070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0184143c40 0x7f0184071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0183fff640 1 -- 172.21.15.97:0/978386070 >> v1:172.21.15.97:6789/0 conn(0x7f01840cca40 legacy=0x7f018415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0183fff640 1 -- 172.21.15.97:0/978386070 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018406e170 con 0x7f01840717d0 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f01837fe640 1 -- 172.21.15.97:0/978386070 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213448053 0 0) 0x7f0184070e50 con 0x7f01840cca40 2023-11-24T08:06:47.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.770+0000 7f0188ca8640 1 --2- 172.21.15.97:0/978386070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0184143c40 0x7f0184071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.771+0000 7f0183fff640 1 --2- 172.21.15.97:0/978386070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01840717d0 0x7f01840cc500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0170009870 tx=0x7f017002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9890cdf833441b5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f01837fe640 1 -- 172.21.15.97:0/978386070 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170031640 con 0x7f01840717d0 2023-11-24T08:06:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f01837fe640 1 -- 172.21.15.97:0/978386070 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700317a0 con 0x7f01840717d0 2023-11-24T08:06:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f01837fe640 1 -- 172.21.15.97:0/978386070 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170031b30 con 0x7f01840717d0 2023-11-24T08:06:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 -- 172.21.15.97:0/978386070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01840717d0 msgr2=0x7f01840cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 --2- 172.21.15.97:0/978386070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01840717d0 0x7f01840cc500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0170009870 tx=0x7f017002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 -- 172.21.15.97:0/978386070 shutdown_connections 2023-11-24T08:06:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 --2- 172.21.15.97:0/978386070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01840717d0 0x7f01840cc500 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 --2- 172.21.15.97:0/978386070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0184143c40 0x7f0184071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 -- 172.21.15.97:0/978386070 >> 172.21.15.97:0/978386070 conn(0x7f018406a800 msgr2=0x7f018406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 -- 172.21.15.97:0/978386070 shutdown_connections 2023-11-24T08:06:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.772+0000 7f0189caa640 1 -- 172.21.15.97:0/978386070 wait complete. 2023-11-24T08:06:47.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.774+0000 7f0189caa640 1 Processor -- start 2023-11-24T08:06:47.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.774+0000 7f0189caa640 1 -- start start 2023-11-24T08:06:47.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.775+0000 7f0189caa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01840717d0 0x7f01840ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.775+0000 7f0189caa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01840cca40 0x7f01840b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.775+0000 7f0189caa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0184143c40 0x7f01840c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.775+0000 7f0189caa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01840c9ad0 con 0x7f0184143c40 2023-11-24T08:06:47.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.775+0000 7f0189caa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01840c9db0 con 0x7f01840717d0 2023-11-24T08:06:47.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.775+0000 7f0189caa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01840ca090 con 0x7f01840cca40 2023-11-24T08:06:47.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0184143c40 0x7f01840c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0184143c40 0x7f01840c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56908/0 (socket says 172.21.15.97:56908) 2023-11-24T08:06:47.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 -- 172.21.15.97:0/209227431 learned_addr learned my addr 172.21.15.97:0/209227431 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f0183fff640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01840cca40 0x7f01840b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f0188ca8640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01840717d0 0x7f01840ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 -- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01840cca40 msgr2=0x7f01840b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01840cca40 0x7f01840b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 -- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01840717d0 msgr2=0x7f01840ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01840717d0 0x7f01840ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 -- 172.21.15.97:0/209227431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700094d0 con 0x7f0184143c40 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01894a9640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0184143c40 0x7f01840c7a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f017c00c7e0 tx=0x7f017c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.776+0000 7f01817fa640 1 -- 172.21.15.97:0/209227431 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00a640 con 0x7f0184143c40 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.777+0000 7f01817fa640 1 -- 172.21.15.97:0/209227431 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00a7c0 con 0x7f0184143c40 2023-11-24T08:06:47.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.777+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01840ca370 con 0x7f0184143c40 2023-11-24T08:06:47.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.777+0000 7f01817fa640 1 -- 172.21.15.97:0/209227431 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00ab70 con 0x7f0184143c40 2023-11-24T08:06:47.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.777+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01840b3390 con 0x7f0184143c40 2023-11-24T08:06:47.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.778+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0184067450 con 0x7f0184143c40 2023-11-24T08:06:47.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.778+0000 7f01817fa640 1 -- 172.21.15.97:0/209227431 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f017c00acd0 con 0x7f0184143c40 2023-11-24T08:06:47.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.780+0000 7f01817fa640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f016806ae40 0x7f016806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.780+0000 7f01817fa640 1 -- 172.21.15.97:0/209227431 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f017c088e20 con 0x7f0184143c40 2023-11-24T08:06:47.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.780+0000 7f0188ca8640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f016806ae40 0x7f016806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.781+0000 7f0188ca8640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f016806ae40 0x7f016806d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f017800b840 tx=0x7f0178008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:47.784+0000 7f01817fa640 1 -- 172.21.15.97:0/209227431 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f017c053f60 con 0x7f0184143c40 2023-11-24T08:06:48.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.021+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f01840c9c10 con 0x7f0184143c40 2023-11-24T08:06:48.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.026+0000 7f01817fa640 1 -- 172.21.15.97:0/209227431 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171031 (secure 0 0 0) 0x7f01840c9c10 con 0x7f0184143c40 2023-11-24T08:06:48.032 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:48.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f016806ae40 msgr2=0x7f016806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f016806ae40 0x7f016806d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f017800b840 tx=0x7f0178008040 comp rx=0 tx=0).stop 2023-11-24T08:06:48.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0184143c40 msgr2=0x7f01840c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0184143c40 0x7f01840c7a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f017c00c7e0 tx=0x7f017c00cca0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 shutdown_connections 2023-11-24T08:06:48.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f016806ae40 0x7f016806d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0184143c40 0x7f01840c7a80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01840cca40 0x7f01840b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 --2- 172.21.15.97:0/209227431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01840717d0 0x7f01840ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 >> 172.21.15.97:0/209227431 conn(0x7f018406a800 msgr2=0x7f01840ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:48.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 shutdown_connections 2023-11-24T08:06:48.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.030+0000 7f0189caa640 1 -- 172.21.15.97:0/209227431 wait complete. 2023-11-24T08:06:48.051 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2294833959},{"type":"v1","addr":"172.21.15.97:6833","nonce":2294833959}]},"active_addr":"172.21.15.97:6833/2294833959","active_change":"2023-11-24T08:06:27.248812+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1421508478}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":713463707}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1693742649}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1325742100}]}]} 2023-11-24T08:06:48.054 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T08:06:48.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T08:06:48.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:48.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.255+0000 7fabcdee7640 1 Processor -- start 2023-11-24T08:06:48.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.255+0000 7fabcdee7640 1 -- start start 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.256+0000 7fabcdee7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabc813df80 0x7fabc815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.256+0000 7fabcdee7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc813e360 0x7fabc80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.256+0000 7fabcdee7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc806c470 con 0x7fabc815f9c0 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.256+0000 7fabcdee7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc806c750 con 0x7fabc813df80 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.256+0000 7fabcdee7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc806ca30 con 0x7fabc813e360 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabc77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabc813df80 0x7fabc815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabc77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabc813df80 0x7fabc815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56914/0 (socket says 172.21.15.97:56914) 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabc77fe640 1 -- 172.21.15.97:0/3428674538 learned_addr learned my addr 172.21.15.97:0/3428674538 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabbffff640 1 --2- 172.21.15.97:0/3428674538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc813e360 0x7fabc80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabc77fe640 1 -- 172.21.15.97:0/3428674538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc813e360 msgr2=0x7fabc80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:48.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabc77fe640 1 --2- 172.21.15.97:0/3428674538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc813e360 0x7fabc80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabc77fe640 1 -- 172.21.15.97:0/3428674538 >> v1:172.21.15.183:6789/0 conn(0x7fabc815f9c0 legacy=0x7fabc81408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:48.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.257+0000 7fabc77fe640 1 -- 172.21.15.97:0/3428674538 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc806cd10 con 0x7fabc813df80 2023-11-24T08:06:48.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabc77fe640 1 --2- 172.21.15.97:0/3428674538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813df80 0x7fabc815bee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009870 tx=0x7fabb802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51800f5a170ae69 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:48.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabc6ffd640 1 -- 172.21.15.97:0/3428674538 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8031640 con 0x7fabc813df80 2023-11-24T08:06:48.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabc6ffd640 1 -- 172.21.15.97:0/3428674538 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80317a0 con 0x7fabc813df80 2023-11-24T08:06:48.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabc6ffd640 1 -- 172.21.15.97:0/3428674538 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8031b30 con 0x7fabc813df80 2023-11-24T08:06:48.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabcdee7640 1 -- 172.21.15.97:0/3428674538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813df80 msgr2=0x7fabc815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabcdee7640 1 --2- 172.21.15.97:0/3428674538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813df80 0x7fabc815bee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009870 tx=0x7fabb802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabcdee7640 1 -- 172.21.15.97:0/3428674538 shutdown_connections 2023-11-24T08:06:48.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabcdee7640 1 --2- 172.21.15.97:0/3428674538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc813e360 0x7fabc80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabcdee7640 1 --2- 172.21.15.97:0/3428674538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813df80 0x7fabc815bee0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.259+0000 7fabcdee7640 1 -- 172.21.15.97:0/3428674538 >> 172.21.15.97:0/3428674538 conn(0x7fabc806a800 msgr2=0x7fabc806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:48.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.260+0000 7fabcdee7640 1 -- 172.21.15.97:0/3428674538 shutdown_connections 2023-11-24T08:06:48.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.260+0000 7fabcdee7640 1 -- 172.21.15.97:0/3428674538 wait complete. 2023-11-24T08:06:48.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.261+0000 7fabcdee7640 1 Processor -- start 2023-11-24T08:06:48.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.261+0000 7fabcdee7640 1 -- start start 2023-11-24T08:06:48.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabcdee7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc813df80 0x7fabc813cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabcdee7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813e360 0x7fabc813d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabcdee7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc815f9c0 0x7fabc814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabcdee7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc814de10 con 0x7fabc813e360 2023-11-24T08:06:48.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabcdee7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8070360 con 0x7fabc813df80 2023-11-24T08:06:48.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabcdee7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8070640 con 0x7fabc815f9c0 2023-11-24T08:06:48.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabbffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813e360 0x7fabc813d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabbffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813e360 0x7fabc813d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56916/0 (socket says 172.21.15.97:56916) 2023-11-24T08:06:48.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.262+0000 7fabbffff640 1 -- 172.21.15.97:0/1499285989 learned_addr learned my addr 172.21.15.97:0/1499285989 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:48.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabc77fe640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc813df80 0x7fabc813cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabc7fff640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc815f9c0 0x7fabc814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabbffff640 1 -- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc815f9c0 msgr2=0x7fabc814e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabbffff640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc815f9c0 0x7fabc814e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabbffff640 1 -- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc813df80 msgr2=0x7fabc813cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabbffff640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc813df80 0x7fabc813cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabbffff640 1 -- 172.21.15.97:0/1499285989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80094d0 con 0x7fabc813e360 2023-11-24T08:06:48.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabbffff640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813e360 0x7fabc813d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c7f0 tx=0x7fabb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:48.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabc4ff9640 1 -- 172.21.15.97:0/1499285989 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004220 con 0x7fabc813e360 2023-11-24T08:06:48.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabc4ff9640 1 -- 172.21.15.97:0/1499285989 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb00043a0 con 0x7fabc813e360 2023-11-24T08:06:48.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc8070920 con 0x7fabc813e360 2023-11-24T08:06:48.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabc4ff9640 1 -- 172.21.15.97:0/1499285989 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0007860 con 0x7fabc813e360 2023-11-24T08:06:48.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.263+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc813d900 con 0x7fabc813e360 2023-11-24T08:06:48.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.264+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc8070e40 con 0x7fabc813e360 2023-11-24T08:06:48.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.265+0000 7fabc4ff9640 1 -- 172.21.15.97:0/1499285989 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabb0007bd0 con 0x7fabc813e360 2023-11-24T08:06:48.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.266+0000 7fabc4ff9640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faba806ae70 0x7faba806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.266+0000 7fabc4ff9640 1 -- 172.21.15.97:0/1499285989 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabb0089670 con 0x7fabc813e360 2023-11-24T08:06:48.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.266+0000 7fabc77fe640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faba806ae70 0x7faba806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.267+0000 7fabc77fe640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faba806ae70 0x7faba806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fabb8036000 tx=0x7fabb803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:48.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.271+0000 7fabc4ff9640 1 -- 172.21.15.97:0/1499285989 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabc8070e40 con 0x7fabc813e360 2023-11-24T08:06:48.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.447+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabc8070e40 con 0x7fabc813e360 2023-11-24T08:06:48.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.450+0000 7fabc4ff9640 1 -- 172.21.15.97:0/1499285989 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fabc8070e40 con 0x7fabc813e360 2023-11-24T08:06:48.452 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:48.452 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:48.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.452+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faba806ae70 msgr2=0x7faba806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.452+0000 7fabcdee7640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faba806ae70 0x7faba806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fabb8036000 tx=0x7fabb803c040 comp rx=0 tx=0).stop 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.452+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813e360 msgr2=0x7fabc813d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.452+0000 7fabcdee7640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813e360 0x7fabc813d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c7f0 tx=0x7fabb000ccb0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.452+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 shutdown_connections 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.452+0000 7fabcdee7640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faba806ae70 0x7faba806d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.453+0000 7fabcdee7640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabc815f9c0 0x7fabc814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.453+0000 7fabcdee7640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc813e360 0x7fabc813d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.453+0000 7fabcdee7640 1 --2- 172.21.15.97:0/1499285989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabc813df80 0x7fabc813cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.453+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 >> 172.21.15.97:0/1499285989 conn(0x7fabc806a800 msgr2=0x7fabc815d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.453+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 shutdown_connections 2023-11-24T08:06:48.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.453+0000 7fabcdee7640 1 -- 172.21.15.97:0/1499285989 wait complete. 2023-11-24T08:06:48.474 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T08:06:48.474 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:48.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.677+0000 7f7de0e7e640 1 Processor -- start 2023-11-24T08:06:48.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.677+0000 7f7de0e7e640 1 -- start start 2023-11-24T08:06:48.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.679+0000 7f7de0e7e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7ddc0d0100 0x7f7ddc0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.679+0000 7f7de0e7e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0d0f40 0x7f7ddc0d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.679+0000 7f7de0e7e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc0d0a10 con 0x7f7ddc160920 2023-11-24T08:06:48.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.679+0000 7f7de0e7e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cf080 con 0x7f7ddc0d0100 2023-11-24T08:06:48.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.679+0000 7f7de0e7e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0c6be0 con 0x7f7ddc0d0f40 2023-11-24T08:06:48.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.679+0000 7f7ddb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7ddc160920 0x7f7ddc0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43444/0 (socket says 172.21.15.97:43444) 2023-11-24T08:06:48.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.679+0000 7f7ddb7fe640 1 -- 172.21.15.97:0/1266545103 learned_addr learned my addr 172.21.15.97:0/1266545103 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7ddbfff640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0d0f40 0x7f7ddc0d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549210698 0 0) 0x7f7ddc0d0a10 con 0x7f7ddc160920 2023-11-24T08:06:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/1266545103 >> v2:172.21.15.183:3300/0 conn(0x7f7ddc0d0100 0x7f7ddc0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc8003520 con 0x7f7ddc160920 2023-11-24T08:06:48.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3199575411 0 0) 0x7f7dc8003520 con 0x7f7ddc160920 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0d0f40 msgr2=0x7f7ddc0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0d0f40 0x7f7ddc0d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 >> v2:172.21.15.183:3300/0 conn(0x7f7ddc0d0100 msgr2=0x7f7ddc0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 --2- 172.21.15.97:0/1266545103 >> v2:172.21.15.183:3300/0 conn(0x7f7ddc0d0100 0x7f7ddc0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0ce7e0 con 0x7f7ddc160920 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f7dc4001670 con 0x7f7ddc160920 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 >> v1:172.21.15.97:6789/0 conn(0x7f7ddc160920 legacy=0x7f7ddc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0d0f40 0x7f7dc8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc8003f40 0x7f7dc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8004d00 0x7f7dc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cf080 con 0x7f7dc8003f40 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0c6be0 con 0x7f7dc8004d00 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc800ba30 con 0x7f7ddc0d0f40 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/1266545103 >> v2:172.21.15.183:3300/0 conn(0x7f7ddc0d0100 0x7f7ddc0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.680+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc8003f40 0x7f7dc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.681+0000 7f7ddaffd640 1 -- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0d0f40 msgr2=0x7f7dc8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.681+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0d0f40 0x7f7dc8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.681+0000 7f7ddaffd640 1 -- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8004d00 msgr2=0x7f7dc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.681+0000 7f7ddbfff640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8004d00 0x7f7dc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.681+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8004d00 0x7f7dc8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.681+0000 7f7ddaffd640 1 -- 172.21.15.97:0/1266545103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8003520 con 0x7f7dc8003f40 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.682+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc8003f40 0x7f7dc80047c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0073e0 tx=0x7f7dc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb25044b89e9b412 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.682+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc02cdc0 con 0x7f7dc8003f40 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.682+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc034440 con 0x7f7dc8003f40 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.682+0000 7f7dda7fc640 1 -- 172.21.15.97:0/1266545103 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0347b0 con 0x7f7dc8003f40 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.683+0000 7f7de0e7e640 1 -- 172.21.15.97:0/1266545103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc8003f40 msgr2=0x7f7dc80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.683+0000 7f7de0e7e640 1 --2- 172.21.15.97:0/1266545103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc8003f40 0x7f7dc80047c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0073e0 tx=0x7f7dc80057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.683+0000 7f7ddbfff640 1 -- 172.21.15.97:0/1266545103 reap_dead start 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.683+0000 7f7de0e7e640 1 -- 172.21.15.97:0/1266545103 shutdown_connections 2023-11-24T08:06:48.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.683+0000 7f7de0e7e640 1 -- 172.21.15.97:0/1266545103 >> 172.21.15.97:0/1266545103 conn(0x7f7ddc0d3090 msgr2=0x7f7ddc0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:48.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.683+0000 7f7de0e7e640 1 -- 172.21.15.97:0/1266545103 shutdown_connections 2023-11-24T08:06:48.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.683+0000 7f7de0e7e640 1 -- 172.21.15.97:0/1266545103 wait complete. 2023-11-24T08:06:48.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.685+0000 7f7de0e7e640 1 Processor -- start 2023-11-24T08:06:48.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.685+0000 7f7de0e7e640 1 -- start start 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7de0e7e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8003f40 0x7f7ddc154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7de0e7e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ddc0cba50 0x7f7ddc14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7de0e7e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0ca160 0x7f7ddc159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7de0e7e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cbed0 con 0x7f7ddc0cba50 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7de0e7e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0ca9b0 con 0x7f7dc8003f40 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7de0e7e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cac90 con 0x7f7ddc0ca160 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ddc0cba50 0x7f7ddc14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ddc0cba50 0x7f7ddc14a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56930/0 (socket says 172.21.15.97:56930) 2023-11-24T08:06:48.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 -- 172.21.15.97:0/2920664911 learned_addr learned my addr 172.21.15.97:0/2920664911 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 -- 172.21.15.97:0/2920664911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0ca160 msgr2=0x7f7ddc159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0ca160 0x7f7ddc159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 -- 172.21.15.97:0/2920664911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8003f40 msgr2=0x7f7ddc154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8003f40 0x7f7ddc154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.686+0000 7f7ddaffd640 1 -- 172.21.15.97:0/2920664911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0caf70 con 0x7f7ddc0cba50 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.687+0000 7f7ddaffd640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ddc0cba50 0x7f7ddc14a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc037040 tx=0x7f7dcc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.687+0000 7f7dd3fff640 1 -- 172.21.15.97:0/2920664911 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc03e8d0 con 0x7f7ddc0cba50 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.687+0000 7f7dd3fff640 1 -- 172.21.15.97:0/2920664911 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc03ea70 con 0x7f7ddc0cba50 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.687+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc0cb250 con 0x7f7ddc0cba50 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.687+0000 7f7dd3fff640 1 -- 172.21.15.97:0/2920664911 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc03ee20 con 0x7f7ddc0cba50 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.687+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc14a970 con 0x7f7ddc0cba50 2023-11-24T08:06:48.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.688+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc067450 con 0x7f7ddc0cba50 2023-11-24T08:06:48.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.689+0000 7f7dd3fff640 1 -- 172.21.15.97:0/2920664911 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dcc03d3a0 con 0x7f7ddc0cba50 2023-11-24T08:06:48.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.690+0000 7f7dd3fff640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dbc06ae70 0x7f7dbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:48.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.690+0000 7f7dd3fff640 1 -- 172.21.15.97:0/2920664911 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dcc0abba0 con 0x7f7ddc0cba50 2023-11-24T08:06:48.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.690+0000 7f7ddb7fe640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dbc06ae70 0x7f7dbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:48.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.691+0000 7f7ddb7fe640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dbc06ae70 0x7f7dbc06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc15a0b0 tx=0x7f7dc4001540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:48.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.694+0000 7f7dd3fff640 1 -- 172.21.15.97:0/2920664911 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7dcc076cf0 con 0x7f7ddc0cba50 2023-11-24T08:06:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.886+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ddc15c300 con 0x7f7ddc0cba50 2023-11-24T08:06:48.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.888+0000 7f7dd3fff640 1 -- 172.21.15.97:0/2920664911 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7dcc04b090 con 0x7f7ddc0cba50 2023-11-24T08:06:48.891 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:48.891 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.891+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dbc06ae70 msgr2=0x7f7dbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.891+0000 7f7de0e7e640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dbc06ae70 0x7f7dbc06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc15a0b0 tx=0x7f7dc4001540 comp rx=0 tx=0).stop 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ddc0cba50 msgr2=0x7f7ddc14a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ddc0cba50 0x7f7ddc14a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc037040 tx=0x7f7dcc004ab0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 shutdown_connections 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dbc06ae70 0x7f7dbc06d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ddc0ca160 0x7f7ddc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ddc0cba50 0x7f7ddc14a430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 --2- 172.21.15.97:0/2920664911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc8003f40 0x7f7ddc154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 >> 172.21.15.97:0/2920664911 conn(0x7f7ddc0d3090 msgr2=0x7f7ddc0d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 shutdown_connections 2023-11-24T08:06:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:48.892+0000 7f7de0e7e640 1 -- 172.21.15.97:0/2920664911 wait complete. 2023-11-24T08:06:48.912 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T08:06:48.913 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T08:06:48.913 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T08:06:48.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T08:06:48.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T08:06:48.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T08:06:48.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T08:06:48.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T08:06:49.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.208+0000 7f64bf47c640 1 Processor -- start 2023-11-24T08:06:49.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.209+0000 7f64bf47c640 1 -- start start 2023-11-24T08:06:49.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.211+0000 7f64bf47c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f64b816e380 0x7f64b808a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.211+0000 7f64bf47c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64b816e760 0x7f64b808aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.211+0000 7f64bca17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64b816e760 0x7f64b808aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.211+0000 7f64bca17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64b816e760 0x7f64b808aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56940/0 (socket says 172.21.15.97:56940) 2023-11-24T08:06:49.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bca17640 1 -- 172.21.15.97:0/1428338207 learned_addr learned my addr 172.21.15.97:0/1428338207 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b8071b20 con 0x7f64b80b29a0 2023-11-24T08:06:49.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b8071da0 con 0x7f64b816e760 2023-11-24T08:06:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b8072080 con 0x7f64b816e380 2023-11-24T08:06:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bca17640 1 -- 172.21.15.97:0/1428338207 >> v2:172.21.15.183:3300/0 conn(0x7f64b816e380 msgr2=0x7f64b808a510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:06:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bca17640 1 --2- 172.21.15.97:0/1428338207 >> v2:172.21.15.183:3300/0 conn(0x7f64b816e380 0x7f64b808a510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bca17640 1 -- 172.21.15.97:0/1428338207 >> v1:172.21.15.183:6789/0 conn(0x7f64b80b29a0 legacy=0x7f64b80b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.212+0000 7f64bca17640 1 -- 172.21.15.97:0/1428338207 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8072360 con 0x7f64b816e760 2023-11-24T08:06:49.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.214+0000 7f64bca17640 1 --2- 172.21.15.97:0/1428338207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b808aa50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64b80b1860 tx=0x7f64b402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af2038a61c6abe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.215+0000 7f64affff640 1 -- 172.21.15.97:0/1428338207 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b402f810 con 0x7f64b816e760 2023-11-24T08:06:49.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.215+0000 7f64affff640 1 -- 172.21.15.97:0/1428338207 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b402f970 con 0x7f64b816e760 2023-11-24T08:06:49.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.216+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 msgr2=0x7f64b808aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.216+0000 7f64affff640 1 -- 172.21.15.97:0/1428338207 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b402f810 con 0x7f64b816e760 2023-11-24T08:06:49.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.216+0000 7f64bf47c640 1 --2- 172.21.15.97:0/1428338207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b808aa50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f64b80b1860 tx=0x7f64b402b9f0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 shutdown_connections 2023-11-24T08:06:49.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f64bf47c640 1 --2- 172.21.15.97:0/1428338207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b808aa50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.214+0000 7f7d3d41c640 1 Processor -- start 2023-11-24T08:06:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.214+0000 7f7d3d41c640 1 -- start start 2023-11-24T08:06:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.216+0000 7f7d3d41c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7d380b22b0 0x7f7d380d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.216+0000 7f7d3d41c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d380d1a90 0x7f7d380ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.216+0000 7f7d3d41c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d380d22e0 con 0x7f7d380b2690 2023-11-24T08:06:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f7d3d41c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380ce680 con 0x7f7d380d1a90 2023-11-24T08:06:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f7d3d41c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380cdd90 con 0x7f7d380b22b0 2023-11-24T08:06:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f64bf47c640 1 --2- 172.21.15.97:0/1428338207 >> v2:172.21.15.183:3300/0 conn(0x7f64b816e380 0x7f64b808a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 >> 172.21.15.97:0/1428338207 conn(0x7f64b80b0be0 msgr2=0x7f64b80b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 shutdown_connections 2023-11-24T08:06:49.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7f64bf47c640 1 -- 172.21.15.97:0/1428338207 wait complete. 2023-11-24T08:06:49.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.217+0000 7fe83e708640 1 Processor -- start 2023-11-24T08:06:49.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.218+0000 7fe83e708640 1 -- start start 2023-11-24T08:06:49.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.218+0000 7f7d377fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d380d1a90 0x7f7d380ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.218+0000 7f7d367fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7d380b2690 0x7f7d380b2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43450/0 (socket says 172.21.15.97:43450) 2023-11-24T08:06:49.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.218+0000 7f7d367fc640 1 -- 172.21.15.97:0/3798097030 learned_addr learned my addr 172.21.15.97:0/3798097030 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:49.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.219+0000 7f7d36ffd640 1 --2- 172.21.15.97:0/3798097030 >> v2:172.21.15.183:3300/0 conn(0x7f7d380b22b0 0x7f7d380d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7f7d377fe640 1 -- 172.21.15.97:0/3798097030 >> v2:172.21.15.183:3300/0 conn(0x7f7d380b22b0 msgr2=0x7f7d380d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7f7d377fe640 1 --2- 172.21.15.97:0/3798097030 >> v2:172.21.15.183:3300/0 conn(0x7f7d380b22b0 0x7f7d380d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7f7d377fe640 1 -- 172.21.15.97:0/3798097030 >> v1:172.21.15.97:6789/0 conn(0x7f7d380b2690 legacy=0x7f7d380b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7f7d377fe640 1 -- 172.21.15.97:0/3798097030 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380d2000 con 0x7f7d380d1a90 2023-11-24T08:06:49.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7fe83e708640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe8300078a0 0x7fe8300edd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7fe83e708640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe830058530 con 0x7fe83003e800 2023-11-24T08:06:49.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7fe83e708640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe830058810 con 0x7fe8300e3080 2023-11-24T08:06:49.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7fe83e708640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe830006160 con 0x7fe8300078a0 2023-11-24T08:06:49.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.220+0000 7fe83cca5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe8300078a0 0x7fe8300edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7fe83cca5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe8300078a0 0x7fe8300edd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58420/0 (socket says 172.21.15.97:58420) 2023-11-24T08:06:49.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7fe83cca5640 1 -- 172.21.15.97:0/781791614 learned_addr learned my addr 172.21.15.97:0/781791614 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.221+0000 7fe837fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe8300e3080 0x7fe830057d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50826/0 (socket says 172.21.15.97:50826) 2023-11-24T08:06:49.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7f64bf47c640 1 Processor -- start 2023-11-24T08:06:49.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7f7d377fe640 1 --2- 172.21.15.97:0/3798097030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380d1a90 0x7f7d380ceb10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097a0 tx=0x7f7d2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430f30a52849ca14 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7fe83cca5640 1 -- 172.21.15.97:0/781791614 >> v1:172.21.15.183:6789/0 conn(0x7fe8300e3080 legacy=0x7fe830057d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7fe83cca5640 1 -- 172.21.15.97:0/781791614 >> v1:172.21.15.97:6789/0 conn(0x7fe83003e800 legacy=0x7fe830053bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7fe836ffd640 1 -- 172.21.15.97:0/781791614 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893473383 0 0) 0x7fe830058530 con 0x7fe83003e800 2023-11-24T08:06:49.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.223+0000 7fe83cca5640 1 -- 172.21.15.97:0/781791614 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830058af0 con 0x7fe8300078a0 2023-11-24T08:06:49.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.223+0000 7f7d35ffb640 1 -- 172.21.15.97:0/3798097030 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28031830 con 0x7f7d380d1a90 2023-11-24T08:06:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.222+0000 7f64bf47c640 1 -- start start 2023-11-24T08:06:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.223+0000 7f64bf47c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64b80b29a0 0x7f64b820b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bf47c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64b816e380 0x7f64b80cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bf47c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b80ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bf47c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8168ae0 con 0x7f64b816e760 2023-11-24T08:06:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bf47c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b81715a0 con 0x7f64b80b29a0 2023-11-24T08:06:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bf47c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8168490 con 0x7f64b816e380 2023-11-24T08:06:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.223+0000 7f7d35ffb640 1 -- 172.21.15.97:0/3798097030 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d28031990 con 0x7f7d380d1a90 2023-11-24T08:06:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.223+0000 7f7d35ffb640 1 -- 172.21.15.97:0/3798097030 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28031d20 con 0x7f7d380d1a90 2023-11-24T08:06:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bda19640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b80ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bda19640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b80ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56960/0 (socket says 172.21.15.97:56960) 2023-11-24T08:06:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f64bda19640 1 -- 172.21.15.97:0/3323569922 learned_addr learned my addr 172.21.15.97:0/3323569922 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bca17640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64b816e380 0x7f64b80cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bd218640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64b80b29a0 0x7f64b820b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f7d3d41c640 1 -- 172.21.15.97:0/3798097030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380d1a90 msgr2=0x7f7d380ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.224+0000 7f7d3d41c640 1 --2- 172.21.15.97:0/3798097030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380d1a90 0x7f7d380ceb10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097a0 tx=0x7f7d2802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f7d3d41c640 1 -- 172.21.15.97:0/3798097030 shutdown_connections 2023-11-24T08:06:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f7d3d41c640 1 --2- 172.21.15.97:0/3798097030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380d1a90 0x7f7d380ceb10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f7d3d41c640 1 --2- 172.21.15.97:0/3798097030 >> v2:172.21.15.183:3300/0 conn(0x7f7d380b22b0 0x7f7d380d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f7d3d41c640 1 -- 172.21.15.97:0/3798097030 >> 172.21.15.97:0/3798097030 conn(0x7f7d3809c550 msgr2=0x7f7d380d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f7d3d41c640 1 -- 172.21.15.97:0/3798097030 shutdown_connections 2023-11-24T08:06:49.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f7d3d41c640 1 -- 172.21.15.97:0/3798097030 wait complete. 2023-11-24T08:06:49.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bd218640 1 -- 172.21.15.97:0/3323569922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64b816e380 msgr2=0x7f64b80cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bd218640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64b816e380 0x7f64b80cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bd218640 1 -- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 msgr2=0x7f64b80ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bd218640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b80ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bd218640 1 -- 172.21.15.97:0/3323569922 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40094d0 con 0x7f64b80b29a0 2023-11-24T08:06:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.225+0000 7f64bda19640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64b816e760 0x7f64b80ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.226+0000 7f64bd218640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64b80b29a0 0x7f64b820b7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64b000be20 tx=0x7f64b0009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.226+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0014440 con 0x7f64b80b29a0 2023-11-24T08:06:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.226+0000 7fe83cca5640 1 --2- 172.21.15.97:0/781791614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe8300edd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe838000b60 tx=0x7fe8380a5f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4810521b2eea82c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.227+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b00145c0 con 0x7f64b80b29a0 2023-11-24T08:06:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.227+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0014970 con 0x7f64b80b29a0 2023-11-24T08:06:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.227+0000 7fe836ffd640 1 -- 172.21.15.97:0/781791614 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380a6dd0 con 0x7fe8300078a0 2023-11-24T08:06:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.227+0000 7fe836ffd640 1 -- 172.21.15.97:0/781791614 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8380ae440 con 0x7fe8300078a0 2023-11-24T08:06:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.227+0000 7fe836ffd640 1 -- 172.21.15.97:0/781791614 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380ae830 con 0x7fe8300078a0 2023-11-24T08:06:49.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b8168770 con 0x7f64b80b29a0 2023-11-24T08:06:49.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7f7d3d41c640 1 Processor -- start 2023-11-24T08:06:49.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7f7d3d41c640 1 -- start start 2023-11-24T08:06:49.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b820bce0 con 0x7f64b80b29a0 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7fe83e708640 1 -- 172.21.15.97:0/781791614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 msgr2=0x7fe8300edd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7fe83e708640 1 --2- 172.21.15.97:0/781791614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe8300edd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe838000b60 tx=0x7fe8380a5f60 comp rx=0 tx=0).stop 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7fe83e708640 1 -- 172.21.15.97:0/781791614 shutdown_connections 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7fe83e708640 1 --2- 172.21.15.97:0/781791614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe8300edd50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7fe83e708640 1 -- 172.21.15.97:0/781791614 >> 172.21.15.97:0/781791614 conn(0x7fe8300559a0 msgr2=0x7fe830055db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7fe83e708640 1 -- 172.21.15.97:0/781791614 shutdown_connections 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.228+0000 7fe83e708640 1 -- 172.21.15.97:0/781791614 wait complete. 2023-11-24T08:06:49.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.229+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64b80675d0 con 0x7f64b80b29a0 2023-11-24T08:06:49.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.230+0000 7ffa79ae7640 1 Processor -- start 2023-11-24T08:06:49.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.230+0000 7ffa79ae7640 1 -- start start 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.229+0000 7f7d3d41c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380b22b0 0x7f7d38156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.229+0000 7f7d3d41c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d380b2690 0x7f7d380cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.229+0000 7f7d3d41c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d380d1a90 0x7f7d3814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.229+0000 7f7d3d41c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380cce00 con 0x7f7d380b22b0 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.229+0000 7f7d3d41c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380cc1f0 con 0x7f7d380b2690 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.229+0000 7f7d3d41c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380cc4d0 con 0x7f7d380d1a90 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.230+0000 7f7d36ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380b22b0 0x7f7d38156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.230+0000 7f7d36ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380b22b0 0x7f7d38156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56964/0 (socket says 172.21.15.97:56964) 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.230+0000 7f7d36ffd640 1 -- 172.21.15.97:0/4276635578 learned_addr learned my addr 172.21.15.97:0/4276635578 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.230+0000 7f7d367fc640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d380b2690 0x7f7d380cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.230+0000 7f7d377fe640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d380d1a90 0x7f7d3814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.231+0000 7f7d36ffd640 1 -- 172.21.15.97:0/4276635578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d380d1a90 msgr2=0x7f7d3814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.231+0000 7f7d36ffd640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d380d1a90 0x7f7d3814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.231+0000 7f7d36ffd640 1 -- 172.21.15.97:0/4276635578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d380b2690 msgr2=0x7f7d380cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.231+0000 7f7d36ffd640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d380b2690 0x7f7d380cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.231+0000 7f7d36ffd640 1 -- 172.21.15.97:0/4276635578 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009400 con 0x7f7d380b22b0 2023-11-24T08:06:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.231+0000 7fe83e708640 1 Processor -- start 2023-11-24T08:06:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.232+0000 7f7d36ffd640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380b22b0 0x7f7d38156da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000ce10 tx=0x7f7d3000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.232+0000 7fe83e708640 1 -- start start 2023-11-24T08:06:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.232+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30003b90 con 0x7f7d380b22b0 2023-11-24T08:06:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.232+0000 7fd505d61640 1 Processor -- start 2023-11-24T08:06:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.232+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30003cf0 con 0x7f7d380b22b0 2023-11-24T08:06:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7ffa79ae7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffa740b30b0 0x7ffa740ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.232+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30003ea0 con 0x7f7d380b22b0 2023-11-24T08:06:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7ffa79ae7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7415d840 con 0x7ffa7406e380 2023-11-24T08:06:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7ffa79ae7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa74072190 con 0x7ffa7415d460 2023-11-24T08:06:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7ffa79ae7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa74071490 con 0x7ffa740b30b0 2023-11-24T08:06:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7ffa73fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffa7406e380 0x7ffa7406d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43470/0 (socket says 172.21.15.97:43470) 2023-11-24T08:06:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7ffa73fff640 1 -- 172.21.15.97:0/1106799964 learned_addr learned my addr 172.21.15.97:0/1106799964 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7ffa72ffd640 1 --2- 172.21.15.97:0/1106799964 >> v2:172.21.15.183:3300/0 conn(0x7ffa740b30b0 0x7ffa740ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64b001d3b0 con 0x7f64b80b29a0 2023-11-24T08:06:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380cc7b0 con 0x7f7d380b22b0 2023-11-24T08:06:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7ffa72ffd640 1 -- 172.21.15.97:0/1106799964 >> v1:172.21.15.183:6789/0 conn(0x7ffa7415d460 legacy=0x7ffa740b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7ffa72ffd640 1 -- 172.21.15.97:0/1106799964 >> v1:172.21.15.97:6789/0 conn(0x7ffa7406e380 legacy=0x7ffa7406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7ffa72ffd640 1 -- 172.21.15.97:0/1106799964 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74072470 con 0x7ffa740b30b0 2023-11-24T08:06:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7ffa727fc640 1 -- 172.21.15.97:0/1106799964 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051214103 0 0) 0x7ffa74072190 con 0x7ffa7415d460 2023-11-24T08:06:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d380b69e0 con 0x7f7d380b22b0 2023-11-24T08:06:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fe83e708640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe83004eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fe83e708640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe83003e800 0x7fe8300e2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fe83e708640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300e3080 0x7fe8300da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fe83e708640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83004f030 con 0x7fe8300e3080 2023-11-24T08:06:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fe83e708640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8300e1270 con 0x7fe8300078a0 2023-11-24T08:06:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fe83e708640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8300e1550 con 0x7fe83003e800 2023-11-24T08:06:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.233+0000 7fd505d61640 1 -- start start 2023-11-24T08:06:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fd505d61640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd500160f80 0x7fd500161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fd505d61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000ce8f0 0x7fd5000ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fd505d61640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd5000cfbe0 0x7fd5000d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.234+0000 7fd505d61640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5001618a0 con 0x7fd500160f80 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.235+0000 7fd505d61640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5000d0de0 con 0x7fd5000cfbe0 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.235+0000 7fd505d61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5000d10c0 con 0x7fd5000ce8f0 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.235+0000 7fd4feffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000ce8f0 0x7fd5000ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.235+0000 7fd4feffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000ce8f0 0x7fd5000ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36338/0 (socket says 172.21.15.97:36338) 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.235+0000 7fd4feffd640 1 -- 172.21.15.97:0/4103423243 learned_addr learned my addr 172.21.15.97:0/4103423243 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7fd4fffff640 1 --2- 172.21.15.97:0/4103423243 >> v2:172.21.15.183:3300/0 conn(0x7fd5000cfbe0 0x7fd5000d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7fd4ff7fe640 1 --2- 172.21.15.97:0/4103423243 >> v2:172.21.15.97:3300/0 conn(0x7fd500160f80 0x7fd500161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7f64adffb640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f649c06ae40 0x7f649c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b0089fb0 con 0x7f64b80b29a0 2023-11-24T08:06:49.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.235+0000 7fe837fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe83004eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7fe837fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe83004eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58450/0 (socket says 172.21.15.97:58450) 2023-11-24T08:06:49.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7fe837fff640 1 -- 172.21.15.97:0/204244138 learned_addr learned my addr 172.21.15.97:0/204244138 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7f64adffb640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7f649c073060 0x7f649c075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 --> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f649c075b30 con 0x7f649c073060 2023-11-24T08:06:49.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b008a360 con 0x7f64b80b29a0 2023-11-24T08:06:49.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7fe8377fe640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe83003e800 0x7fe8300e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.236+0000 7ffa72ffd640 1 --2- 172.21.15.97:0/1106799964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa740b30b0 0x7ffa740ac8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097a0 tx=0x7ffa6402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1419ae4ff39fa965 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7f64bda19640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7f649c073060 0x7f649c075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fe83cca5640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300e3080 0x7fe8300da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fd4feffd640 1 -- 172.21.15.97:0/4103423243 >> v2:172.21.15.183:3300/0 conn(0x7fd5000cfbe0 msgr2=0x7fd5000d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fd4feffd640 1 --2- 172.21.15.97:0/4103423243 >> v2:172.21.15.183:3300/0 conn(0x7fd5000cfbe0 0x7fd5000d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fd4feffd640 1 -- 172.21.15.97:0/4103423243 >> v2:172.21.15.97:3300/0 conn(0x7fd500160f80 msgr2=0x7fd500161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fd4feffd640 1 --2- 172.21.15.97:0/4103423243 >> v2:172.21.15.97:3300/0 conn(0x7fd500160f80 0x7fd500161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fd4feffd640 1 -- 172.21.15.97:0/4103423243 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5000d13a0 con 0x7fd5000ce8f0 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fe837fff640 1 -- 172.21.15.97:0/204244138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe83003e800 msgr2=0x7fe8300e2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fe837fff640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe83003e800 0x7fe8300e2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fe837fff640 1 -- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300e3080 msgr2=0x7fe8300da7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fe837fff640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300e3080 0x7fe8300da7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.237+0000 7fe837fff640 1 -- 172.21.15.97:0/204244138 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83804f090 con 0x7fe8300078a0 2023-11-24T08:06:49.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.238+0000 7f64bda19640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7f649c073060 0x7f649c075480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.238+0000 7fe83cca5640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300e3080 0x7fe8300da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:49.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.238+0000 7f64bca17640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f649c06ae40 0x7f649c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.238+0000 7fe837fff640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe83004eaf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b410 tx=0x7fe82400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7ffa727fc640 1 -- 172.21.15.97:0/1106799964 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64031640 con 0x7ffa740b30b0 2023-11-24T08:06:49.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7ffa727fc640 1 -- 172.21.15.97:0/1106799964 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa640317a0 con 0x7ffa740b30b0 2023-11-24T08:06:49.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7ffa727fc640 1 -- 172.21.15.97:0/1106799964 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64031b30 con 0x7ffa740b30b0 2023-11-24T08:06:49.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824011830 con 0x7fe8300078a0 2023-11-24T08:06:49.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe824011990 con 0x7fe8300078a0 2023-11-24T08:06:49.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824011dc0 con 0x7fe8300078a0 2023-11-24T08:06:49.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== osd.0 v2:172.21.15.97:6808/1087850663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f649c075b30 con 0x7f649c073060 2023-11-24T08:06:49.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7f64bca17640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f649c06ae40 0x7f649c06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64b4036000 tx=0x7f64b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8300e1830 con 0x7fe8300078a0 2023-11-24T08:06:49.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.239+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8300e1df0 con 0x7fe8300078a0 2023-11-24T08:06:49.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.240+0000 7fd4feffd640 1 --2- 172.21.15.97:0/4103423243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000ce8f0 0x7fd5000ced50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd5000c6a40 tx=0x7fd4f002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5258f8c5d506964d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.240+0000 7ffa79ae7640 1 -- 172.21.15.97:0/1106799964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa740b30b0 msgr2=0x7ffa740ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.240+0000 7ffa79ae7640 1 --2- 172.21.15.97:0/1106799964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa740b30b0 0x7ffa740ac8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097a0 tx=0x7ffa6402b8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.240+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d30004240 con 0x7f7d380b22b0 2023-11-24T08:06:49.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.240+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d380d4080 con 0x7f7d380b22b0 2023-11-24T08:06:49.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe818000fc0 con 0x7fe8300078a0 2023-11-24T08:06:49.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7fd4fe7fc640 1 -- 172.21.15.97:0/4103423243 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0031870 con 0x7fd5000ce8f0 2023-11-24T08:06:49.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7fd4fe7fc640 1 -- 172.21.15.97:0/4103423243 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f00319d0 con 0x7fd5000ce8f0 2023-11-24T08:06:49.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7fd4fe7fc640 1 -- 172.21.15.97:0/4103423243 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0031d60 con 0x7fd5000ce8f0 2023-11-24T08:06:49.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7ffa79ae7640 1 -- 172.21.15.97:0/1106799964 shutdown_connections 2023-11-24T08:06:49.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7f7d1f7fe640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7d2406ae40 0x7f7d2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7ffa79ae7640 1 --2- 172.21.15.97:0/1106799964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa740b30b0 0x7ffa740ac8d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7ffa79ae7640 1 -- 172.21.15.97:0/1106799964 >> 172.21.15.97:0/1106799964 conn(0x7ffa740b0be0 msgr2=0x7ffa740b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.241+0000 7ffa79ae7640 1 -- 172.21.15.97:0/1106799964 shutdown_connections 2023-11-24T08:06:49.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d30012070 con 0x7f7d380b22b0 2023-11-24T08:06:49.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7fd505d61640 1 -- 172.21.15.97:0/4103423243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000ce8f0 msgr2=0x7fd5000ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7fd505d61640 1 --2- 172.21.15.97:0/4103423243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000ce8f0 0x7fd5000ced50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd5000c6a40 tx=0x7fd4f002b910 comp rx=0 tx=0).stop 2023-11-24T08:06:49.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7f7d1f7fe640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f7d24072fe0 0x7f7d24075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7fd505d61640 1 -- 172.21.15.97:0/4103423243 shutdown_connections 2023-11-24T08:06:49.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7fd505d61640 1 --2- 172.21.15.97:0/4103423243 >> v2:172.21.15.183:3300/0 conn(0x7fd5000cfbe0 0x7fd5000d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7fd505d61640 1 --2- 172.21.15.97:0/4103423243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000ce8f0 0x7fd5000ced50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7fd505d61640 1 --2- 172.21.15.97:0/4103423243 >> v2:172.21.15.97:3300/0 conn(0x7fd500160f80 0x7fd500161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7fd505d61640 1 -- 172.21.15.97:0/4103423243 >> 172.21.15.97:0/4103423243 conn(0x7fd50009c550 msgr2=0x7fd5000d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 --> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d24075ab0 con 0x7f7d24072fe0 2023-11-24T08:06:49.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d3008c4d0 con 0x7f7d380b22b0 2023-11-24T08:06:49.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.242+0000 7f7d367fc640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7d2406ae40 0x7f7d2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.243+0000 7ffa79ae7640 1 -- 172.21.15.97:0/1106799964 wait complete. 2023-11-24T08:06:49.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.243+0000 7fd505d61640 1 -- 172.21.15.97:0/4103423243 shutdown_connections 2023-11-24T08:06:49.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.243+0000 7f7d377fe640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f7d24072fe0 0x7f7d24075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.244+0000 7f7d367fc640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7d2406ae40 0x7f7d2406d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d380b91d0 tx=0x7f7d2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.244+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe82401a400 con 0x7fe8300078a0 2023-11-24T08:06:49.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.244+0000 7f7d377fe640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f7d24072fe0 0x7f7d24075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.244+0000 7f85304bb640 1 Processor -- start 2023-11-24T08:06:49.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.243+0000 7fd505d61640 1 -- 172.21.15.97:0/4103423243 wait complete. 2023-11-24T08:06:49.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.245+0000 7f85304bb640 1 -- start start 2023-11-24T08:06:49.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.246+0000 7ffa79ae7640 1 Processor -- start 2023-11-24T08:06:49.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.246+0000 7ffa79ae7640 1 -- start start 2023-11-24T08:06:49.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.246+0000 7fd505d61640 1 Processor -- start 2023-11-24T08:06:49.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.247+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== osd.1 v2:172.21.15.97:6800/2437632405 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7d24075ab0 con 0x7f7d24072fe0 2023-11-24T08:06:49.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.246+0000 7fe834ff9640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe81c06af10 0x7fe81c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.246+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe824089da0 con 0x7fe8300078a0 2023-11-24T08:06:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.247+0000 7fe834ff9640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7fe81c073130 0x7fe81c075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.247+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 --> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe81c075c00 con 0x7fe81c073130 2023-11-24T08:06:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.247+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe82408a150 con 0x7fe8300078a0 2023-11-24T08:06:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.247+0000 7fe8377fe640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe81c06af10 0x7fe81c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.246+0000 7fd505d61640 1 -- start start 2023-11-24T08:06:49.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.247+0000 7f85304bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85281598d0 0x7f85280cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7fe83cca5640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7fe81c073130 0x7fe81c075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7fd505d61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5000ce8f0 0x7fd5000c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7fd505d61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000cfbe0 0x7fd5000c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7f85304bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8528159e20 con 0x7f8528153a50 2023-11-24T08:06:49.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7ffa79ae7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa7406e380 0x7ffa7415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7fd505d61640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd500160f80 0x7fd5000c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7ffa79ae7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa740b30b0 0x7ffa74151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7ffa79ae7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa7415d460 0x7ffa7415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7f85304bb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852815a100 con 0x7f85280cf900 2023-11-24T08:06:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7fd505d61640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5000b8980 con 0x7fd500160f80 2023-11-24T08:06:49.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd505d61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5001586b0 con 0x7fd5000ce8f0 2023-11-24T08:06:49.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7ffa72ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa740b30b0 0x7ffa74151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd505d61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5000b9120 con 0x7fd5000cfbe0 2023-11-24T08:06:49.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7ffa79ae7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa74151ff0 con 0x7ffa740b30b0 2023-11-24T08:06:49.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7ffa72ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa740b30b0 0x7ffa74151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57006/0 (socket says 172.21.15.97:57006) 2023-11-24T08:06:49.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7ffa79ae7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741f8450 con 0x7ffa7415d460 2023-11-24T08:06:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4fffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd500160f80 0x7fd5000c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4fffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd500160f80 0x7fd5000c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56998/0 (socket says 172.21.15.97:56998) 2023-11-24T08:06:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4fffff640 1 -- 172.21.15.97:0/3451396720 learned_addr learned my addr 172.21.15.97:0/3451396720 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7ffa79ae7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa74153bd0 con 0x7ffa7406e380 2023-11-24T08:06:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7ffa72ffd640 1 -- 172.21.15.97:0/2393228629 learned_addr learned my addr 172.21.15.97:0/2393228629 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4feffd640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000cfbe0 0x7fd5000c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7fe8377fe640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe81c06af10 0x7fe81c06d3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe82c007fd0 tx=0x7fe82c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7ffa737fe640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa7406e380 0x7ffa7415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7f85304bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8528153e30 con 0x7f85281598d0 2023-11-24T08:06:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7f852ea58640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f85280cf900 0x7f8528070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50844/0 (socket says 172.21.15.97:50844) 2023-11-24T08:06:49.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7f852ea58640 1 -- 172.21.15.97:0/3249612113 learned_addr learned my addr 172.21.15.97:0/3249612113 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:49.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.248+0000 7f852da56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85281598d0 0x7f85280cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4ff7fe640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5000ce8f0 0x7fd5000c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4fffff640 1 -- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000cfbe0 msgr2=0x7fd5000c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4fffff640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5000cfbe0 0x7fd5000c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fd4fffff640 1 -- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5000ce8f0 msgr2=0x7fd5000c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.249+0000 7fe83cca5640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7fe81c073130 0x7fe81c075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7ffa73fff640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa7415d460 0x7ffa7415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7fd4fffff640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5000ce8f0 0x7fd5000c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7fd4fffff640 1 -- 172.21.15.97:0/3451396720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f00094d0 con 0x7fd500160f80 2023-11-24T08:06:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7fd4ff7fe640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5000ce8f0 0x7fd5000c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:49.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7f852da56640 1 -- 172.21.15.97:0/3249612113 >> v1:172.21.15.183:6789/0 conn(0x7f85280cf900 legacy=0x7f8528070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7f852da56640 1 -- 172.21.15.97:0/3249612113 >> v1:172.21.15.97:6789/0 conn(0x7f8528153a50 legacy=0x7f85280b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7f852da56640 1 -- 172.21.15.97:0/3249612113 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852815a3e0 con 0x7f85281598d0 2023-11-24T08:06:49.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== osd.2 v2:172.21.15.97:6816/2868474403 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe81c075c00 con 0x7fe81c073130 2023-11-24T08:06:49.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7ffa72ffd640 1 -- 172.21.15.97:0/2393228629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa7406e380 msgr2=0x7ffa7415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7ffa72ffd640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa7406e380 0x7ffa7415c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7ffa72ffd640 1 -- 172.21.15.97:0/2393228629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa7415d460 msgr2=0x7ffa7415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7ffa72ffd640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa7415d460 0x7ffa7415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7ffa72ffd640 1 -- 172.21.15.97:0/2393228629 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009400 con 0x7ffa740b30b0 2023-11-24T08:06:49.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7ffa72ffd640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa740b30b0 0x7ffa74151ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa6402bf00 tx=0x7ffa640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.250+0000 7fd4fffff640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd500160f80 0x7fd5000c9710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400e830 tx=0x7fd4f400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4009610 con 0x7fd500160f80 2023-11-24T08:06:49.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400c940 con 0x7fd500160f80 2023-11-24T08:06:49.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400ccf0 con 0x7fd500160f80 2023-11-24T08:06:49.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.252+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6403bc70 con 0x7ffa740b30b0 2023-11-24T08:06:49.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7fd505d61640 1 -- 172.21.15.97:0/3451396720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5000c9c50 con 0x7fd500160f80 2023-11-24T08:06:49.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.251+0000 7fd505d61640 1 -- 172.21.15.97:0/3451396720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5000b8e40 con 0x7fd500160f80 2023-11-24T08:06:49.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.252+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6403bdd0 con 0x7ffa740b30b0 2023-11-24T08:06:49.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.253+0000 7f6f83c1e640 1 Processor -- start 2023-11-24T08:06:49.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.253+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64043630 con 0x7ffa740b30b0 2023-11-24T08:06:49.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.253+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa741f78d0 con 0x7ffa740b30b0 2023-11-24T08:06:49.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.253+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa741f7e90 con 0x7ffa740b30b0 2023-11-24T08:06:49.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.253+0000 7f6f83c1e640 1 -- start start 2023-11-24T08:06:49.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.253+0000 7f852da56640 1 --2- 172.21.15.97:0/3249612113 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85281598d0 0x7f85280cf3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85240097d0 tx=0x7f852402b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b778246b86e118 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.255+0000 7f852d255640 1 -- 172.21.15.97:0/3249612113 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852402f810 con 0x7f85281598d0 2023-11-24T08:06:49.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.255+0000 7f46d0e3d640 1 Processor -- start 2023-11-24T08:06:49.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.254+0000 7fd505d61640 1 -- 172.21.15.97:0/3451396720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4e0000fc0 con 0x7fd500160f80 2023-11-24T08:06:49.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.255+0000 7f852d255640 1 -- 172.21.15.97:0/3249612113 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852402f970 con 0x7f85281598d0 2023-11-24T08:06:49.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.255+0000 7f852d255640 1 -- 172.21.15.97:0/3249612113 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852402fce0 con 0x7f85281598d0 2023-11-24T08:06:49.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.256+0000 7f46d0e3d640 1 -- start start 2023-11-24T08:06:49.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.256+0000 7f6f83c1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.256+0000 7f85304bb640 1 -- 172.21.15.97:0/3249612113 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85281598d0 msgr2=0x7f85280cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.256+0000 7f85304bb640 1 --2- 172.21.15.97:0/3249612113 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85281598d0 0x7f85280cf3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85240097d0 tx=0x7f852402b9f0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.256+0000 7f6f83c1e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c153d30 con 0x7f6f7c15ce90 2023-11-24T08:06:49.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f6f83c1e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c0b2b70 con 0x7f6f7c06d480 2023-11-24T08:06:49.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f6f83c1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c0b2e50 con 0x7f6f7c153950 2023-11-24T08:06:49.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f6f819ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f6f819ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c0cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36394/0 (socket says 172.21.15.97:36394) 2023-11-24T08:06:49.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f6f819ba640 1 -- 172.21.15.97:0/2976962973 learned_addr learned my addr 172.21.15.97:0/2976962973 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa74071140 con 0x7ffa740b30b0 2023-11-24T08:06:49.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f6f819ba640 1 -- 172.21.15.97:0/2976962973 >> v1:172.21.15.183:6789/0 conn(0x7f6f7c06d480 legacy=0x7f6f7c159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f6f819ba640 1 -- 172.21.15.97:0/2976962973 >> v1:172.21.15.97:6789/0 conn(0x7f6f7c15ce90 legacy=0x7f6f7c1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.258+0000 7f6f819ba640 1 -- 172.21.15.97:0/2976962973 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0b3130 con 0x7f6f7c153950 2023-11-24T08:06:49.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.258+0000 7f46d0e3d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46cc0b3ae0 0x7f46cc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.258+0000 7f46d0e3d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc070c40 con 0x7f46cc0ae5a0 2023-11-24T08:06:49.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.258+0000 7f46d0e3d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc06c470 con 0x7f46cc0cf290 2023-11-24T08:06:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.258+0000 7f46d0e3d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc071450 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f85304bb640 1 -- 172.21.15.97:0/3249612113 shutdown_connections 2023-11-24T08:06:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f85304bb640 1 --2- 172.21.15.97:0/3249612113 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85281598d0 0x7f85280cf3c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.259+0000 7f46ca59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f46cc0ae5a0 0x7f46cc06cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43510/0 (socket says 172.21.15.97:43510) 2023-11-24T08:06:49.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f85304bb640 1 -- 172.21.15.97:0/3249612113 >> 172.21.15.97:0/3249612113 conn(0x7f852806a800 msgr2=0x7f852806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f85304bb640 1 -- 172.21.15.97:0/3249612113 shutdown_connections 2023-11-24T08:06:49.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.257+0000 7f85304bb640 1 -- 172.21.15.97:0/3249612113 wait complete. 2023-11-24T08:06:49.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.259+0000 7f85304bb640 1 Processor -- start 2023-11-24T08:06:49.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.259+0000 7f46ca59c640 1 -- 172.21.15.97:0/3560379407 learned_addr learned my addr 172.21.15.97:0/3560379407 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:49.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.259+0000 7f85304bb640 1 -- start start 2023-11-24T08:06:49.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.259+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa6402f050 con 0x7ffa740b30b0 2023-11-24T08:06:49.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.260+0000 7f46c3fff640 1 --2- 172.21.15.97:0/3560379407 >> v2:172.21.15.97:3300/0 conn(0x7f46cc0b3ae0 0x7f46cc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.260+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4f4013470 con 0x7fd500160f80 2023-11-24T08:06:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.260+0000 7f6f819ba640 1 --2- 172.21.15.97:0/2976962973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c0cb0d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00d3a0 tx=0x7f6f6c02e360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c96a02f4782b5744 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f6f809b8640 1 -- 172.21.15.97:0/2976962973 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c038600 con 0x7f6f7c153950 2023-11-24T08:06:49.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7ffa5bfff640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffa6006ae90 0x7ffa6006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f6f809b8640 1 -- 172.21.15.97:0/2976962973 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c032070 con 0x7f6f7c153950 2023-11-24T08:06:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f85304bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85280cf900 0x7f8528143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f6f809b8640 1 -- 172.21.15.97:0/2976962973 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c038980 con 0x7f6f7c153950 2023-11-24T08:06:49.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f85304bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8528153a50 0x7f85280cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f85304bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85281598d0 0x7f8528158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f85304bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528143cd0 con 0x7f85280cf900 2023-11-24T08:06:49.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f85304bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528149910 con 0x7f85281598d0 2023-11-24T08:06:49.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f85304bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8528149bf0 con 0x7f8528153a50 2023-11-24T08:06:49.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f46c9d9b640 1 -- 172.21.15.97:0/3560379407 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788606726 0 0) 0x7f46cc070c40 con 0x7f46cc0ae5a0 2023-11-24T08:06:49.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f46c9d9b640 1 -- 172.21.15.97:0/3560379407 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b8003520 con 0x7f46cc0ae5a0 2023-11-24T08:06:49.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f46c9d9b640 1 -- 172.21.15.97:0/3560379407 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891816325 0 0) 0x7f46cc06c470 con 0x7f46cc0cf290 2023-11-24T08:06:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.261+0000 7f46c9d9b640 1 -- 172.21.15.97:0/3560379407 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46cc070c40 con 0x7f46cc0cf290 2023-11-24T08:06:49.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f852e257640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85280cf900 0x7f8528143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa640ab490 con 0x7ffa740b30b0 2023-11-24T08:06:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f852e257640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85280cf900 0x7f8528143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57022/0 (socket says 172.21.15.97:57022) 2023-11-24T08:06:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f852e257640 1 -- 172.21.15.97:0/523325160 learned_addr learned my addr 172.21.15.97:0/523325160 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f852ea58640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85281598d0 0x7f8528158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f6f83c1e640 1 -- 172.21.15.97:0/2976962973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 msgr2=0x7f6f7c0cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f6f83c1e640 1 --2- 172.21.15.97:0/2976962973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c0cb0d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00d3a0 tx=0x7f6f6c02e360 comp rx=0 tx=0).stop 2023-11-24T08:06:49.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7ffa5bfff640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7ffa600730b0 0x7ffa600754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 --> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa60075b80 con 0x7ffa600730b0 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa640ada70 con 0x7ffa740b30b0 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7ffa737fe640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffa6006ae90 0x7ffa6006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f852da56640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8528153a50 0x7f85280cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f6f83c1e640 1 -- 172.21.15.97:0/2976962973 shutdown_connections 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f6f83c1e640 1 --2- 172.21.15.97:0/2976962973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c0cb0d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f6f83c1e640 1 -- 172.21.15.97:0/2976962973 >> 172.21.15.97:0/2976962973 conn(0x7f6f7c0b0be0 msgr2=0x7f6f7c0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7ffa73fff640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7ffa600730b0 0x7ffa600754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f852e257640 1 -- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8528153a50 msgr2=0x7f85280cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f852e257640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8528153a50 0x7f85280cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f852e257640 1 -- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85281598d0 msgr2=0x7f8528158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f852e257640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85281598d0 0x7f8528158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f852e257640 1 -- 172.21.15.97:0/523325160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524009400 con 0x7f85280cf900 2023-11-24T08:06:49.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f46c3fff640 1 -- 172.21.15.97:0/3560379407 >> v1:172.21.15.183:6789/0 conn(0x7f46cc0cf290 legacy=0x7f46cc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f46c3fff640 1 -- 172.21.15.97:0/3560379407 >> v1:172.21.15.97:6789/0 conn(0x7f46cc0ae5a0 legacy=0x7f46cc06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.262+0000 7f46c3fff640 1 -- 172.21.15.97:0/3560379407 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc06c750 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f852da56640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8528153a50 0x7f85280cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:49.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.263+0000 7f6f83c1e640 1 -- 172.21.15.97:0/2976962973 shutdown_connections 2023-11-24T08:06:49.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.264+0000 7ffa73fff640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7ffa600730b0 0x7ffa600754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.264+0000 7f6f83c1e640 1 -- 172.21.15.97:0/2976962973 wait complete. 2023-11-24T08:06:49.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.264+0000 7f852e257640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85280cf900 0x7f8528143790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f852000c7a0 tx=0x7f852000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.265+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520003b90 con 0x7f85280cf900 2023-11-24T08:06:49.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.265+0000 7ffa737fe640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffa6006ae90 0x7ffa6006d350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0012e0 tx=0x7ffa6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.265+0000 7f46c3fff640 1 --2- 172.21.15.97:0/3560379407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 0x7f46cc15e430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46b40097a0 tx=0x7f46b402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898d1d8478e7ae70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.265+0000 7fd4e7fff640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd4ec06af10 0x7fd4ec06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.265+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520003d10 con 0x7f85280cf900 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.265+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000aa90 con 0x7f85280cf900 2023-11-24T08:06:49.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7f46c9d9b640 1 -- 172.21.15.97:0/3560379407 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b402f840 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== osd.3 v2:172.21.15.97:6824/1194273011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffa60075b80 con 0x7ffa600730b0 2023-11-24T08:06:49.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7f46c9d9b640 1 -- 172.21.15.97:0/3560379407 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b402f9a0 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7f46c9d9b640 1 -- 172.21.15.97:0/3560379407 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b402fd70 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.265+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4f4089750 con 0x7fd500160f80 2023-11-24T08:06:49.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7fd4e7fff640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7fd4ec073130 0x7fd4ec075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 --> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4ec075c00 con 0x7fd4ec073130 2023-11-24T08:06:49.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4f408bd70 con 0x7fd500160f80 2023-11-24T08:06:49.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.266+0000 7fd4ff7fe640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd4ec06af10 0x7fd4ec06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.267+0000 7f46d0e3d640 1 -- 172.21.15.97:0/3560379407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 msgr2=0x7f46cc15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.267+0000 7f46d0e3d640 1 --2- 172.21.15.97:0/3560379407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 0x7f46cc15e430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46b40097a0 tx=0x7f46b402ba20 comp rx=0 tx=0).stop 2023-11-24T08:06:49.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.267+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8528149ed0 con 0x7f85280cf900 2023-11-24T08:06:49.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.267+0000 7fd4ff7fe640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd4ec06af10 0x7fd4ec06d3d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007eb0 tx=0x7fd4f8007400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.268+0000 7fd4feffd640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7fd4ec073130 0x7fd4ec075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.268+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8528149480 con 0x7f85280cf900 2023-11-24T08:06:49.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.269+0000 7f6f83c1e640 1 Processor -- start 2023-11-24T08:06:49.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.269+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85280cfd70 con 0x7f85280cf900 2023-11-24T08:06:49.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.269+0000 7f6f83c1e640 1 -- start start 2023-11-24T08:06:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.269+0000 7f46d0e3d640 1 -- 172.21.15.97:0/3560379407 shutdown_connections 2023-11-24T08:06:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.269+0000 7f46d0e3d640 1 --2- 172.21.15.97:0/3560379407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 0x7f46cc15e430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.269+0000 7f46d0e3d640 1 -- 172.21.15.97:0/3560379407 >> 172.21.15.97:0/3560379407 conn(0x7f46cc06a800 msgr2=0x7f46cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.270+0000 7f46d0e3d640 1 -- 172.21.15.97:0/3560379407 shutdown_connections 2023-11-24T08:06:49.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.270+0000 7f46d0e3d640 1 -- 172.21.15.97:0/3560379407 wait complete. 2023-11-24T08:06:49.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.270+0000 7f6f83c1e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7c06d480 0x7f6f7c154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.270+0000 7f6f83c1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c1456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.270+0000 7f6f83c1e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7c15ce90 0x7f6f7c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.271+0000 7f6f83c1e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c156dd0 con 0x7f6f7c15ce90 2023-11-24T08:06:49.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.271+0000 7f6f83c1e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1554b0 con 0x7f6f7c06d480 2023-11-24T08:06:49.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.271+0000 7f6f83c1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c153f60 con 0x7f6f7c153950 2023-11-24T08:06:49.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.271+0000 7f6f821bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7c15ce90 0x7f6f7c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.271+0000 7f6f821bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7c15ce90 0x7f6f7c0ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57036/0 (socket says 172.21.15.97:57036) 2023-11-24T08:06:49.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.271+0000 7f6f821bb640 1 -- 172.21.15.97:0/187071061 learned_addr learned my addr 172.21.15.97:0/187071061 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.272+0000 7f6f819ba640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7c06d480 0x7f6f7c154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.272+0000 7f6f811b9640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c1456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.273+0000 7f6f821bb640 1 -- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 msgr2=0x7f6f7c1456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.273+0000 7f6f821bb640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7c153950 0x7f6f7c1456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.273+0000 7f6f821bb640 1 -- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7c06d480 msgr2=0x7f6f7c154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.273+0000 7f6f821bb640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7c06d480 0x7f6f7c154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.273+0000 7f6f821bb640 1 -- 172.21.15.97:0/187071061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c00d050 con 0x7f6f7c15ce90 2023-11-24T08:06:49.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.274+0000 7fd4feffd640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7fd4ec073130 0x7fd4ec075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.273+0000 7f6f821bb640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7c15ce90 0x7f6f7c0ad260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c3d0 tx=0x7f6f7400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.274+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f740052d0 con 0x7f6f7c15ce90 2023-11-24T08:06:49.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.274+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74005430 con 0x7f6f7c15ce90 2023-11-24T08:06:49.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.274+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74003830 con 0x7f6f7c15ce90 2023-11-24T08:06:49.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.274+0000 7f46d0e3d640 1 Processor -- start 2023-11-24T08:06:49.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.273+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f852000abf0 con 0x7f85280cf900 2023-11-24T08:06:49.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.274+0000 7f46d0e3d640 1 -- start start 2023-11-24T08:06:49.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f851effd640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f850c06aec0 0x7f850c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 --> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64b80709d0 con 0x7f649c073060 2023-11-24T08:06:49.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f64adffb640 1 -- 172.21.15.97:0/3323569922 <== osd.0 v2:172.21.15.97:6808/1087850663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64b80709d0 con 0x7f649c073060 2023-11-24T08:06:49.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 --> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d380ce310 con 0x7f7d24072fe0 2023-11-24T08:06:49.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== osd.4 v2:172.21.15.183:6800/1731286381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd4ec075c00 con 0x7fd4ec073130 2023-11-24T08:06:49.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8520089d50 con 0x7f85280cf900 2023-11-24T08:06:49.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f851effd640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7f850c0730e0 0x7f850c075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 --> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f850c075bb0 con 0x7f850c0730e0 2023-11-24T08:06:49.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f852008a1f0 con 0x7f85280cf900 2023-11-24T08:06:49.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f852da56640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f850c06aec0 0x7f850c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f852ea58640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7f850c0730e0 0x7f850c075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f852da56640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f850c06aec0 0x7f850c06d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8524036000 tx=0x7f8524008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c1541b0 con 0x7f6f7c15ce90 2023-11-24T08:06:49.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.275+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c154770 con 0x7f6f7c15ce90 2023-11-24T08:06:49.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f7c15a6c0 con 0x7f6f7c15ce90 2023-11-24T08:06:49.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.277+0000 7f7d1f7fe640 1 -- 172.21.15.97:0/4276635578 <== osd.1 v2:172.21.15.97:6800/2437632405 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d280317f0 con 0x7f7d24072fe0 2023-11-24T08:06:49.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f46d0e3d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46cc0ae5a0 0x7f46cc14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f46d0e3d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 0x7f46cc160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f46d0e3d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46cc0cf290 0x7f46cc161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f46d0e3d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0ade50 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f46d0e3d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0ce780 con 0x7f46cc0ae5a0 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.276+0000 7f46d0e3d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc148470 con 0x7f46cc0cf290 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.277+0000 7f46cad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46cc0cf290 0x7f46cc161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.277+0000 7f46cad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46cc0cf290 0x7f46cc161470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36414/0 (socket says 172.21.15.97:36414) 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.277+0000 7f46cad9d640 1 -- 172.21.15.97:0/1398307773 learned_addr learned my addr 172.21.15.97:0/1398307773 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.277+0000 7f46ca59c640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46cc0ae5a0 0x7f46cc14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.277+0000 7f46c3fff640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 0x7f46cc160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.277+0000 7f852ea58640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7f850c0730e0 0x7f850c075500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f7d24072fe0 msgr2=0x7f7d24075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f7d24072fe0 0x7f7d24075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7d2406ae40 msgr2=0x7f7d2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7d2406ae40 0x7f7d2406d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d380b91d0 tx=0x7f7d2c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:49.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380b22b0 msgr2=0x7f7d38156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 --2- 172.21.15.97:0/4276635578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d380b22b0 0x7f7d38156da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000ce10 tx=0x7f7d3000a660 comp rx=0 tx=0).stop 2023-11-24T08:06:49.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d377fe640 1 -- 172.21.15.97:0/4276635578 reap_dead start 2023-11-24T08:06:49.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 shutdown_connections 2023-11-24T08:06:49.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.278+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 >> 172.21.15.97:0/4276635578 conn(0x7f7d3809c550 msgr2=0x7f7d380b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7f649c073060 msgr2=0x7f649c075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 shutdown_connections 2023-11-24T08:06:49.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f7d3d41c640 1 -- 172.21.15.97:0/4276635578 wait complete. 2023-11-24T08:06:49.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f74003990 con 0x7f6f7c15ce90 2023-11-24T08:06:49.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f46c3fff640 1 -- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46cc0cf290 msgr2=0x7f46cc161470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f46c3fff640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46cc0cf290 0x7f46cc161470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f46c3fff640 1 -- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46cc0ae5a0 msgr2=0x7f46cc14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f46c3fff640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46cc0ae5a0 0x7f46cc14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f64bf47c640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7f649c073060 0x7f649c075480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f649c06ae40 msgr2=0x7f649c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f64bf47c640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f649c06ae40 0x7f649c06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64b4036000 tx=0x7f64b4008030 comp rx=0 tx=0).stop 2023-11-24T08:06:49.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f46c3fff640 1 -- 172.21.15.97:0/1398307773 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009400 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64b80b29a0 msgr2=0x7f64b820b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.279+0000 7f64bf47c640 1 --2- 172.21.15.97:0/3323569922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64b80b29a0 0x7f64b820b7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64b000be20 tx=0x7f64b0009f70 comp rx=0 tx=0).stop 2023-11-24T08:06:49.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.280+0000 7f64bda19640 1 -- 172.21.15.97:0/3323569922 reap_dead start 2023-11-24T08:06:49.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.280+0000 7f46c3fff640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 0x7f46cc160f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f46b4033000 tx=0x7f46b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.280+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 shutdown_connections 2023-11-24T08:06:49.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.280+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 >> 172.21.15.97:0/3323569922 conn(0x7f64b80b0be0 msgr2=0x7f64b80aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.280+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 shutdown_connections 2023-11-24T08:06:49.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.280+0000 7f64bf47c640 1 -- 172.21.15.97:0/3323569922 wait complete. 2023-11-24T08:06:49.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 --> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe818002cb0 con 0x7fe81c073130 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b403b040 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4037be0 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc14b370 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.280+0000 7f6f7a7fc640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6f6806ae90 0x7f6f6806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f740894e0 con 0x7f6f7c15ce90 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f6f819ba640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6f6806ae90 0x7f6f6806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f6f7a7fc640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7f6f680730b0 0x7f6f680754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 --> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f68075b80 con 0x7f6f680730b0 2023-11-24T08:06:49.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f74089980 con 0x7f6f7c15ce90 2023-11-24T08:06:49.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.282+0000 7fe834ff9640 1 -- 172.21.15.97:0/204244138 <== osd.2 v2:172.21.15.97:6816/2868474403 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe818002cb0 con 0x7fe81c073130 2023-11-24T08:06:49.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc156710 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.281+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4042480 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.282+0000 7f6f819ba640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6f6806ae90 0x7f6f6806d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c039000 tx=0x7f6f6c00a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.282+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46b0000fc0 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.282+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== osd.5 v2:172.21.15.183:6816/3585625163 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f850c075bb0 con 0x7f850c0730e0 2023-11-24T08:06:49.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.282+0000 7f6f811b9640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7f6f680730b0 0x7f6f680754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.283+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7fe81c073130 msgr2=0x7fe81c075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.283+0000 7fe83e708640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7fe81c073130 0x7fe81c075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.283+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe81c06af10 msgr2=0x7fe81c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.283+0000 7fe83e708640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe81c06af10 0x7fe81c06d3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe82c007fd0 tx=0x7fe82c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.283+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 msgr2=0x7fe83004eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.283+0000 7fe83e708640 1 --2- 172.21.15.97:0/204244138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8300078a0 0x7fe83004eaf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b410 tx=0x7fe82400b8d0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.283+0000 7fe83cca5640 1 -- 172.21.15.97:0/204244138 reap_dead start 2023-11-24T08:06:49.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.284+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46b40425e0 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.285+0000 7f6f811b9640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7f6f680730b0 0x7f6f680754d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.285+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 shutdown_connections 2023-11-24T08:06:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.285+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 >> 172.21.15.97:0/204244138 conn(0x7fe8300559a0 msgr2=0x7fe830053960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.285+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 shutdown_connections 2023-11-24T08:06:49.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.285+0000 7fe83e708640 1 -- 172.21.15.97:0/204244138 wait complete. 2023-11-24T08:06:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.286+0000 7f46c2ffd640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f46ac06ae90 0x7f46ac06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.286+0000 7f46ca59c640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f46ac06ae90 0x7f46ac06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.286+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46b40ac530 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.287+0000 7f46c2ffd640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7f46ac0730b0 0x7f46ac0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.287+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 --> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46ac075b80 con 0x7f46ac0730b0 2023-11-24T08:06:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.287+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46b40ac9d0 con 0x7f46cc0b3ae0 2023-11-24T08:06:49.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.287+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== osd.7 v2:172.21.15.183:6808/1489077381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6f68075b80 con 0x7f6f680730b0 2023-11-24T08:06:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.287+0000 7f46cad9d640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7f46ac0730b0 0x7f46ac0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.288+0000 7f46ca59c640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f46ac06ae90 0x7f46ac06d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0011e0 tx=0x7f46bc007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.288+0000 7f46cad9d640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7f46ac0730b0 0x7f46ac0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.291+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== osd.6 v2:172.21.15.183:6818/553932600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f46ac075b80 con 0x7f46ac0730b0 2023-11-24T08:06:49.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.292+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 --> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa740675d0 con 0x7ffa600730b0 2023-11-24T08:06:49.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.292+0000 7ffa5bfff640 1 -- 172.21.15.97:0/2393228629 <== osd.3 v2:172.21.15.97:6824/1194273011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa740675d0 con 0x7ffa600730b0 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.293+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7ffa600730b0 msgr2=0x7ffa600754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.293+0000 7ffa79ae7640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7ffa600730b0 0x7ffa600754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.296+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffa6006ae90 msgr2=0x7ffa6006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.296+0000 7ffa79ae7640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ffa6006ae90 0x7ffa6006d350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0012e0 tx=0x7ffa6c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.296+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa740b30b0 msgr2=0x7ffa74151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.296+0000 7ffa79ae7640 1 --2- 172.21.15.97:0/2393228629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa740b30b0 0x7ffa74151ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa6402bf00 tx=0x7ffa640046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.296+0000 7ffa73fff640 1 -- 172.21.15.97:0/2393228629 reap_dead start 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.296+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 shutdown_connections 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.296+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 >> 172.21.15.97:0/2393228629 conn(0x7ffa740b0be0 msgr2=0x7ffa740ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.298+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 shutdown_connections 2023-11-24T08:06:49.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.298+0000 7ffa79ae7640 1 -- 172.21.15.97:0/2393228629 wait complete. 2023-11-24T08:06:49.358 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2023-11-24T08:06:49.359 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:06:49.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.307+0000 7fd505d61640 1 -- 172.21.15.97:0/3451396720 --> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4e0002cb0 con 0x7fd4ec073130 2023-11-24T08:06:49.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.308+0000 7fd4e7fff640 1 -- 172.21.15.97:0/3451396720 <== osd.4 v2:172.21.15.183:6800/1731286381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4e0002cb0 con 0x7fd4ec073130 2023-11-24T08:06:49.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.309+0000 7fd4e5ffb640 1 -- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7fd4ec073130 msgr2=0x7fd4ec075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.310+0000 7fd4e5ffb640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7fd4ec073130 0x7fd4ec075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.360 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2023-11-24T08:06:49.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:06:49.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.310+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 --> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8528149d60 con 0x7f850c0730e0 2023-11-24T08:06:49.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.310+0000 7fd4e5ffb640 1 -- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd4ec06af10 msgr2=0x7fd4ec06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.310+0000 7fd4e5ffb640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd4ec06af10 0x7fd4ec06d3d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007eb0 tx=0x7fd4f8007400 comp rx=0 tx=0).stop 2023-11-24T08:06:49.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.310+0000 7fd4e5ffb640 1 -- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd500160f80 msgr2=0x7fd5000c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.310+0000 7fd4e5ffb640 1 --2- 172.21.15.97:0/3451396720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd500160f80 0x7fd5000c9710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400e830 tx=0x7fd4f400ecf0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.310+0000 7fd4fffff640 1 -- 172.21.15.97:0/3451396720 reap_dead start 2023-11-24T08:06:49.362 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2023-11-24T08:06:49.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:06:49.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.313+0000 7fd4e5ffb640 1 -- 172.21.15.97:0/3451396720 shutdown_connections 2023-11-24T08:06:49.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.313+0000 7fd4e5ffb640 1 -- 172.21.15.97:0/3451396720 >> 172.21.15.97:0/3451396720 conn(0x7fd50009c550 msgr2=0x7fd5000cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.313+0000 7fd4e5ffb640 1 -- 172.21.15.97:0/3451396720 shutdown_connections 2023-11-24T08:06:49.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.313+0000 7fd4e5ffb640 1 -- 172.21.15.97:0/3451396720 wait complete. 2023-11-24T08:06:49.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.314+0000 7f851effd640 1 -- 172.21.15.97:0/523325160 <== osd.5 v2:172.21.15.183:6816/3585625163 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8528149d60 con 0x7f850c0730e0 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.314+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7f850c0730e0 msgr2=0x7f850c075500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7f850c0730e0 0x7f850c075500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f850c06aec0 msgr2=0x7f850c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f850c06aec0 0x7f850c06d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8524036000 tx=0x7f8524008030 comp rx=0 tx=0).stop 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85280cf900 msgr2=0x7f8528143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 --2- 172.21.15.97:0/523325160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85280cf900 0x7f8528143790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f852000c7a0 tx=0x7f852000cc60 comp rx=0 tx=0).stop 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f852ea58640 1 -- 172.21.15.97:0/523325160 reap_dead start 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 shutdown_connections 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 >> 172.21.15.97:0/523325160 conn(0x7f852806a800 msgr2=0x7f8528071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 shutdown_connections 2023-11-24T08:06:49.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.315+0000 7f85304bb640 1 -- 172.21.15.97:0/523325160 wait complete. 2023-11-24T08:06:49.366 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:49.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:06:49.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.323+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 --> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f7c0b36f0 con 0x7f6f680730b0 2023-11-24T08:06:49.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.324+0000 7f6f7a7fc640 1 -- 172.21.15.97:0/187071061 <== osd.7 v2:172.21.15.183:6808/1489077381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f700012c0 con 0x7f6f680730b0 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7f6f680730b0 msgr2=0x7f6f680754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7f6f680730b0 0x7f6f680754d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6f6806ae90 msgr2=0x7f6f6806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6f6806ae90 0x7f6f6806d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c039000 tx=0x7f6f6c00a040 comp rx=0 tx=0).stop 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7c15ce90 msgr2=0x7f6f7c0ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 --2- 172.21.15.97:0/187071061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f7c15ce90 0x7f6f7c0ad260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c3d0 tx=0x7f6f7400c890 comp rx=0 tx=0).stop 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f821bb640 1 -- 172.21.15.97:0/187071061 reap_dead start 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 shutdown_connections 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 >> 172.21.15.97:0/187071061 conn(0x7f6f7c0b0be0 msgr2=0x7f6f7c0702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 shutdown_connections 2023-11-24T08:06:49.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.325+0000 7f6f83c1e640 1 -- 172.21.15.97:0/187071061 wait complete. 2023-11-24T08:06:49.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.326+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 --> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46b0002cb0 con 0x7f46ac0730b0 2023-11-24T08:06:49.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.327+0000 7f46c2ffd640 1 -- 172.21.15.97:0/1398307773 <== osd.6 v2:172.21.15.183:6818/553932600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46b0002cb0 con 0x7f46ac0730b0 2023-11-24T08:06:49.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.327+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7f46ac0730b0 msgr2=0x7f46ac0754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.327+0000 7f46d0e3d640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7f46ac0730b0 0x7f46ac0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.327+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f46ac06ae90 msgr2=0x7f46ac06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.327+0000 7f46d0e3d640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f46ac06ae90 0x7f46ac06d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0011e0 tx=0x7f46bc007d30 comp rx=0 tx=0).stop 2023-11-24T08:06:49.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.328+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 msgr2=0x7f46cc160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.328+0000 7f46d0e3d640 1 --2- 172.21.15.97:0/1398307773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46cc0b3ae0 0x7f46cc160f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f46b4033000 tx=0x7f46b40046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.328+0000 7f46cad9d640 1 -- 172.21.15.97:0/1398307773 reap_dead start 2023-11-24T08:06:49.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.328+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 shutdown_connections 2023-11-24T08:06:49.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.328+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 >> 172.21.15.97:0/1398307773 conn(0x7f46cc06a800 msgr2=0x7f46cc0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.328+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 shutdown_connections 2023-11-24T08:06:49.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.328+0000 7f46d0e3d640 1 -- 172.21.15.97:0/1398307773 wait complete. 2023-11-24T08:06:49.371 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:49.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:06:49.372 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2023-11-24T08:06:49.373 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:06:49.373 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:49.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:06:49.374 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:49.375 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:06:49.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.697+0000 7fa69ae56640 1 Processor -- start 2023-11-24T08:06:49.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.697+0000 7fa69ae56640 1 -- start start 2023-11-24T08:06:49.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.699+0000 7fa69ae56640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa6941598d0 0x7fa6940cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.699+0000 7fa69ae56640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa6940cf900 0x7fa694070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.699+0000 7fa69ae56640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa694159e20 con 0x7fa694153a50 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.699+0000 7fa69ae56640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa694153e30 con 0x7fa6940cf900 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.699+0000 7fa69ae56640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6940b31c0 con 0x7fa6941598d0 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.700+0000 7fa693fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa6941598d0 0x7fa6940cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.700+0000 7fa693fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa6941598d0 0x7fa6940cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58520/0 (socket says 172.21.15.97:58520) 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.700+0000 7fa693fff640 1 -- 172.21.15.97:0/3118350730 learned_addr learned my addr 172.21.15.97:0/3118350730 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.700+0000 7fa6993f3640 1 --2- 172.21.15.97:0/3118350730 >> v2:172.21.15.97:3300/0 conn(0x7fa6940cf900 0x7fa694070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.699+0000 7fb17f271640 1 Processor -- start 2023-11-24T08:06:49.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.700+0000 7fb17f271640 1 -- start start 2023-11-24T08:06:49.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.701+0000 7fa693fff640 1 -- 172.21.15.97:0/3118350730 >> v2:172.21.15.97:3300/0 conn(0x7fa6940cf900 msgr2=0x7fa694070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.701+0000 7fa693fff640 1 --2- 172.21.15.97:0/3118350730 >> v2:172.21.15.97:3300/0 conn(0x7fa6940cf900 0x7fa694070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.701+0000 7fa693fff640 1 -- 172.21.15.97:0/3118350730 >> v1:172.21.15.97:6789/0 conn(0x7fa694153a50 legacy=0x7fa6940b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.701+0000 7fa693fff640 1 -- 172.21.15.97:0/3118350730 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69415a100 con 0x7fa6941598d0 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17f271640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb17815f1e0 0x7fb178070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17f271640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 0x7fb17806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17f271640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1780b2f10 0x7fb1780b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17f271640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17815f5c0 con 0x7fb1780b2f10 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17f271640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780b38a0 con 0x7fb17815f1e0 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17f271640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb178161b40 con 0x7fb1781625e0 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17e26f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb17815f1e0 0x7fb178070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17e26f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb17815f1e0 0x7fb178070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58534/0 (socket says 172.21.15.97:58534) 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.702+0000 7fb17e26f640 1 -- 172.21.15.97:0/3197140863 learned_addr learned my addr 172.21.15.97:0/3197140863 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7fb17da6e640 1 --2- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 0x7fb17806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7fb17ea70640 1 --2- 172.21.15.97:0/3197140863 >> v2:172.21.15.97:3300/0 conn(0x7fb1780b2f10 0x7fb1780b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7f224a0bb640 1 Processor -- start 2023-11-24T08:06:49.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7fb17e26f640 1 -- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 msgr2=0x7fb17806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7fb17e26f640 1 --2- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 0x7fb17806d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7fb17e26f640 1 -- 172.21.15.97:0/3197140863 >> v2:172.21.15.97:3300/0 conn(0x7fb1780b2f10 msgr2=0x7fb1780b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7fb17e26f640 1 --2- 172.21.15.97:0/3197140863 >> v2:172.21.15.97:3300/0 conn(0x7fb1780b2f10 0x7fb1780b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7fb17e26f640 1 -- 172.21.15.97:0/3197140863 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17806dc50 con 0x7fb17815f1e0 2023-11-24T08:06:49.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.704+0000 7fb17ea70640 1 --2- 172.21.15.97:0/3197140863 >> v2:172.21.15.97:3300/0 conn(0x7fb1780b2f10 0x7fb1780b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:49.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7fa693fff640 1 --2- 172.21.15.97:0/3118350730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6941598d0 0x7fa6940cf3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa694070750 tx=0x7fa684030420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb436f1a2399061 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.703+0000 7f224a0bb640 1 -- start start 2023-11-24T08:06:49.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7f224a0bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2244160a20 0x7f22440cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7f224a0bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2244160e00 0x7f22440cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7f224a0bb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440d1e00 con 0x7f22440b3b20 2023-11-24T08:06:49.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7f224a0bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440d3c40 con 0x7f2244160a20 2023-11-24T08:06:49.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7f224a0bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440d3e50 con 0x7f2244160e00 2023-11-24T08:06:49.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7fa6937fe640 1 -- 172.21.15.97:0/3118350730 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684037600 con 0x7fa6941598d0 2023-11-24T08:06:49.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7fa6937fe640 1 -- 172.21.15.97:0/3118350730 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684033050 con 0x7fa6941598d0 2023-11-24T08:06:49.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7fa6937fe640 1 -- 172.21.15.97:0/3118350730 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684037980 con 0x7fa6941598d0 2023-11-24T08:06:49.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.705+0000 7fb17e26f640 1 --2- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 0x7fb178070c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b16a0 tx=0x7fb17402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f61ce357ecb38e06 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.706+0000 7f22490b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2244160a20 0x7f22440cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.706+0000 7f22488b8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2244160e00 0x7f22440cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.706+0000 7f22490b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2244160a20 0x7f22440cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57060/0 (socket says 172.21.15.97:57060) 2023-11-24T08:06:49.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.706+0000 7f22490b9640 1 -- 172.21.15.97:0/657697038 learned_addr learned my addr 172.21.15.97:0/657697038 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.706+0000 7fa69ae56640 1 -- 172.21.15.97:0/3118350730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6941598d0 msgr2=0x7fa6940cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7fb17d26d640 1 -- 172.21.15.97:0/3197140863 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740317e0 con 0x7fb17815f1e0 2023-11-24T08:06:49.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7fb17d26d640 1 -- 172.21.15.97:0/3197140863 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174031940 con 0x7fb17815f1e0 2023-11-24T08:06:49.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7fb17d26d640 1 -- 172.21.15.97:0/3197140863 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174031cd0 con 0x7fb17815f1e0 2023-11-24T08:06:49.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.706+0000 7fa69ae56640 1 --2- 172.21.15.97:0/3118350730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6941598d0 0x7fa6940cf3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa694070750 tx=0x7fa684030420 comp rx=0 tx=0).stop 2023-11-24T08:06:49.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7fa69ae56640 1 -- 172.21.15.97:0/3118350730 shutdown_connections 2023-11-24T08:06:49.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7fa69ae56640 1 --2- 172.21.15.97:0/3118350730 >> v2:172.21.15.97:3300/0 conn(0x7fa6940cf900 0x7fa694070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7f22488b8640 1 -- 172.21.15.97:0/657697038 >> v2:172.21.15.97:3300/0 conn(0x7f2244160a20 msgr2=0x7f22440cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7f22488b8640 1 --2- 172.21.15.97:0/657697038 >> v2:172.21.15.97:3300/0 conn(0x7f2244160a20 0x7f22440cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7f22488b8640 1 -- 172.21.15.97:0/657697038 >> v1:172.21.15.183:6789/0 conn(0x7f22440b3b20 legacy=0x7f22440b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7f22488b8640 1 -- 172.21.15.97:0/657697038 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440d1a90 con 0x7f2244160e00 2023-11-24T08:06:49.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7fa69ae56640 1 --2- 172.21.15.97:0/3118350730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6941598d0 0x7fa6940cf3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.707+0000 7fa69ae56640 1 -- 172.21.15.97:0/3118350730 >> 172.21.15.97:0/3118350730 conn(0x7fa69406a800 msgr2=0x7fa69406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fa69ae56640 1 -- 172.21.15.97:0/3118350730 shutdown_connections 2023-11-24T08:06:49.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fb17f271640 1 -- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 msgr2=0x7fb178070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fa69ae56640 1 -- 172.21.15.97:0/3118350730 wait complete. 2023-11-24T08:06:49.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fb17f271640 1 --2- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 0x7fb178070c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b16a0 tx=0x7fb17402b880 comp rx=0 tx=0).stop 2023-11-24T08:06:49.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fb17f271640 1 -- 172.21.15.97:0/3197140863 shutdown_connections 2023-11-24T08:06:49.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fb17f271640 1 --2- 172.21.15.97:0/3197140863 >> v2:172.21.15.97:3300/0 conn(0x7fb1780b2f10 0x7fb1780b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fb17f271640 1 --2- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 0x7fb17806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fb17f271640 1 --2- 172.21.15.97:0/3197140863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 0x7fb178070c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.708+0000 7fb17f271640 1 -- 172.21.15.97:0/3197140863 >> 172.21.15.97:0/3197140863 conn(0x7fb1780b0b00 msgr2=0x7fb1780b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.709+0000 7fb17f271640 1 -- 172.21.15.97:0/3197140863 shutdown_connections 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.709+0000 7f22488b8640 1 --2- 172.21.15.97:0/657697038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2244160e00 0x7f22440cfd90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22340097a0 tx=0x7f223402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41af6d4441a0aba1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.709+0000 7f223bfff640 1 -- 172.21.15.97:0/657697038 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234031830 con 0x7f2244160e00 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.710+0000 7f223bfff640 1 -- 172.21.15.97:0/657697038 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234031990 con 0x7f2244160e00 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.710+0000 7f223bfff640 1 -- 172.21.15.97:0/657697038 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234031d00 con 0x7f2244160e00 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.711+0000 7f224a0bb640 1 -- 172.21.15.97:0/657697038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2244160e00 msgr2=0x7f22440cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.711+0000 7f224a0bb640 1 --2- 172.21.15.97:0/657697038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2244160e00 0x7f22440cfd90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22340097a0 tx=0x7f223402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.711+0000 7fa69ae56640 1 Processor -- start 2023-11-24T08:06:49.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.711+0000 7fa69ae56640 1 -- start start 2023-11-24T08:06:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.709+0000 7fb17f271640 1 -- 172.21.15.97:0/3197140863 wait complete. 2023-11-24T08:06:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7fb17f271640 1 Processor -- start 2023-11-24T08:06:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7f224a0bb640 1 -- 172.21.15.97:0/657697038 shutdown_connections 2023-11-24T08:06:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7f224a0bb640 1 --2- 172.21.15.97:0/657697038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2244160e00 0x7f22440cfd90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7f224a0bb640 1 --2- 172.21.15.97:0/657697038 >> v2:172.21.15.97:3300/0 conn(0x7f2244160a20 0x7f22440cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7f224a0bb640 1 -- 172.21.15.97:0/657697038 >> 172.21.15.97:0/657697038 conn(0x7f22440d3120 msgr2=0x7f22440d3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7f224a0bb640 1 -- 172.21.15.97:0/657697038 shutdown_connections 2023-11-24T08:06:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7f224a0bb640 1 -- 172.21.15.97:0/657697038 wait complete. 2023-11-24T08:06:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7fb17f271640 1 -- start start 2023-11-24T08:06:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.712+0000 7fce2fa48640 1 Processor -- start 2023-11-24T08:06:49.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.713+0000 7fce2fa48640 1 -- start start 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.713+0000 7fa69ae56640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6940cf900 0x7fa69414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.713+0000 7fa69ae56640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa694153a50 0x7fa6940cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.713+0000 7fa69ae56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6941598d0 0x7fa69414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.713+0000 7fa69ae56640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6941505f0 con 0x7fa694153a50 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.713+0000 7fa69ae56640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69414f9e0 con 0x7fa6940cf900 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.713+0000 7fa69ae56640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69414fcc0 con 0x7fa6941598d0 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.714+0000 7fb17f271640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1780b2f10 0x7fb1780c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.714+0000 7fa698bf2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6940cf900 0x7fa69414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.714+0000 7fa693fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa694153a50 0x7fa6940cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.714+0000 7fa693fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa694153a50 0x7fa6940cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57070/0 (socket says 172.21.15.97:57070) 2023-11-24T08:06:49.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.714+0000 7fa693fff640 1 -- 172.21.15.97:0/78051964 learned_addr learned my addr 172.21.15.97:0/78051964 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.714+0000 7fb17f271640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 0x7fb1780c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17f271640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 0x7fb178159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fce2fa48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce2814b2c0 0x7fce280cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17e26f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1780b2f10 0x7fb1780c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17f271640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c7c50 con 0x7fb1780b2f10 2023-11-24T08:06:49.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17f271640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c5dc0 con 0x7fb17815f1e0 2023-11-24T08:06:49.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17f271640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17815a180 con 0x7fb1781625e0 2023-11-24T08:06:49.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17e26f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1780b2f10 0x7fb1780c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57078/0 (socket says 172.21.15.97:57078) 2023-11-24T08:06:49.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17e26f640 1 -- 172.21.15.97:0/3437658180 learned_addr learned my addr 172.21.15.97:0/3437658180 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fa6993f3640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6941598d0 0x7fa69414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fce2fa48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fce28071070 0x7fce280cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fb17da6e640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 0x7fb1780c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7f224a0bb640 1 Processor -- start 2023-11-24T08:06:49.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fce2fa48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280cfbf0 con 0x7fce280cf7d0 2023-11-24T08:06:49.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fce2fa48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2814b6a0 con 0x7fce28071070 2023-11-24T08:06:49.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.715+0000 7fce2fa48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce28071690 con 0x7fce2814b2c0 2023-11-24T08:06:49.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fce2cfe3640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fce280cf7d0 0x7fce28070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50872/0 (socket says 172.21.15.97:50872) 2023-11-24T08:06:49.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fce2cfe3640 1 -- 172.21.15.97:0/1908281144 learned_addr learned my addr 172.21.15.97:0/1908281144 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:49.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fce2d7e4640 1 --2- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce2814b2c0 0x7fce280cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fa698bf2640 1 -- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6941598d0 msgr2=0x7fa69414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fce2dfe5640 1 --2- 172.21.15.97:0/1908281144 >> v2:172.21.15.183:3300/0 conn(0x7fce28071070 0x7fce280cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fa698bf2640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6941598d0 0x7fa69414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fb17e26f640 1 -- 172.21.15.97:0/3437658180 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 msgr2=0x7fb178159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fb17e26f640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 0x7fb178159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fb17e26f640 1 -- 172.21.15.97:0/3437658180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 msgr2=0x7fb1780c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fb17e26f640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 0x7fb1780c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.716+0000 7fb17e26f640 1 -- 172.21.15.97:0/3437658180 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170009a70 con 0x7fb1780b2f10 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fb17e26f640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1780b2f10 0x7fb1780c3d70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb17402b8c0 tx=0x7fb1740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fce1bfff640 1 -- 172.21.15.97:0/1908281144 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161080465 0 0) 0x7fce280cfbf0 con 0x7fce280cf7d0 2023-11-24T08:06:49.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fce1bfff640 1 -- 172.21.15.97:0/1908281144 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce14003520 con 0x7fce280cf7d0 2023-11-24T08:06:49.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fa698bf2640 1 -- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa694153a50 msgr2=0x7fa6940cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7f224a0bb640 1 -- start start 2023-11-24T08:06:49.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fce2dfe5640 1 -- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce2814b2c0 msgr2=0x7fce280cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fce2dfe5640 1 --2- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce2814b2c0 0x7fce280cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fce2dfe5640 1 -- 172.21.15.97:0/1908281144 >> v1:172.21.15.183:6789/0 conn(0x7fce280cf7d0 legacy=0x7fce28070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fa698bf2640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa694153a50 0x7fa6940cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fce2dfe5640 1 -- 172.21.15.97:0/1908281144 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28071970 con 0x7fce28071070 2023-11-24T08:06:49.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.717+0000 7fa698bf2640 1 -- 172.21.15.97:0/78051964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009b30 con 0x7fa6940cf900 2023-11-24T08:06:49.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7f49dfd1d640 1 Processor -- start 2023-11-24T08:06:49.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7f224a0bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22440b3b20 0x7f22441ff520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7f224a0bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244160a20 0x7f22440b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7f224a0bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2244160e00 0x7f22440c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7fa698bf2640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6940cf900 0x7fa69414bc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c340 tx=0x7fa67c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7f49dfd1d640 1 -- start start 2023-11-24T08:06:49.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7fb16effd640 1 -- 172.21.15.97:0/3437658180 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174032880 con 0x7fb1780b2f10 2023-11-24T08:06:49.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7fb16effd640 1 -- 172.21.15.97:0/3437658180 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174032a00 con 0x7fb1780b2f10 2023-11-24T08:06:49.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1740094d0 con 0x7fb1780b2f10 2023-11-24T08:06:49.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7fb16effd640 1 -- 172.21.15.97:0/3437658180 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174032db0 con 0x7fb1780b2f10 2023-11-24T08:06:49.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.718+0000 7f224a0bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b7730 con 0x7f2244160e00 2023-11-24T08:06:49.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f22490b9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22440b3b20 0x7f22441ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f22490b9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22440b3b20 0x7f22441ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36472/0 (socket says 172.21.15.97:36472) 2023-11-24T08:06:49.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f224a0bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b66f0 con 0x7f2244160a20 2023-11-24T08:06:49.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f22490b9640 1 -- 172.21.15.97:0/3182226798 learned_addr learned my addr 172.21.15.97:0/3182226798 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b69d0 con 0x7f22440b3b20 2023-11-24T08:06:49.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f22488b8640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244160a20 0x7f22440b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f22498ba640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2244160e00 0x7f22440c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb178200a00 con 0x7fb1780b2f10 2023-11-24T08:06:49.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7f11ede07640 1 Processor -- start 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7fa6917fa640 1 -- 172.21.15.97:0/78051964 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0052d0 con 0x7fa6940cf900 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69414ffa0 con 0x7fa6940cf900 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7fa6917fa640 1 -- 172.21.15.97:0/78051964 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c005430 con 0x7fa6940cf900 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69414c1c0 con 0x7fa6940cf900 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.719+0000 7fce2dfe5640 1 --2- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce28071070 0x7fce280cc160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce20009d90 tx=0x7fce2002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d36a5c2389e8361c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7fce1bfff640 1 -- 172.21.15.97:0/1908281144 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2002cc60 con 0x7fce28071070 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7fce1bfff640 1 -- 172.21.15.97:0/1908281144 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2002cdc0 con 0x7fce28071070 2023-11-24T08:06:49.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7fce1bfff640 1 -- 172.21.15.97:0/1908281144 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20034660 con 0x7fce28071070 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f49dfd1d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f49d8164e50 0x7f49d80cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f49dfd1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f49d80d1090 0x7f49d80d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f49dfd1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d8165230 con 0x7f49d80b34e0 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f49dfd1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80c6860 con 0x7f49d80d1090 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f49dfd1d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80d0df0 con 0x7f49d8164e50 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f49ddab9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f49d8164e50 0x7f49d80cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f49ddab9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f49d8164e50 0x7f49d80cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58568/0 (socket says 172.21.15.97:58568) 2023-11-24T08:06:49.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.722+0000 7f49ddab9640 1 -- 172.21.15.97:0/127954243 learned_addr learned my addr 172.21.15.97:0/127954243 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.722+0000 7fa6917fa640 1 -- 172.21.15.97:0/78051964 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0052d0 con 0x7fa6940cf900 2023-11-24T08:06:49.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.722+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa678005250 con 0x7fa6940cf900 2023-11-24T08:06:49.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f22498ba640 1 -- 172.21.15.97:0/3182226798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22440b3b20 msgr2=0x7f22441ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f22498ba640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22440b3b20 0x7f22441ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f22498ba640 1 -- 172.21.15.97:0/3182226798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244160a20 msgr2=0x7f22440b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f22498ba640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244160a20 0x7f22440b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f22498ba640 1 -- 172.21.15.97:0/3182226798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234009400 con 0x7f2244160e00 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f22498ba640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2244160e00 0x7f22440c8800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f224000c390 tx=0x7f224000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f2239ffb640 1 -- 172.21.15.97:0/3182226798 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400052d0 con 0x7f2244160e00 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f2239ffb640 1 -- 172.21.15.97:0/3182226798 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240005430 con 0x7f2244160e00 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.720+0000 7f2239ffb640 1 -- 172.21.15.97:0/3182226798 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240003830 con 0x7f2244160e00 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22440b7980 con 0x7f2244160e00 2023-11-24T08:06:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.721+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22441ffa60 con 0x7f2244160e00 2023-11-24T08:06:49.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.722+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb178067450 con 0x7fb1780b2f10 2023-11-24T08:06:49.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.722+0000 7fb16effd640 1 -- 172.21.15.97:0/3437658180 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb17404e450 con 0x7fb1780b2f10 2023-11-24T08:06:49.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.722+0000 7f11ede07640 1 -- start start 2023-11-24T08:06:49.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.723+0000 7f49de2ba640 1 --2- 172.21.15.97:0/127954243 >> v2:172.21.15.97:3300/0 conn(0x7f49d80d1090 0x7f49d80d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.724+0000 7fb16effd640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb15c06ae90 0x7fb15c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.723+0000 7f49ddab9640 1 -- 172.21.15.97:0/127954243 >> v2:172.21.15.97:3300/0 conn(0x7f49d80d1090 msgr2=0x7f49d80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.723+0000 7f49ddab9640 1 --2- 172.21.15.97:0/127954243 >> v2:172.21.15.97:3300/0 conn(0x7f49d80d1090 0x7f49d80d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.723+0000 7f49ddab9640 1 -- 172.21.15.97:0/127954243 >> v1:172.21.15.97:6789/0 conn(0x7f49d80b34e0 legacy=0x7f49d80ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.723+0000 7f49ddab9640 1 -- 172.21.15.97:0/127954243 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80d19f0 con 0x7f49d8164e50 2023-11-24T08:06:49.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.725+0000 7fb16effd640 1 -- 172.21.15.97:0/3437658180 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1740ab4e0 con 0x7fb1780b2f10 2023-11-24T08:06:49.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.724+0000 7fce2fa48640 1 -- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce28071070 msgr2=0x7fce280cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.724+0000 7fce2fa48640 1 --2- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce28071070 0x7fce280cc160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce20009d90 tx=0x7fce2002beb0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.725+0000 7f11ede07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e80d0280 0x7f11e80ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.725+0000 7f11ede07640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f11e80ce6f0 0x7f11e80b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.725+0000 7f49ddab9640 1 --2- 172.21.15.97:0/127954243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d8164e50 0x7f49d80cb6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49d80d1060 tx=0x7f49d002b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd5d5e42246e281 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.724+0000 7fce2fa48640 1 -- 172.21.15.97:0/1908281144 shutdown_connections 2023-11-24T08:06:49.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.724+0000 7fce2fa48640 1 --2- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce28071070 0x7fce280cc160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7f2239ffb640 1 -- 172.21.15.97:0/3182226798 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2240003990 con 0x7f2244160e00 2023-11-24T08:06:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22440b7ea0 con 0x7f2244160e00 2023-11-24T08:06:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.724+0000 7fce2fa48640 1 --2- 172.21.15.97:0/1908281144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce2814b2c0 0x7fce280cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.724+0000 7fce2fa48640 1 -- 172.21.15.97:0/1908281144 >> 172.21.15.97:0/1908281144 conn(0x7fce2806a800 msgr2=0x7fce2806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7fa6917fa640 1 -- 172.21.15.97:0/78051964 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa67c007020 con 0x7fa6940cf900 2023-11-24T08:06:49.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.725+0000 7f11ede07640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e80b6750 con 0x7f11e815d590 2023-11-24T08:06:49.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.725+0000 7f11ede07640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e80cf1f0 con 0x7f11e80ce6f0 2023-11-24T08:06:49.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.725+0000 7f11ede07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80cef10 con 0x7f11e80d0280 2023-11-24T08:06:49.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7fce2fa48640 1 -- 172.21.15.97:0/1908281144 shutdown_connections 2023-11-24T08:06:49.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7f11e77fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f11e815d590 0x7f11e80cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50886/0 (socket says 172.21.15.97:50886) 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7f11e77fe640 1 -- 172.21.15.97:0/713498297 learned_addr learned my addr 172.21.15.97:0/713498297 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7f11e6ffd640 1 --2- 172.21.15.97:0/713498297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e80d0280 0x7f11e80ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7f11e7fff640 1 --2- 172.21.15.97:0/713498297 >> v2:172.21.15.97:3300/0 conn(0x7f11e80ce6f0 0x7f11e80b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7f11e6ffd640 1 -- 172.21.15.97:0/713498297 >> v2:172.21.15.97:3300/0 conn(0x7f11e80ce6f0 msgr2=0x7f11e80b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7f11e6ffd640 1 --2- 172.21.15.97:0/713498297 >> v2:172.21.15.97:3300/0 conn(0x7f11e80ce6f0 0x7f11e80b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7f11e6ffd640 1 -- 172.21.15.97:0/713498297 >> v1:172.21.15.183:6789/0 conn(0x7f11e815d590 legacy=0x7f11e80cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7f11e6ffd640 1 -- 172.21.15.97:0/713498297 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80b6100 con 0x7f11e80d0280 2023-11-24T08:06:49.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.726+0000 7fce2fa48640 1 -- 172.21.15.97:0/1908281144 wait complete. 2023-11-24T08:06:49.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7f2239ffb640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f222806ae40 0x7f222806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7f2239ffb640 1 -- 172.21.15.97:0/3182226798 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22400889c0 con 0x7f2244160e00 2023-11-24T08:06:49.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7fb17da6e640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb15c06ae90 0x7fb15c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.728+0000 7f22490b9640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f222806ae40 0x7f222806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7fa6917fa640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa67406aea0 0x7fa67406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.727+0000 7fa6917fa640 1 -- 172.21.15.97:0/78051964 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa67c0887b0 con 0x7fa6940cf900 2023-11-24T08:06:49.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.728+0000 7fa693fff640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa67406aea0 0x7fa67406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.729+0000 7f11e6ffd640 1 --2- 172.21.15.97:0/713498297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e80d0280 0x7f11e80ce1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0097a0 tx=0x7f11dc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d19f2e850cde245 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.729+0000 7fce2fa48640 1 Processor -- start 2023-11-24T08:06:49.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.729+0000 7fb17da6e640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb15c06ae90 0x7fb15c06d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1780ca9e0 tx=0x7fb168009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.729+0000 7fce2fa48640 1 -- start start 2023-11-24T08:06:49.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.729+0000 7f22490b9640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f222806ae40 0x7f222806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f223c0093e0 tx=0x7f223c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.729+0000 7fa693fff640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa67406aea0 0x7fa67406d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa6941fa8c0 tx=0x7fa684009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.729+0000 7f11e67fc640 1 -- 172.21.15.97:0/713498297 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc02d040 con 0x7f11e80d0280 2023-11-24T08:06:49.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.730+0000 7f11e67fc640 1 -- 172.21.15.97:0/713498297 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc031810 con 0x7f11e80d0280 2023-11-24T08:06:49.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.730+0000 7f11e67fc640 1 -- 172.21.15.97:0/713498297 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc031ba0 con 0x7f11e80d0280 2023-11-24T08:06:49.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.730+0000 7fce2fa48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce28071070 0x7fce28145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.730+0000 7fce2fa48640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce280cf7d0 0x7fce281f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.730+0000 7fce2fa48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce2814b2c0 0x7fce28147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2fa48640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce281456d0 con 0x7fce280cf7d0 2023-11-24T08:06:49.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f9b850bb640 1 Processor -- start 2023-11-24T08:06:49.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2fa48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2815fab0 con 0x7fce2814b2c0 2023-11-24T08:06:49.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f9b850bb640 1 -- start start 2023-11-24T08:06:49.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2fa48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce281f7ca0 con 0x7fce28071070 2023-11-24T08:06:49.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce280cf7d0 0x7fce281f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce280cf7d0 0x7fce281f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57118/0 (socket says 172.21.15.97:57118) 2023-11-24T08:06:49.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 -- 172.21.15.97:0/824656561 learned_addr learned my addr 172.21.15.97:0/824656561 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2d7e4640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce28071070 0x7fce28145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2dfe5640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce2814b2c0 0x7fce28147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f11ede07640 1 -- 172.21.15.97:0/713498297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e80d0280 msgr2=0x7f11e80ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f11ede07640 1 --2- 172.21.15.97:0/713498297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e80d0280 0x7f11e80ce1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0097a0 tx=0x7f11dc02b8b0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 -- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce28071070 msgr2=0x7fce28145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce28071070 0x7fce28145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f11ede07640 1 -- 172.21.15.97:0/713498297 shutdown_connections 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f11ede07640 1 --2- 172.21.15.97:0/713498297 >> v2:172.21.15.97:3300/0 conn(0x7f11e80ce6f0 0x7f11e80b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f11ede07640 1 --2- 172.21.15.97:0/713498297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e80d0280 0x7f11e80ce1b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7f11ede07640 1 -- 172.21.15.97:0/713498297 >> 172.21.15.97:0/713498297 conn(0x7f11e809c540 msgr2=0x7f11e80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 -- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce2814b2c0 msgr2=0x7fce28147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce2814b2c0 0x7fce28147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.731+0000 7fce2cfe3640 1 -- 172.21.15.97:0/824656561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20009a70 con 0x7fce280cf7d0 2023-11-24T08:06:49.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.732+0000 7fce2cfe3640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce280cf7d0 0x7fce281f7190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c500 tx=0x7fce1c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.732+0000 7f11ede07640 1 -- 172.21.15.97:0/713498297 shutdown_connections 2023-11-24T08:06:49.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.732+0000 7f11ede07640 1 -- 172.21.15.97:0/713498297 wait complete. 2023-11-24T08:06:49.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b850bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b8015d590 0x7f9b800cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b850bb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9b800d00b0 0x7f9b800ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b850bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800b6750 con 0x7f9b800ce6f0 2023-11-24T08:06:49.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b850bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800d0530 con 0x7f9b8015d590 2023-11-24T08:06:49.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b850bb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800cf1f0 con 0x7f9b800d00b0 2023-11-24T08:06:49.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b7e59c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9b800d00b0 0x7f9b800ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7fb16effd640 1 -- 172.21.15.97:0/3437658180 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb174076600 con 0x7fb1780b2f10 2023-11-24T08:06:49.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b7e59c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9b800d00b0 0x7f9b800ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58590/0 (socket says 172.21.15.97:58590) 2023-11-24T08:06:49.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.733+0000 7f9b7e59c640 1 -- 172.21.15.97:0/1248581324 learned_addr learned my addr 172.21.15.97:0/1248581324 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f11ede07640 1 Processor -- start 2023-11-24T08:06:49.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f9b7ed9d640 1 --2- 172.21.15.97:0/1248581324 >> v2:172.21.15.97:3300/0 conn(0x7f9b8015d590 0x7f9b800cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f9b7e59c640 1 -- 172.21.15.97:0/1248581324 >> v2:172.21.15.97:3300/0 conn(0x7f9b8015d590 msgr2=0x7f9b800cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f9b7e59c640 1 --2- 172.21.15.97:0/1248581324 >> v2:172.21.15.97:3300/0 conn(0x7f9b8015d590 0x7f9b800cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f9b7e59c640 1 -- 172.21.15.97:0/1248581324 >> v1:172.21.15.97:6789/0 conn(0x7f9b800ce6f0 legacy=0x7f9b800d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f9b7e59c640 1 -- 172.21.15.97:0/1248581324 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800cef10 con 0x7f9b800d00b0 2023-11-24T08:06:49.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f9b7ed9d640 1 --2- 172.21.15.97:0/1248581324 >> v2:172.21.15.97:3300/0 conn(0x7f9b8015d590 0x7f9b800cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:49.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.734+0000 7f11ede07640 1 -- start start 2023-11-24T08:06:49.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.735+0000 7f64a4a7c640 1 Processor -- start 2023-11-24T08:06:49.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.735+0000 7f9b7e59c640 1 --2- 172.21.15.97:0/1248581324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 0x7f9b800ce1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b8008d970 tx=0x7f9b7402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2b8e3cc2606f7aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f64a4a7c640 1 -- start start 2023-11-24T08:06:49.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11ede07640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e80ce6f0 0x7f11e80c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11ede07640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11e80d0280 0x7f11e80b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11ede07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e815d590 0x7f11e80b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11ede07640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80cb220 con 0x7f11e80ce6f0 2023-11-24T08:06:49.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11ede07640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80b3310 con 0x7f11e80d0280 2023-11-24T08:06:49.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11ede07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80b35b0 con 0x7f11e815d590 2023-11-24T08:06:49.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11e77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e80ce6f0 0x7f11e80c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11e77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e80ce6f0 0x7f11e80c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57134/0 (socket says 172.21.15.97:57134) 2023-11-24T08:06:49.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.736+0000 7f11e77fe640 1 -- 172.21.15.97:0/121677674 learned_addr learned my addr 172.21.15.97:0/121677674 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f11e6ffd640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11e80d0280 0x7f11e80b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f64a4a7c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64a015d320 0x7f64a00c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f64a4a7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a00d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f64a4a7c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a00d1c50 con 0x7f64a00c72c0 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f64a4a7c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a00d1f30 con 0x7f64a015d320 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f64a4a7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a00ce090 con 0x7f64a00cefa0 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f11e77fe640 1 -- 172.21.15.97:0/121677674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e815d590 msgr2=0x7f11e80b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f11e77fe640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e815d590 0x7f11e80b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f11e77fe640 1 -- 172.21.15.97:0/121677674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11e80d0280 msgr2=0x7f11e80b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f11e77fe640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11e80d0280 0x7f11e80b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f11e77fe640 1 -- 172.21.15.97:0/121677674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc009400 con 0x7f11e80ce6f0 2023-11-24T08:06:49.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f11e77fe640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e80ce6f0 0x7f11e80c9390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11e000cb10 tx=0x7f11e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f649e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64a015d320 0x7f64a00c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a00d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f649dd9b640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f64a00c72c0 0x7f64a00ce890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50902/0 (socket says 172.21.15.97:50902) 2023-11-24T08:06:49.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a00d2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36516/0 (socket says 172.21.15.97:36516) 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f649dd9b640 1 -- 172.21.15.97:0/3379195606 learned_addr learned my addr 172.21.15.97:0/3379195606 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.737+0000 7f649e59c640 1 --2- 172.21.15.97:0/3379195606 >> v2:172.21.15.97:3300/0 conn(0x7f64a015d320 0x7f64a00c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57142/0 (socket says 172.21.15.97:57142) 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.738+0000 7f649e59c640 1 -- 172.21.15.97:0/3379195606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 msgr2=0x7f64a00d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.738+0000 7f649e59c640 1 --2- 172.21.15.97:0/3379195606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a00d2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.738+0000 7f649e59c640 1 -- 172.21.15.97:0/3379195606 >> v1:172.21.15.183:6789/0 conn(0x7f64a00c72c0 legacy=0x7f64a00ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.738+0000 7f649e59c640 1 -- 172.21.15.97:0/3379195606 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a00ce370 con 0x7f64a015d320 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7f11cffff640 1 -- 172.21.15.97:0/121677674 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e000ac70 con 0x7f11e80ce6f0 2023-11-24T08:06:49.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7f11cffff640 1 -- 172.21.15.97:0/121677674 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e000add0 con 0x7f11e80ce6f0 2023-11-24T08:06:49.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7f11cffff640 1 -- 172.21.15.97:0/121677674 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0012620 con 0x7f11e80ce6f0 2023-11-24T08:06:49.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e80b3890 con 0x7f11e80ce6f0 2023-11-24T08:06:49.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7f2239ffb640 1 -- 172.21.15.97:0/3182226798 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22440b7ea0 con 0x7f2244160e00 2023-11-24T08:06:49.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7fce19ffb640 1 -- 172.21.15.97:0/824656561 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c007560 con 0x7fce280cf7d0 2023-11-24T08:06:49.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7fce19ffb640 1 -- 172.21.15.97:0/824656561 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c0047e0 con 0x7fce280cf7d0 2023-11-24T08:06:49.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.739+0000 7fce19ffb640 1 -- 172.21.15.97:0/824656561 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c004bd0 con 0x7fce280cf7d0 2023-11-24T08:06:49.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.740+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce281f7f80 con 0x7fce280cf7d0 2023-11-24T08:06:49.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.740+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e815df80 con 0x7f11e80ce6f0 2023-11-24T08:06:49.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.740+0000 7f649e59c640 1 --2- 172.21.15.97:0/3379195606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a00c6d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6490009a00 tx=0x7f649002baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcc8ab9344211 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.741+0000 7f649d59a640 1 -- 172.21.15.97:0/3379195606 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649002d650 con 0x7f64a015d320 2023-11-24T08:06:49.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.740+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce28146030 con 0x7fce280cf7d0 2023-11-24T08:06:49.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.741+0000 7f9b7dd9b640 1 -- 172.21.15.97:0/1248581324 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74031870 con 0x7f9b800d00b0 2023-11-24T08:06:49.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.741+0000 7f49dcab7640 1 -- 172.21.15.97:0/127954243 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0031890 con 0x7f49d8164e50 2023-11-24T08:06:49.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.741+0000 7f49dcab7640 1 -- 172.21.15.97:0/127954243 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d00319f0 con 0x7f49d8164e50 2023-11-24T08:06:49.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.741+0000 7f649d59a640 1 -- 172.21.15.97:0/3379195606 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649002d7b0 con 0x7f64a015d320 2023-11-24T08:06:49.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.741+0000 7f649d59a640 1 -- 172.21.15.97:0/3379195606 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649002db40 con 0x7f64a015d320 2023-11-24T08:06:49.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.741+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e80675d0 con 0x7f11e80ce6f0 2023-11-24T08:06:49.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.742+0000 7f9b7dd9b640 1 -- 172.21.15.97:0/1248581324 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740319d0 con 0x7f9b800d00b0 2023-11-24T08:06:49.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.742+0000 7fa6917fa640 1 -- 172.21.15.97:0/78051964 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa67c053880 con 0x7fa6940cf900 2023-11-24T08:06:49.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.742+0000 7f9b7dd9b640 1 -- 172.21.15.97:0/1248581324 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74031d60 con 0x7f9b800d00b0 2023-11-24T08:06:49.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.742+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce281f81a0 con 0x7fce280cf7d0 2023-11-24T08:06:49.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.742+0000 7f49dfd1d640 1 -- 172.21.15.97:0/127954243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d8164e50 msgr2=0x7f49d80cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.742+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/127954243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d8164e50 0x7f49d80cb6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49d80d1060 tx=0x7f49d002b930 comp rx=0 tx=0).stop 2023-11-24T08:06:49.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f49dfd1d640 1 -- 172.21.15.97:0/127954243 shutdown_connections 2023-11-24T08:06:49.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/127954243 >> v2:172.21.15.97:3300/0 conn(0x7f49d80d1090 0x7f49d80d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/127954243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d8164e50 0x7f49d80cb6c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f49dfd1d640 1 -- 172.21.15.97:0/127954243 >> 172.21.15.97:0/127954243 conn(0x7f49d8066690 msgr2=0x7f49d806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3379195606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 msgr2=0x7f64a00c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3379195606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a00c6d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6490009a00 tx=0x7f649002baa0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f49dfd1d640 1 -- 172.21.15.97:0/127954243 shutdown_connections 2023-11-24T08:06:49.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.743+0000 7f49dfd1d640 1 -- 172.21.15.97:0/127954243 wait complete. 2023-11-24T08:06:49.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3379195606 shutdown_connections 2023-11-24T08:06:49.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3379195606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a00d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3379195606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a00c6d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3379195606 >> 172.21.15.97:0/3379195606 conn(0x7f64a008cc50 msgr2=0x7f64a009c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3379195606 shutdown_connections 2023-11-24T08:06:49.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3379195606 wait complete. 2023-11-24T08:06:49.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f9b850bb640 1 -- 172.21.15.97:0/1248581324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 msgr2=0x7f9b800ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f9b850bb640 1 --2- 172.21.15.97:0/1248581324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 0x7f9b800ce1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b8008d970 tx=0x7f9b7402b910 comp rx=0 tx=0).stop 2023-11-24T08:06:49.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.744+0000 7f9b850bb640 1 -- 172.21.15.97:0/1248581324 shutdown_connections 2023-11-24T08:06:49.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.745+0000 7f9b850bb640 1 --2- 172.21.15.97:0/1248581324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 0x7f9b800ce1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.745+0000 7f9b850bb640 1 --2- 172.21.15.97:0/1248581324 >> v2:172.21.15.97:3300/0 conn(0x7f9b8015d590 0x7f9b800cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.745+0000 7f9b850bb640 1 -- 172.21.15.97:0/1248581324 >> 172.21.15.97:0/1248581324 conn(0x7f9b8009c540 msgr2=0x7f9b800d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:49.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.746+0000 7f49dfd1d640 1 Processor -- start 2023-11-24T08:06:49.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.746+0000 7f64a4a7c640 1 Processor -- start 2023-11-24T08:06:49.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.747+0000 7f64a4a7c640 1 -- start start 2023-11-24T08:06:49.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.746+0000 7f49dfd1d640 1 -- start start 2023-11-24T08:06:49.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.745+0000 7fce19ffb640 1 -- 172.21.15.97:0/824656561 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce1c004d30 con 0x7fce280cf7d0 2023-11-24T08:06:49.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.747+0000 7fce19ffb640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce0c06af10 0x7fce0c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.747+0000 7fce19ffb640 1 -- 172.21.15.97:0/824656561 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce1c088c20 con 0x7fce280cf7d0 2023-11-24T08:06:49.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.747+0000 7fce2d7e4640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce0c06af10 0x7fce0c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7f11cffff640 1 -- 172.21.15.97:0/121677674 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11e0007070 con 0x7f11e80ce6f0 2023-11-24T08:06:49.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7fce2d7e4640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce0c06af10 0x7fce0c06d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce24006fd0 tx=0x7fce24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7f64a4a7c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64a00c72c0 0x7f64a01519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7f64a4a7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7f64a4a7c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a015db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7f64a4a7c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a015e4d0 con 0x7f64a015d320 2023-11-24T08:06:49.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7f64a4a7c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a015e7b0 con 0x7f64a00c72c0 2023-11-24T08:06:49.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.748+0000 7f64a4a7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a015ea90 con 0x7f64a00cefa0 2023-11-24T08:06:49.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f9b850bb640 1 -- 172.21.15.97:0/1248581324 shutdown_connections 2023-11-24T08:06:49.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f49dfd1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49d80b34e0 0x7f49d80c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f49dfd1d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d80d1090 0x7f49d806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f649e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64a00c72c0 0x7f64a01519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f649e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64a00c72c0 0x7f64a01519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58608/0 (socket says 172.21.15.97:58608) 2023-11-24T08:06:49.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f649e59c640 1 -- 172.21.15.97:0/3311388449 learned_addr learned my addr 172.21.15.97:0/3311388449 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f649ed9d640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f649dd9b640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f11cffff640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f11d406ae90 0x7f11d406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f49dfd1d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d8164e50 0x7f49d806c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f49dfd1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80b48f0 con 0x7f49d80b34e0 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f49dfd1d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8157d70 con 0x7f49d80d1090 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f49dfd1d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8158050 con 0x7f49d8164e50 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f49ddab9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49d80b34e0 0x7f49d80c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f49ddab9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49d80b34e0 0x7f49d80c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57154/0 (socket says 172.21.15.97:57154) 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f49ddab9640 1 -- 172.21.15.97:0/494372143 learned_addr learned my addr 172.21.15.97:0/494372143 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f649ed9d640 1 -- 172.21.15.97:0/3311388449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 msgr2=0x7f64a015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f649ed9d640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f649ed9d640 1 -- 172.21.15.97:0/3311388449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64a00c72c0 msgr2=0x7f64a01519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f649ed9d640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64a00c72c0 0x7f64a01519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.750+0000 7f649ed9d640 1 -- 172.21.15.97:0/3311388449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009400 con 0x7f64a015d320 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f49ddab9640 1 -- 172.21.15.97:0/494372143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d8164e50 msgr2=0x7f49d806c160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f49ddab9640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d8164e50 0x7f49d806c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f49ddab9640 1 -- 172.21.15.97:0/494372143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d80d1090 msgr2=0x7f49d806bc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f49ddab9640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d80d1090 0x7f49d806bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f49ddab9640 1 -- 172.21.15.97:0/494372143 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00094d0 con 0x7f49d80b34e0 2023-11-24T08:06:49.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f649ed9d640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a015db80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f649800ef90 tx=0x7f649800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f11e6ffd640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f11d406ae90 0x7f11d406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f11cffff640 1 -- 172.21.15.97:0/121677674 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11e0089550 con 0x7f11e80ce6f0 2023-11-24T08:06:49.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f49ddab9640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49d80b34e0 0x7f49d80c8140 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49d00090b0 tx=0x7f49d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.749+0000 7f9b850bb640 1 -- 172.21.15.97:0/1248581324 wait complete. 2023-11-24T08:06:49.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.751+0000 7f9b850bb640 1 Processor -- start 2023-11-24T08:06:49.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.752+0000 7f11e6ffd640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f11d406ae90 0x7f11d406d350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f11dc036000 tx=0x7f11dc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.752+0000 7f9b850bb640 1 -- start start 2023-11-24T08:06:49.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b850bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b800ce6f0 0x7f9b80200090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b850bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 0x7f9b800cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b850bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b8015d590 0x7f9b800cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b850bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800ccae0 con 0x7f9b8015d590 2023-11-24T08:06:49.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b850bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800cbed0 con 0x7f9b800d00b0 2023-11-24T08:06:49.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b850bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800cc1b0 con 0x7f9b800ce6f0 2023-11-24T08:06:49.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7fce19ffb640 1 -- 172.21.15.97:0/824656561 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce1c053d40 con 0x7fce280cf7d0 2023-11-24T08:06:49.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b8015d590 0x7f9b800cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b8015d590 0x7f9b800cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57160/0 (socket says 172.21.15.97:57160) 2023-11-24T08:06:49.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 -- 172.21.15.97:0/3832940456 learned_addr learned my addr 172.21.15.97:0/3832940456 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:49.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 -- 172.21.15.97:0/3832940456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b800ce6f0 msgr2=0x7f9b80200090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b800ce6f0 0x7f9b80200090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 -- 172.21.15.97:0/3832940456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 msgr2=0x7f9b800cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 0x7f9b800cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.754+0000 7f9b7f59e640 1 -- 172.21.15.97:0/3832940456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740094d0 con 0x7f9b8015d590 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.755+0000 7f9b7f59e640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b8015d590 0x7f9b800cb230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800b970 tx=0x7f9b7800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.759+0000 7f9b677fe640 1 -- 172.21.15.97:0/3832940456 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800cb40 con 0x7f9b8015d590 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.759+0000 7f9b677fe640 1 -- 172.21.15.97:0/3832940456 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800cca0 con 0x7f9b8015d590 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.759+0000 7f9b677fe640 1 -- 172.21.15.97:0/3832940456 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78014680 con 0x7f9b8015d590 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.760+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800cc490 con 0x7f9b8015d590 2023-11-24T08:06:49.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.760+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800ccf70 con 0x7f9b8015d590 2023-11-24T08:06:49.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.760+0000 7f648effd640 1 -- 172.21.15.97:0/3311388449 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498009c00 con 0x7f64a015d320 2023-11-24T08:06:49.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.761+0000 7f648effd640 1 -- 172.21.15.97:0/3311388449 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649800f040 con 0x7f64a015d320 2023-11-24T08:06:49.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.761+0000 7f648effd640 1 -- 172.21.15.97:0/3311388449 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64980146c0 con 0x7f64a015d320 2023-11-24T08:06:49.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.761+0000 7f11cffff640 1 -- 172.21.15.97:0/121677674 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11e00546e0 con 0x7f11e80ce6f0 2023-11-24T08:06:49.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.761+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a015ed70 con 0x7f64a015d320 2023-11-24T08:06:49.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.761+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a015e0c0 con 0x7f64a015d320 2023-11-24T08:06:49.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.762+0000 7f49ce7fc640 1 -- 172.21.15.97:0/494372143 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0045430 con 0x7f49d80b34e0 2023-11-24T08:06:49.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.762+0000 7f49ce7fc640 1 -- 172.21.15.97:0/494372143 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0045590 con 0x7f49d80b34e0 2023-11-24T08:06:49.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.762+0000 7f49ce7fc640 1 -- 172.21.15.97:0/494372143 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0045920 con 0x7f49d80b34e0 2023-11-24T08:06:49.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.762+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d8158330 con 0x7f49d80b34e0 2023-11-24T08:06:49.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.762+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d80c8680 con 0x7f49d80b34e0 2023-11-24T08:06:49.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.763+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a00cfe70 con 0x7f64a015d320 2023-11-24T08:06:49.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.764+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b800675d0 con 0x7f9b8015d590 2023-11-24T08:06:49.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.764+0000 7f648effd640 1 -- 172.21.15.97:0/3311388449 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6498014820 con 0x7f64a015d320 2023-11-24T08:06:49.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.766+0000 7f648effd640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f648006ae90 0x7f648006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.766+0000 7f648effd640 1 -- 172.21.15.97:0/3311388449 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f649808a2e0 con 0x7f64a015d320 2023-11-24T08:06:49.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.766+0000 7f649e59c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f648006ae90 0x7f648006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.767+0000 7f49ce7fc640 1 -- 172.21.15.97:0/494372143 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49d0042030 con 0x7f49d80b34e0 2023-11-24T08:06:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.768+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0005250 con 0x7f49d80b34e0 2023-11-24T08:06:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.768+0000 7f49ce7fc640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f49bc06ae90 0x7f49bc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.769+0000 7f49ce7fc640 1 -- 172.21.15.97:0/494372143 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49d00abc90 con 0x7f49d80b34e0 2023-11-24T08:06:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.769+0000 7f49dd2b8640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f49bc06ae90 0x7f49bc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.770+0000 7f49dd2b8640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f49bc06ae90 0x7f49bc06d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f49d80cf970 tx=0x7f49c8007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.771+0000 7f649e59c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f648006ae90 0x7f648006d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f649002bae0 tx=0x7f649003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.771+0000 7f9b677fe640 1 -- 172.21.15.97:0/3832940456 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b7801d3b0 con 0x7f9b8015d590 2023-11-24T08:06:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.772+0000 7f9b677fe640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9b6c06af10 0x7f9b6c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.772+0000 7f9b677fe640 1 -- 172.21.15.97:0/3832940456 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b78089470 con 0x7f9b8015d590 2023-11-24T08:06:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.773+0000 7f9b7ed9d640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9b6c06af10 0x7f9b6c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:49.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.774+0000 7f9b7ed9d640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9b6c06af10 0x7f9b6c06d3d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006fd0 tx=0x7f9b70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:49.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.779+0000 7f648effd640 1 -- 172.21.15.97:0/3311388449 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6498055420 con 0x7f64a015d320 2023-11-24T08:06:49.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.788+0000 7f9b677fe640 1 -- 172.21.15.97:0/3832940456 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b78054590 con 0x7f9b8015d590 2023-11-24T08:06:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:49.795+0000 7f49ce7fc640 1 -- 172.21.15.97:0/494372143 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49d0076d90 con 0x7f49d80b34e0 2023-11-24T08:06:50.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.138+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22440b7ea0 con 0x7f2244160e00 2023-11-24T08:06:50.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.140+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1780c5f60 con 0x7fb1780b2f10 2023-11-24T08:06:50.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.141+0000 7f2239ffb640 1 -- 172.21.15.97:0/3182226798 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22440b7ea0 con 0x7f2244160e00 2023-11-24T08:06:50.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.141+0000 7fb16effd640 1 -- 172.21.15.97:0/3437658180 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb174079c20 con 0x7fb1780b2f10 2023-11-24T08:06:50.143 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:50.144 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:50.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.145+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f222806ae40 msgr2=0x7f222806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.145+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb15c06ae90 msgr2=0x7fb15c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.145+0000 7fb17f271640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb15c06ae90 0x7fb15c06d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1780ca9e0 tx=0x7fb168009190 comp rx=0 tx=0).stop 2023-11-24T08:06:50.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.145+0000 7f224a0bb640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f222806ae40 0x7f222806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f223c0093e0 tx=0x7f223c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:50.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.145+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2244160e00 msgr2=0x7f22440c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.145+0000 7f224a0bb640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2244160e00 0x7f22440c8800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f224000c390 tx=0x7f224000c850 comp rx=0 tx=0).stop 2023-11-24T08:06:50.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1780b2f10 msgr2=0x7fb1780c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 shutdown_connections 2023-11-24T08:06:50.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7f224a0bb640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f222806ae40 0x7f222806d300 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f223c0093e0 tx=0x7f223c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:50.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7f224a0bb640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2244160e00 0x7f22440c8800 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7f224a0bb640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2244160a20 0x7f22440b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7f224a0bb640 1 --2- 172.21.15.97:0/3182226798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22440b3b20 0x7f22441ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 >> 172.21.15.97:0/3182226798 conn(0x7f22440d3120 msgr2=0x7f224415f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1780b2f10 0x7fb1780c3d70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb17402b8c0 tx=0x7fb1740046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 shutdown_connections 2023-11-24T08:06:50.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb15c06ae90 0x7fb15c06d350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1781625e0 0x7fb178159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb17815f1e0 0x7fb1780c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 --2- 172.21.15.97:0/3437658180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1780b2f10 0x7fb1780c3d70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.146+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 >> 172.21.15.97:0/3437658180 conn(0x7fb1780b0b00 msgr2=0x7fb1780b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.147+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 shutdown_connections 2023-11-24T08:06:50.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.147+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 shutdown_connections 2023-11-24T08:06:50.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.147+0000 7fb17f271640 1 -- 172.21.15.97:0/3437658180 wait complete. 2023-11-24T08:06:50.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.147+0000 7f224a0bb640 1 -- 172.21.15.97:0/3182226798 wait complete. 2023-11-24T08:06:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.162+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6780057d0 con 0x7fa6940cf900 2023-11-24T08:06:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.163+0000 7fa6917fa640 1 -- 172.21.15.97:0/78051964 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa67c020020 con 0x7fa6940cf900 2023-11-24T08:06:50.166 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.167+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa67406aea0 msgr2=0x7fa67406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.167+0000 7fa69ae56640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa67406aea0 0x7fa67406d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa6941fa8c0 tx=0x7fa684009000 comp rx=0 tx=0).stop 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.167+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6940cf900 msgr2=0x7fa69414bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.167+0000 7fa69ae56640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6940cf900 0x7fa69414bc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c340 tx=0x7fa67c00c800 comp rx=0 tx=0).stop 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.168+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 shutdown_connections 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.168+0000 7fa69ae56640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa67406aea0 0x7fa67406d360 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa6941fa8c0 tx=0x7fa684009000 comp rx=0 tx=0).stop 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.168+0000 7fa69ae56640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6941598d0 0x7fa69414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.168+0000 7fa69ae56640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa694153a50 0x7fa6940cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.168+0000 7fa69ae56640 1 --2- 172.21.15.97:0/78051964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6940cf900 0x7fa69414bc80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.168+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 >> 172.21.15.97:0/78051964 conn(0x7fa69406a800 msgr2=0x7fa6940718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.169+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 shutdown_connections 2023-11-24T08:06:50.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.169+0000 7fa69ae56640 1 -- 172.21.15.97:0/78051964 wait complete. 2023-11-24T08:06:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.173+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce280675d0 con 0x7fce280cf7d0 2023-11-24T08:06:50.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2023-11-24T08:06:50.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.174+0000 7fce19ffb640 1 -- 172.21.15.97:0/824656561 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce1c018090 con 0x7fce280cf7d0 2023-11-24T08:06:50.177 INFO:teuthology.orchestra.run.smithi097.stdout:60129542147 2023-11-24T08:06:50.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2023-11-24T08:06:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce0c06af10 msgr2=0x7fce0c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce0c06af10 0x7fce0c06d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce24006fd0 tx=0x7fce24008040 comp rx=0 tx=0).stop 2023-11-24T08:06:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce280cf7d0 msgr2=0x7fce281f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce280cf7d0 0x7fce281f7190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c500 tx=0x7fce1c00c9c0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 shutdown_connections 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce0c06af10 0x7fce0c06d3d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce2814b2c0 0x7fce28147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce280cf7d0 0x7fce281f7190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 --2- 172.21.15.97:0/824656561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce28071070 0x7fce28145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 >> 172.21.15.97:0/824656561 conn(0x7fce2806a800 msgr2=0x7fce280b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.178+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 shutdown_connections 2023-11-24T08:06:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.179+0000 7fce2fa48640 1 -- 172.21.15.97:0/824656561 wait complete. 2023-11-24T08:06:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.185+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9b800ccc20 con 0x7f9b8015d590 2023-11-24T08:06:50.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.185+0000 7f9b677fe640 1 -- 172.21.15.97:0/3832940456 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b78057bb0 con 0x7f9b8015d590 2023-11-24T08:06:50.187 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:50.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.186+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f11e815cb90 con 0x7f11e80ce6f0 2023-11-24T08:06:50.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.187+0000 7f11cffff640 1 -- 172.21.15.97:0/121677674 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11e0057d00 con 0x7f11e80ce6f0 2023-11-24T08:06:50.189 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:50.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9b6c06af10 msgr2=0x7f9b6c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9b6c06af10 0x7f9b6c06d3d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006fd0 tx=0x7f9b70008040 comp rx=0 tx=0).stop 2023-11-24T08:06:50.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b8015d590 msgr2=0x7f9b800cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b8015d590 0x7f9b800cb230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800b970 tx=0x7f9b7800be30 comp rx=0 tx=0).stop 2023-11-24T08:06:50.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 shutdown_connections 2023-11-24T08:06:50.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9b6c06af10 0x7f9b6c06d3d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b8015d590 0x7f9b800cb230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b800d00b0 0x7f9b800cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 --2- 172.21.15.97:0/3832940456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b800ce6f0 0x7f9b80200090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.188+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 >> 172.21.15.97:0/3832940456 conn(0x7f9b8009c540 msgr2=0x7f9b800b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.189+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 shutdown_connections 2023-11-24T08:06:50.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.189+0000 7f9b850bb640 1 -- 172.21.15.97:0/3832940456 wait complete. 2023-11-24T08:06:50.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2023-11-24T08:06:50.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.190+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f11d406ae90 msgr2=0x7f11d406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.190+0000 7f11ede07640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f11d406ae90 0x7f11d406d350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f11dc036000 tx=0x7f11dc03c040 comp rx=0 tx=0).stop 2023-11-24T08:06:50.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.190+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e80ce6f0 msgr2=0x7f11e80c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.190+0000 7f11ede07640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e80ce6f0 0x7f11e80c9390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11e000cb10 tx=0x7f11e000a060 comp rx=0 tx=0).stop 2023-11-24T08:06:50.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 shutdown_connections 2023-11-24T08:06:50.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f11d406ae90 0x7f11d406d350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11e815d590 0x7f11e80b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11e80d0280 0x7f11e80b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 --2- 172.21.15.97:0/121677674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e80ce6f0 0x7f11e80c9390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 >> 172.21.15.97:0/121677674 conn(0x7f11e809c540 msgr2=0x7f11e80cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 shutdown_connections 2023-11-24T08:06:50.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.193+0000 7f11ede07640 1 -- 172.21.15.97:0/121677674 wait complete. 2023-11-24T08:06:50.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.194+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f64a015f290 con 0x7f64a015d320 2023-11-24T08:06:50.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.195+0000 7f648effd640 1 -- 172.21.15.97:0/3311388449 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64a015f290 con 0x7f64a015d320 2023-11-24T08:06:50.196 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:50.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.198+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f648006ae90 msgr2=0x7f648006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.198+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f648006ae90 0x7f648006d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f649002bae0 tx=0x7f649003b040 comp rx=0 tx=0).stop 2023-11-24T08:06:50.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.198+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 msgr2=0x7f64a015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.198+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a015db80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f649800ef90 tx=0x7f649800c490 comp rx=0 tx=0).stop 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 shutdown_connections 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f648006ae90 0x7f648006d350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64a015d320 0x7f64a015db80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64a00cefa0 0x7f64a015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 --2- 172.21.15.97:0/3311388449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64a00c72c0 0x7f64a01519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 >> 172.21.15.97:0/3311388449 conn(0x7f64a008cc50 msgr2=0x7f64a00d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 shutdown_connections 2023-11-24T08:06:50.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.199+0000 7f64a4a7c640 1 -- 172.21.15.97:0/3311388449 wait complete. 2023-11-24T08:06:50.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.3 2023-11-24T08:06:50.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.208+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f49c00057d0 con 0x7f49d80b34e0 2023-11-24T08:06:50.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.209+0000 7f49ce7fc640 1 -- 172.21.15.97:0/494372143 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49d0035090 con 0x7f49d80b34e0 2023-11-24T08:06:50.210 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:50.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f49bc06ae90 msgr2=0x7f49bc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f49bc06ae90 0x7f49bc06d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f49d80cf970 tx=0x7f49c8007990 comp rx=0 tx=0).stop 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49d80b34e0 msgr2=0x7f49d80c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49d80b34e0 0x7f49d80c8140 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49d00090b0 tx=0x7f49d00046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 shutdown_connections 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f49bc06ae90 0x7f49bc06d350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d8164e50 0x7f49d806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d80d1090 0x7f49d806bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 --2- 172.21.15.97:0/494372143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49d80b34e0 0x7f49d80c8140 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:50.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 >> 172.21.15.97:0/494372143 conn(0x7f49d8066690 msgr2=0x7f49d8165400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:50.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 shutdown_connections 2023-11-24T08:06:50.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:50.211+0000 7f49dfd1d640 1 -- 172.21.15.97:0/494372143 wait complete. 2023-11-24T08:06:50.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2023-11-24T08:06:50.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.7 2023-11-24T08:06:50.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2023-11-24T08:06:51.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:06:51.180 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:06:51.193 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:06:51.207 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:06:51.212 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:06:51.221 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:06:51.225 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:06:51.230 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:06:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.456+0000 7f3c8d472640 1 Processor -- start 2023-11-24T08:06:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.456+0000 7f3c8d472640 1 -- start start 2023-11-24T08:06:51.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.458+0000 7f3c8d472640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3c8004f8d0 0x7f3c8004fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.458+0000 7f3c8d472640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80053790 0x7f3c80007130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.458+0000 7f3c8d472640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c80005e60 0x7f3c800062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.458+0000 7f3c8d472640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c800548d0 con 0x7f3c80005e60 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.458+0000 7f3c8d472640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c800501f0 con 0x7f3c8004f8d0 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.458+0000 7f3c8d472640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80037bf0 con 0x7f3c80053790 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.458+0000 7f3c8cc71640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c80005e60 0x7f3c800062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c8cc71640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c80005e60 0x7f3c800062f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57172/0 (socket says 172.21.15.97:57172) 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c8cc71640 1 -- 172.21.15.97:0/129948767 learned_addr learned my addr 172.21.15.97:0/129948767 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c877fe640 1 --2- 172.21.15.97:0/129948767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80053790 0x7f3c80007130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c8cc71640 1 -- 172.21.15.97:0/129948767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80053790 msgr2=0x7f3c80007130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c8cc71640 1 --2- 172.21.15.97:0/129948767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80053790 0x7f3c80007130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c8cc71640 1 -- 172.21.15.97:0/129948767 >> v2:172.21.15.183:3300/0 conn(0x7f3c8004f8d0 msgr2=0x7f3c8004fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c8cc71640 1 --2- 172.21.15.97:0/129948767 >> v2:172.21.15.183:3300/0 conn(0x7f3c8004f8d0 0x7f3c8004fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.459+0000 7f3c8cc71640 1 -- 172.21.15.97:0/129948767 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80053d50 con 0x7f3c80005e60 2023-11-24T08:06:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.461+0000 7f3c8cc71640 1 --2- 172.21.15.97:0/129948767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c80005e60 0x7f3c800062f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c800529e0 tx=0x7f3c7402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227bda05d85e7cc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.461+0000 7f3c86ffd640 1 -- 172.21.15.97:0/129948767 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74030850 con 0x7f3c80005e60 2023-11-24T08:06:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.461+0000 7f3c86ffd640 1 -- 172.21.15.97:0/129948767 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c740309b0 con 0x7f3c80005e60 2023-11-24T08:06:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.461+0000 7f3c86ffd640 1 -- 172.21.15.97:0/129948767 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74030d40 con 0x7f3c80005e60 2023-11-24T08:06:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.462+0000 7f3c8d472640 1 -- 172.21.15.97:0/129948767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c80005e60 msgr2=0x7f3c800062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.462+0000 7f3c8d472640 1 --2- 172.21.15.97:0/129948767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c80005e60 0x7f3c800062f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c800529e0 tx=0x7f3c7402b990 comp rx=0 tx=0).stop 2023-11-24T08:06:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.463+0000 7f3c8d472640 1 -- 172.21.15.97:0/129948767 shutdown_connections 2023-11-24T08:06:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.463+0000 7f3c8d472640 1 --2- 172.21.15.97:0/129948767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c80005e60 0x7f3c800062f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.463+0000 7f3c8d472640 1 --2- 172.21.15.97:0/129948767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80053790 0x7f3c80007130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.463+0000 7f3c8d472640 1 --2- 172.21.15.97:0/129948767 >> v2:172.21.15.183:3300/0 conn(0x7f3c8004f8d0 0x7f3c8004fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.463+0000 7f3c8d472640 1 -- 172.21.15.97:0/129948767 >> 172.21.15.97:0/129948767 conn(0x7f3c80009f80 msgr2=0x7f3c8000a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.464+0000 7f3c8d472640 1 -- 172.21.15.97:0/129948767 shutdown_connections 2023-11-24T08:06:51.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.464+0000 7f3c8d472640 1 -- 172.21.15.97:0/129948767 wait complete. 2023-11-24T08:06:51.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.466+0000 7f3c8d472640 1 Processor -- start 2023-11-24T08:06:51.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.466+0000 7f3c8d472640 1 -- start start 2023-11-24T08:06:51.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.468+0000 7f3c8d472640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80005e60 0x7f3c80047110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.468+0000 7f3c8d472640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8004f8d0 0x7f3c801823d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.468+0000 7f3c8d472640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c80053790 0x7f3c8004aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.468+0000 7f3c8d472640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800352d0 con 0x7f3c8004f8d0 2023-11-24T08:06:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.468+0000 7f3c8d472640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800346e0 con 0x7f3c80053790 2023-11-24T08:06:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.468+0000 7f3c8d472640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80182100 con 0x7f3c80005e60 2023-11-24T08:06:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.469+0000 7f3c877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8004f8d0 0x7f3c801823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.469+0000 7f3c877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8004f8d0 0x7f3c801823d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57176/0 (socket says 172.21.15.97:57176) 2023-11-24T08:06:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.469+0000 7f3c877fe640 1 -- 172.21.15.97:0/1769561027 learned_addr learned my addr 172.21.15.97:0/1769561027 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.469+0000 7f3c87fff640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80005e60 0x7f3c80047110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.470+0000 7f3c8cc71640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c80053790 0x7f3c8004aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.470+0000 7f3c877fe640 1 -- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80005e60 msgr2=0x7f3c80047110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.470+0000 7f3c877fe640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80005e60 0x7f3c80047110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.470+0000 7f3c877fe640 1 -- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c80053790 msgr2=0x7f3c8004aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.470+0000 7f3c877fe640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c80053790 0x7f3c8004aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.470+0000 7f3c877fe640 1 -- 172.21.15.97:0/1769561027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740094d0 con 0x7f3c8004f8d0 2023-11-24T08:06:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f3c877fe640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8004f8d0 0x7f3c801823d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c88050140 tx=0x7f3c880748f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f7e62456640 1 Processor -- start 2023-11-24T08:06:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f3c84ff9640 1 -- 172.21.15.97:0/1769561027 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88072970 con 0x7f3c8004f8d0 2023-11-24T08:06:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f3c84ff9640 1 -- 172.21.15.97:0/1769561027 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88071070 con 0x7f3c8004f8d0 2023-11-24T08:06:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f3c84ff9640 1 -- 172.21.15.97:0/1769561027 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8806b460 con 0x7f3c8004f8d0 2023-11-24T08:06:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f7e62456640 1 -- start start 2023-11-24T08:06:51.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c80034930 con 0x7f3c8004f8d0 2023-11-24T08:06:51.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.471+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c80034ef0 con 0x7f3c8004f8d0 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.474+0000 7f7e62456640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e5c14b2c0 0x7f7e5c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.474+0000 7f7e62456640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.474+0000 7f7e62456640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5c0cfbf0 con 0x7f7e5c070ea0 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.474+0000 7f7e62456640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5c14b6a0 con 0x7f7e5c14b2c0 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.474+0000 7f7e62456640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c071690 con 0x7f7e5c0cf7d0 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.475+0000 7f7e5bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e5c14b2c0 0x7f7e5c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.475+0000 7f7e5bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e5c14b2c0 0x7f7e5c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58670/0 (socket says 172.21.15.97:58670) 2023-11-24T08:06:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.475+0000 7f7e5bfff640 1 -- 172.21.15.97:0/3482499989 learned_addr learned my addr 172.21.15.97:0/3482499989 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.475+0000 7f7e5b7fe640 1 --2- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.476+0000 7f7e5bfff640 1 -- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 msgr2=0x7f7e5c070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.476+0000 7f7e5bfff640 1 --2- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.476+0000 7f7e5bfff640 1 -- 172.21.15.97:0/3482499989 >> v1:172.21.15.97:6789/0 conn(0x7f7e5c070ea0 legacy=0x7f7e5c0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.476+0000 7f7e5bfff640 1 -- 172.21.15.97:0/3482499989 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c071970 con 0x7f7e5c14b2c0 2023-11-24T08:06:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.476+0000 7f7e5b7fe640 1 --2- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.477+0000 7f3c84ff9640 1 -- 172.21.15.97:0/1769561027 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c8807f020 con 0x7f3c8004f8d0 2023-11-24T08:06:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.478+0000 7f3c84ff9640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3c6c06ae90 0x7f3c6c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.479+0000 7f3c84ff9640 1 -- 172.21.15.97:0/1769561027 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c880c1970 con 0x7f3c8004f8d0 2023-11-24T08:06:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.479+0000 7f7e5bfff640 1 --2- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c0cf290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009870 tx=0x7f7e4c02b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429c7d0a55398dd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.479+0000 7f3c87fff640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3c6c06ae90 0x7f3c6c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.480+0000 7f7e5affd640 1 -- 172.21.15.97:0/3482499989 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c030710 con 0x7f7e5c14b2c0 2023-11-24T08:06:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.480+0000 7f7e5affd640 1 -- 172.21.15.97:0/3482499989 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c02e050 con 0x7f7e5c14b2c0 2023-11-24T08:06:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.480+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c68005250 con 0x7f3c8004f8d0 2023-11-24T08:06:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.480+0000 7f7e5affd640 1 -- 172.21.15.97:0/3482499989 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c030a90 con 0x7f7e5c14b2c0 2023-11-24T08:06:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.481+0000 7f7e62456640 1 -- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 msgr2=0x7f7e5c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.481+0000 7f7e62456640 1 --2- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c0cf290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009870 tx=0x7f7e4c02b7d0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.482+0000 7f3c87fff640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3c6c06ae90 0x7f3c6c06d350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00b810 tx=0x7f3c7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.482+0000 7f7e62456640 1 -- 172.21.15.97:0/3482499989 shutdown_connections 2023-11-24T08:06:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.482+0000 7f7e62456640 1 --2- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.482+0000 7f7e62456640 1 --2- 172.21.15.97:0/3482499989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c0cf290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.482+0000 7f7e62456640 1 -- 172.21.15.97:0/3482499989 >> 172.21.15.97:0/3482499989 conn(0x7f7e5c06a800 msgr2=0x7f7e5c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.483+0000 7f7e62456640 1 -- 172.21.15.97:0/3482499989 shutdown_connections 2023-11-24T08:06:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.483+0000 7f7e62456640 1 -- 172.21.15.97:0/3482499989 wait complete. 2023-11-24T08:06:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.486+0000 7f7e62456640 1 Processor -- start 2023-11-24T08:06:51.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.487+0000 7f7e62456640 1 -- start start 2023-11-24T08:06:51.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.489+0000 7f7e62456640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e5c070ea0 0x7f7e5c143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.489+0000 7f7e62456640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c1f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f3c84ff9640 1 -- 172.21.15.97:0/1769561027 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c88087070 con 0x7f3c8004f8d0 2023-11-24T08:06:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f7e62456640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e5c070ea0 0x7f7e5c143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e5c070ea0 0x7f7e5c143d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57186/0 (socket says 172.21.15.97:57186) 2023-11-24T08:06:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f7e62456640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c1f76e0 con 0x7f7e5c070ea0 2023-11-24T08:06:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f7e62456640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c1f79c0 con 0x7f7e5c14b2c0 2023-11-24T08:06:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f7e62456640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c1f7ca0 con 0x7f7e5c0cf7d0 2023-11-24T08:06:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.490+0000 7f7e5bfff640 1 -- 172.21.15.97:0/4076922206 learned_addr learned my addr 172.21.15.97:0/4076922206 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.491+0000 7f7e5bfff640 1 -- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 msgr2=0x7f7e5c1f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.491+0000 7f7e5b7fe640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c1f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.491+0000 7f7e609f3640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.491+0000 7f7e5bfff640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c1f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.491+0000 7f7e5bfff640 1 -- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 msgr2=0x7f7e5c162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.491+0000 7f7e5bfff640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c162710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.492+0000 7f7e5bfff640 1 -- 172.21.15.97:0/4076922206 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54009a70 con 0x7f7e5c070ea0 2023-11-24T08:06:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.492+0000 7f7e609f3640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.492+0000 7f7e5b7fe640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c1f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:51.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.493+0000 7f7e5bfff640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e5c070ea0 0x7f7e5c143d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009990 tx=0x7f7e4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.493+0000 7f7e58ff9640 1 -- 172.21.15.97:0/4076922206 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c03c850 con 0x7f7e5c070ea0 2023-11-24T08:06:51.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.494+0000 7f7e58ff9640 1 -- 172.21.15.97:0/4076922206 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c03c9b0 con 0x7f7e5c070ea0 2023-11-24T08:06:51.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.494+0000 7f7e58ff9640 1 -- 172.21.15.97:0/4076922206 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c03cd60 con 0x7f7e5c070ea0 2023-11-24T08:06:51.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.495+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c0094d0 con 0x7f7e5c070ea0 2023-11-24T08:06:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.496+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c1621f0 con 0x7f7e5c070ea0 2023-11-24T08:06:51.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.501+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5c0675d0 con 0x7f7e5c070ea0 2023-11-24T08:06:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.501+0000 7f7e58ff9640 1 -- 172.21.15.97:0/4076922206 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e4c032400 con 0x7f7e5c070ea0 2023-11-24T08:06:51.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.503+0000 7f7e58ff9640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7e4806ae40 0x7f7e4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.506+0000 7f7e5b7fe640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7e4806ae40 0x7f7e4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.512+0000 7f7e5b7fe640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7e4806ae40 0x7f7e4806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009fd0 tx=0x7f7e5400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.512+0000 7f7e58ff9640 1 -- 172.21.15.97:0/4076922206 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e4c043310 con 0x7f7e5c070ea0 2023-11-24T08:06:51.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.516+0000 7f7e58ff9640 1 -- 172.21.15.97:0/4076922206 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e4c037020 con 0x7f7e5c070ea0 2023-11-24T08:06:51.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.524+0000 7f5ca95e5640 1 Processor -- start 2023-11-24T08:06:51.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.525+0000 7f5ca95e5640 1 -- start start 2023-11-24T08:06:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.527+0000 7f5ca95e5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5c9c005e50 0x7f5c9c006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.527+0000 7f5ca95e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5c9c0067d0 0x7f5c9c006c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.527+0000 7f5ca95e5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c0542f0 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.527+0000 7f5ca95e5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c0536e0 con 0x7f5c9c005e50 2023-11-24T08:06:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.527+0000 7f5ca95e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c0539c0 con 0x7f5c9c0067d0 2023-11-24T08:06:51.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.528+0000 7f5ca2ffd640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f5c9c0eacc0 0x7f5c9c04fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50916/0 (socket says 172.21.15.97:50916) 2023-11-24T08:06:51.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.528+0000 7f5ca2ffd640 1 -- 172.21.15.97:0/1139989492 learned_addr learned my addr 172.21.15.97:0/1139989492 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:51.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.528+0000 7f5ca37fe640 1 --2- 172.21.15.97:0/1139989492 >> v2:172.21.15.183:3300/0 conn(0x7f5c9c0067d0 0x7f5c9c006c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.528+0000 7f5ca27fc640 1 --2- 172.21.15.97:0/1139989492 >> v2:172.21.15.97:3300/0 conn(0x7f5c9c005e50 0x7f5c9c006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.529+0000 7f5ca37fe640 1 -- 172.21.15.97:0/1139989492 >> v2:172.21.15.97:3300/0 conn(0x7f5c9c005e50 msgr2=0x7f5c9c006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.529+0000 7f5ca37fe640 1 --2- 172.21.15.97:0/1139989492 >> v2:172.21.15.97:3300/0 conn(0x7f5c9c005e50 0x7f5c9c006290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.529+0000 7f5ca37fe640 1 -- 172.21.15.97:0/1139989492 >> v1:172.21.15.183:6789/0 conn(0x7f5c9c0eacc0 legacy=0x7f5c9c04fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.529+0000 7f5ca37fe640 1 -- 172.21.15.97:0/1139989492 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c053ca0 con 0x7f5c9c0067d0 2023-11-24T08:06:51.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.529+0000 7f5ca27fc640 1 --2- 172.21.15.97:0/1139989492 >> v2:172.21.15.97:3300/0 conn(0x7f5c9c005e50 0x7f5c9c006290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:51.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.530+0000 7f5ca37fe640 1 --2- 172.21.15.97:0/1139989492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 0x7f5c9c006c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ca404fab0 tx=0x7f5ca40a5dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a70ce4d5e6b335 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.531+0000 7f5ca1ffb640 1 -- 172.21.15.97:0/1139989492 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40a6c30 con 0x7f5c9c0067d0 2023-11-24T08:06:51.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.531+0000 7f5ca1ffb640 1 -- 172.21.15.97:0/1139989492 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca40a6d90 con 0x7f5c9c0067d0 2023-11-24T08:06:51.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.531+0000 7f5ca1ffb640 1 -- 172.21.15.97:0/1139989492 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40ae640 con 0x7f5c9c0067d0 2023-11-24T08:06:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.532+0000 7f5ca95e5640 1 -- 172.21.15.97:0/1139989492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 msgr2=0x7f5c9c006c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.532+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/1139989492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 0x7f5c9c006c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ca404fab0 tx=0x7f5ca40a5dc0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.532+0000 7f5ca95e5640 1 -- 172.21.15.97:0/1139989492 shutdown_connections 2023-11-24T08:06:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.532+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/1139989492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 0x7f5c9c006c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.532+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/1139989492 >> v2:172.21.15.97:3300/0 conn(0x7f5c9c005e50 0x7f5c9c006290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.532+0000 7f5ca95e5640 1 -- 172.21.15.97:0/1139989492 >> 172.21.15.97:0/1139989492 conn(0x7f5c9c009f70 msgr2=0x7f5c9c00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.533+0000 7f5ca95e5640 1 -- 172.21.15.97:0/1139989492 shutdown_connections 2023-11-24T08:06:51.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.533+0000 7f5ca95e5640 1 -- 172.21.15.97:0/1139989492 wait complete. 2023-11-24T08:06:51.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.535+0000 7f5ca95e5640 1 Processor -- start 2023-11-24T08:06:51.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.535+0000 7f3d50483640 1 Processor -- start 2023-11-24T08:06:51.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.535+0000 7f3d50483640 1 -- start start 2023-11-24T08:06:51.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.536+0000 7f5ca95e5640 1 -- start start 2023-11-24T08:06:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.537+0000 7f5ca95e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c9c005e50 0x7f5c9c17c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.537+0000 7f3d50483640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d48153a50 0x7f3d480b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.537+0000 7f3d50483640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d481598d0 0x7f3d480cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.537+0000 7f3d50483640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3d480cf900 0x7f3d4806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.537+0000 7f5ca95e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 0x7f5c9c038990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d50483640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d48153e30 con 0x7f3d481598d0 2023-11-24T08:06:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d50483640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480709b0 con 0x7f3d480cf900 2023-11-24T08:06:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d50483640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480cfd70 con 0x7f3d48153a50 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f5ca95e5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c9c0eacc0 0x7f5c9c038ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f5ca95e5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c17cc10 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f5ca95e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c035460 con 0x7f5c9c0067d0 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f5ca95e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0db830 con 0x7f5c9c005e50 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d4da1e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d481598d0 0x7f3d480cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d4e21f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d48153a50 0x7f3d480b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d4e21f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d48153a50 0x7f3d480b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36610/0 (socket says 172.21.15.97:36610) 2023-11-24T08:06:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d4e21f640 1 -- 172.21.15.97:0/3038926793 learned_addr learned my addr 172.21.15.97:0/3038926793 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f5ca2ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c9c005e50 0x7f5c9c17c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f5ca37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c9c0eacc0 0x7f5c9c038ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f5ca37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c9c0eacc0 0x7f5c9c038ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57198/0 (socket says 172.21.15.97:57198) 2023-11-24T08:06:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f5ca37fe640 1 -- 172.21.15.97:0/3581800868 learned_addr learned my addr 172.21.15.97:0/3581800868 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.538+0000 7f3d4ea20640 1 --2- 172.21.15.97:0/3038926793 >> v2:172.21.15.183:3300/0 conn(0x7f3d480cf900 0x7f3d4806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f5ca27fc640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 0x7f5c9c038990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f3d4ea20640 1 -- 172.21.15.97:0/3038926793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d48153a50 msgr2=0x7f3d480b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f3d4ea20640 1 --2- 172.21.15.97:0/3038926793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d48153a50 0x7f3d480b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f5ca37fe640 1 -- 172.21.15.97:0/3581800868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c9c005e50 msgr2=0x7f5c9c17c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.539+0000 7f5ca37fe640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c9c005e50 0x7f5c9c17c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f5ca37fe640 1 -- 172.21.15.97:0/3581800868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 msgr2=0x7f5c9c038990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f5ca37fe640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 0x7f5c9c038990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f5ca37fe640 1 -- 172.21.15.97:0/3581800868 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca404f090 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f5ca37fe640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c9c0eacc0 0x7f5c9c038ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4000b60 tx=0x7f5ca40687a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f3d4ea20640 1 -- 172.21.15.97:0/3038926793 >> v2:172.21.15.97:3300/0 conn(0x7f3d481598d0 msgr2=0x7f3d480cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f3d4ea20640 1 --2- 172.21.15.97:0/3038926793 >> v2:172.21.15.97:3300/0 conn(0x7f3d481598d0 0x7f3d480cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f3d4ea20640 1 -- 172.21.15.97:0/3038926793 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48159e20 con 0x7f3d480cf900 2023-11-24T08:06:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f3d4da1e640 1 --2- 172.21.15.97:0/3038926793 >> v2:172.21.15.97:3300/0 conn(0x7f3d481598d0 0x7f3d480cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f5c8b7fe640 1 -- 172.21.15.97:0/3581800868 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40ba650 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f5c8b7fe640 1 -- 172.21.15.97:0/3581800868 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca40ba7b0 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.540+0000 7f5c8b7fe640 1 -- 172.21.15.97:0/3581800868 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40bab20 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.541+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c0343e0 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.541+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c034980 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.541+0000 7f8ba118a640 1 Processor -- start 2023-11-24T08:06:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.542+0000 7f3d4ea20640 1 --2- 172.21.15.97:0/3038926793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 0x7f3d4806c470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d48070750 tx=0x7f3d3802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=115b85a759d9ac60 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.542+0000 7f3d4d21d640 1 -- 172.21.15.97:0/3038926793 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38031830 con 0x7f3d480cf900 2023-11-24T08:06:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.542+0000 7f3d4d21d640 1 -- 172.21.15.97:0/3038926793 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38031990 con 0x7f3d480cf900 2023-11-24T08:06:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.542+0000 7f3d4d21d640 1 -- 172.21.15.97:0/3038926793 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38031d20 con 0x7f3d480cf900 2023-11-24T08:06:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.543+0000 7f8ba118a640 1 -- start start 2023-11-24T08:06:51.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.543+0000 7f3d50483640 1 -- 172.21.15.97:0/3038926793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 msgr2=0x7f3d4806c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.543+0000 7f3d50483640 1 --2- 172.21.15.97:0/3038926793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 0x7f3d4806c470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d48070750 tx=0x7f3d3802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.543+0000 7f3d50483640 1 -- 172.21.15.97:0/3038926793 shutdown_connections 2023-11-24T08:06:51.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.543+0000 7f3d50483640 1 --2- 172.21.15.97:0/3038926793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 0x7f3d4806c470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.544+0000 7f3d50483640 1 --2- 172.21.15.97:0/3038926793 >> v2:172.21.15.97:3300/0 conn(0x7f3d481598d0 0x7f3d480cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.544+0000 7f3d50483640 1 --2- 172.21.15.97:0/3038926793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d48153a50 0x7f3d480b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.544+0000 7f3d50483640 1 -- 172.21.15.97:0/3038926793 >> 172.21.15.97:0/3038926793 conn(0x7f3d4806a800 msgr2=0x7f3d4806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.544+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c84005250 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.545+0000 7f8ba118a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8b9c0d0280 0x7f8b9c0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.545+0000 7f8ba118a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.545+0000 7f8ba118a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c0b6750 con 0x7f8b9c15d590 2023-11-24T08:06:51.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.545+0000 7f8ba118a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c0cf1f0 con 0x7f8b9c0d0280 2023-11-24T08:06:51.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.545+0000 7f8ba118a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0cef10 con 0x7f8b9c0ce6f0 2023-11-24T08:06:51.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.545+0000 7f5c8b7fe640 1 -- 172.21.15.97:0/3581800868 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ca40bac80 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.545+0000 7f3d50483640 1 -- 172.21.15.97:0/3038926793 shutdown_connections 2023-11-24T08:06:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.546+0000 7f3d50483640 1 -- 172.21.15.97:0/3038926793 wait complete. 2023-11-24T08:06:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.546+0000 7f8b9259c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8b9c0d0280 0x7f8b9c0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.546+0000 7f8b9259c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8b9c0d0280 0x7f8b9c0ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58716/0 (socket says 172.21.15.97:58716) 2023-11-24T08:06:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.546+0000 7f8b9259c640 1 -- 172.21.15.97:0/510992614 learned_addr learned my addr 172.21.15.97:0/510992614 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.546+0000 7fe947c1c640 1 Processor -- start 2023-11-24T08:06:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.546+0000 7f5c8b7fe640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9006ae90 0x7f5c9006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.547+0000 7f5c8b7fe640 1 -- 172.21.15.97:0/3581800868 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ca4125bb0 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.547+0000 7f5ca2ffd640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9006ae90 0x7f5c9006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7f3d50483640 1 Processor -- start 2023-11-24T08:06:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7f5ca2ffd640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9006ae90 0x7f5c9006d350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5c980092a0 tx=0x7f5c98009230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.547+0000 7fe947c1c640 1 -- start start 2023-11-24T08:06:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe947c1c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe94015e880 0x7fe94006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe947c1c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94009a170 0x7fe94006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe947c1c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9400cfa70 con 0x7fe940070490 2023-11-24T08:06:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe947c1c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400cff00 con 0x7fe94015e880 2023-11-24T08:06:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe947c1c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94006fc70 con 0x7fe94009a170 2023-11-24T08:06:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.547+0000 7f8b9259c640 1 -- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0ce6f0 msgr2=0x7f8b9c0b6be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:06:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.547+0000 7f8b9a59c640 1 -- 172.21.15.97:0/510992614 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142313974 0 0) 0x7f8b9c0b6750 con 0x7f8b9c15d590 2023-11-24T08:06:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.548+0000 7f8b9b59e640 1 --2- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe9461b9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94009a170 0x7fe94006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe9459b8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe94015e880 0x7fe94006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe9461b9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94009a170 0x7fe94006e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36634/0 (socket says 172.21.15.97:36634) 2023-11-24T08:06:51.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7fe9461b9640 1 -- 172.21.15.97:0/3370889560 learned_addr learned my addr 172.21.15.97:0/3370889560 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7f8b9259c640 1 --2- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.550+0000 7f3d50483640 1 -- start start 2023-11-24T08:06:51.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7f8b9259c640 1 -- 172.21.15.97:0/510992614 >> v1:172.21.15.183:6789/0 conn(0x7f8b9c15d590 legacy=0x7f8b9c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.550+0000 7fe9449b6640 1 -- 172.21.15.97:0/3370889560 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25011012 0 0) 0x7fe9400cfa70 con 0x7fe940070490 2023-11-24T08:06:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.550+0000 7fe9449b6640 1 -- 172.21.15.97:0/3370889560 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92c003520 con 0x7fe940070490 2023-11-24T08:06:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.550+0000 7fe9461b9640 1 -- 172.21.15.97:0/3370889560 >> v2:172.21.15.183:3300/0 conn(0x7fe94015e880 msgr2=0x7fe94006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.550+0000 7fe9461b9640 1 --2- 172.21.15.97:0/3370889560 >> v2:172.21.15.183:3300/0 conn(0x7fe94015e880 0x7fe94006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.550+0000 7fe9461b9640 1 -- 172.21.15.97:0/3370889560 >> v1:172.21.15.183:6789/0 conn(0x7fe940070490 legacy=0x7fe940099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.550+0000 7fe9461b9640 1 -- 172.21.15.97:0/3370889560 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400cf420 con 0x7fe94009a170 2023-11-24T08:06:51.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7f8b9259c640 1 -- 172.21.15.97:0/510992614 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0b6100 con 0x7f8b9c0d0280 2023-11-24T08:06:51.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.549+0000 7f8b9b59e640 1 --2- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:51.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.551+0000 7f8b9259c640 1 --2- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c0d0280 0x7f8b9c0ce1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009870 tx=0x7f8b8402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71b05c161c1b9d38 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.552+0000 7f8b9a59c640 1 -- 172.21.15.97:0/510992614 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84030840 con 0x7f8b9c0d0280 2023-11-24T08:06:51.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.552+0000 7f8b9a59c640 1 -- 172.21.15.97:0/510992614 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b840309a0 con 0x7f8b9c0d0280 2023-11-24T08:06:51.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.552+0000 7f8b9a59c640 1 -- 172.21.15.97:0/510992614 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84030d30 con 0x7f8b9c0d0280 2023-11-24T08:06:51.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.552+0000 7f3d50483640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 0x7f3d481ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.552+0000 7f3d50483640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d48153a50 0x7f3d48071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.552+0000 7f3d50483640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d481598d0 0x7f3d48071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.552+0000 7fe9461b9640 1 --2- 172.21.15.97:0/3370889560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94009a170 0x7fe94006e7c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e50 tx=0x7fe938030400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f8ee6ab9f92b64 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f3d50483640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48203d00 con 0x7f3d48153a50 2023-11-24T08:06:51.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 -- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c0d0280 msgr2=0x7f8b9c0ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 --2- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c0d0280 0x7f8b9c0ce1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009870 tx=0x7f8b8402b980 comp rx=0 tx=0).stop 2023-11-24T08:06:51.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f3d50483640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48203080 con 0x7f3d480cf900 2023-11-24T08:06:51.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 -- 172.21.15.97:0/510992614 shutdown_connections 2023-11-24T08:06:51.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 --2- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 --2- 172.21.15.97:0/510992614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c0d0280 0x7f8b9c0ce1b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 -- 172.21.15.97:0/510992614 >> 172.21.15.97:0/510992614 conn(0x7f8b9c09c540 msgr2=0x7f8b9c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 -- 172.21.15.97:0/510992614 shutdown_connections 2023-11-24T08:06:51.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f3d50483640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48203360 con 0x7f3d481598d0 2023-11-24T08:06:51.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f3d4e21f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 0x7f3d481ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f3d4da1e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d48153a50 0x7f3d48071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f3d4da1e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d48153a50 0x7f3d48071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57204/0 (socket says 172.21.15.97:57204) 2023-11-24T08:06:51.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f3d4da1e640 1 -- 172.21.15.97:0/3140048212 learned_addr learned my addr 172.21.15.97:0/3140048212 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.553+0000 7f8ba118a640 1 -- 172.21.15.97:0/510992614 wait complete. 2023-11-24T08:06:51.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7fe9449b6640 1 -- 172.21.15.97:0/3370889560 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938037600 con 0x7fe94009a170 2023-11-24T08:06:51.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7fe9449b6640 1 -- 172.21.15.97:0/3370889560 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe938033050 con 0x7fe94009a170 2023-11-24T08:06:51.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7fe9449b6640 1 -- 172.21.15.97:0/3370889560 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938037980 con 0x7fe94009a170 2023-11-24T08:06:51.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7f3d4da1e640 1 -- 172.21.15.97:0/3140048212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d481598d0 msgr2=0x7f3d48071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7f3d4da1e640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d481598d0 0x7f3d48071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7f3d4da1e640 1 -- 172.21.15.97:0/3140048212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 msgr2=0x7f3d481ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7f3d4da1e640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 0x7f3d481ff1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.554+0000 7f3d4da1e640 1 -- 172.21.15.97:0/3140048212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4400d8a0 con 0x7f3d48153a50 2023-11-24T08:06:51.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.555+0000 7f3d4da1e640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d48153a50 0x7f3d48071840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400bed0 tx=0x7f3d4400f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.555+0000 7f5c8b7fe640 1 -- 172.21.15.97:0/3581800868 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ca412c080 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.555+0000 7fcc7694c640 1 Processor -- start 2023-11-24T08:06:51.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.555+0000 7fcc7694c640 1 -- start start 2023-11-24T08:06:51.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.555+0000 7fb3729fa640 1 Processor -- start 2023-11-24T08:06:51.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fb3729fa640 1 -- start start 2023-11-24T08:06:51.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fe947c1c640 1 -- 172.21.15.97:0/3370889560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94009a170 msgr2=0x7fe94006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7f3d3effd640 1 -- 172.21.15.97:0/3140048212 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400ddc0 con 0x7f3d48153a50 2023-11-24T08:06:51.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3370889560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94009a170 0x7fe94006e7c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e50 tx=0x7fe938030400 comp rx=0 tx=0).stop 2023-11-24T08:06:51.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7f3d3effd640 1 -- 172.21.15.97:0/3140048212 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400fb90 con 0x7f3d48153a50 2023-11-24T08:06:51.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7f8ba118a640 1 Processor -- start 2023-11-24T08:06:51.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fe947c1c640 1 -- 172.21.15.97:0/3370889560 shutdown_connections 2023-11-24T08:06:51.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3370889560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94009a170 0x7fe94006e7c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3370889560 >> v2:172.21.15.183:3300/0 conn(0x7fe94015e880 0x7fe94006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fe947c1c640 1 -- 172.21.15.97:0/3370889560 >> 172.21.15.97:0/3370889560 conn(0x7fe9400b2d00 msgr2=0x7fe9400b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7fe947c1c640 1 -- 172.21.15.97:0/3370889560 shutdown_connections 2023-11-24T08:06:51.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.557+0000 7f8ba118a640 1 -- start start 2023-11-24T08:06:51.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.557+0000 7fcc7694c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc7015d590 0x7fcc700cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7f3d3effd640 1 -- 172.21.15.97:0/3140048212 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44016420 con 0x7f3d48153a50 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d38009400 con 0x7f3d48153a50 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.556+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d48203920 con 0x7f3d48153a50 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fb3729fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3640e1060 0x7fb364038600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fb3729fa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb364050da0 0x7fb364039e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fb3729fa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36404f510 con 0x7fb36403a3d0 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fb3729fa640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36404f7f0 con 0x7fb364050da0 2023-11-24T08:06:51.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fb3729fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36404fad0 con 0x7fb3640e1060 2023-11-24T08:06:51.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.557+0000 7fe947c1c640 1 -- 172.21.15.97:0/3370889560 wait complete. 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.557+0000 7fcc7694c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700d00b0 0x7fcc700ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fcc7694c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700b6750 con 0x7fcc700ce6f0 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fcc7694c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc700d0530 con 0x7fcc7015d590 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fcc7694c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700cf1f0 con 0x7fcc700d00b0 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fcc6ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc7015d590 0x7fcc700cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fcc6ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc7015d590 0x7fcc700cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57220/0 (socket says 172.21.15.97:57220) 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.558+0000 7fcc6ffff640 1 -- 172.21.15.97:0/93755560 learned_addr learned my addr 172.21.15.97:0/93755560 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fcc6f7fe640 1 --2- 172.21.15.97:0/93755560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700d00b0 0x7fcc700ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fb3721f9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb36403a3d0 0x7fb3640e4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43554/0 (socket says 172.21.15.97:43554) 2023-11-24T08:06:51.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fb3719f8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3640e1060 0x7fb364038600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fb3721f9640 1 -- 172.21.15.97:0/1516833843 learned_addr learned my addr 172.21.15.97:0/1516833843 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:51.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7f8ba118a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fcc6ffff640 1 -- 172.21.15.97:0/93755560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700d00b0 msgr2=0x7fcc700ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fcc6ffff640 1 --2- 172.21.15.97:0/93755560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700d00b0 0x7fcc700ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fcc6ffff640 1 -- 172.21.15.97:0/93755560 >> v1:172.21.15.183:6789/0 conn(0x7fcc700ce6f0 legacy=0x7fcc700d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fcc6ffff640 1 -- 172.21.15.97:0/93755560 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700cef10 con 0x7fcc7015d590 2023-11-24T08:06:51.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7fe947c1c640 1 Processor -- start 2023-11-24T08:06:51.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7f8ba118a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0d0280 0x7f8b9c1f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.559+0000 7f8ba118a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c15d590 0x7f8b9c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7fb3719f8640 1 -- 172.21.15.97:0/1516833843 >> v2:172.21.15.97:3300/0 conn(0x7fb364050da0 msgr2=0x7fb364039e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:51.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7f8ba118a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c1f36d0 con 0x7f8b9c0ce6f0 2023-11-24T08:06:51.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7fb3719f8640 1 --2- 172.21.15.97:0/1516833843 >> v2:172.21.15.97:3300/0 conn(0x7fb364050da0 0x7fb364039e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7fb3719f8640 1 -- 172.21.15.97:0/1516833843 >> v1:172.21.15.97:6789/0 conn(0x7fb36403a3d0 legacy=0x7fb3640e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7fb3719f8640 1 -- 172.21.15.97:0/1516833843 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36404fdb0 con 0x7fb3640e1060 2023-11-24T08:06:51.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7f8ba118a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c1f39b0 con 0x7f8b9c15d590 2023-11-24T08:06:51.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7f8ba118a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0ccde0 con 0x7f8b9c0d0280 2023-11-24T08:06:51.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7fe947c1c640 1 -- start start 2023-11-24T08:06:51.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480675d0 con 0x7f3d48153a50 2023-11-24T08:06:51.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.560+0000 7f8b9b59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c15d590 0x7f8b9c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.561+0000 7f8b9b59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c15d590 0x7f8b9c0b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58742/0 (socket says 172.21.15.97:58742) 2023-11-24T08:06:51.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.561+0000 7f8b9b59e640 1 -- 172.21.15.97:0/1082112317 learned_addr learned my addr 172.21.15.97:0/1082112317 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.561+0000 7fcc6ffff640 1 --2- 172.21.15.97:0/93755560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc700cfb70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009870 tx=0x7fcc6002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fae5c6241af7ae6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.561+0000 7fb3719f8640 1 --2- 172.21.15.97:0/1516833843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3640e1060 0x7fb364038600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0097a0 tx=0x7fb35c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b560069691278b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.561+0000 7f8b9259c640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0d0280 0x7f8b9c1f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7fb3709f6640 1 -- 172.21.15.97:0/1516833843 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c02d040 con 0x7fb3640e1060 2023-11-24T08:06:51.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7fb3709f6640 1 -- 172.21.15.97:0/1516833843 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c031810 con 0x7fb3640e1060 2023-11-24T08:06:51.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7fb3709f6640 1 -- 172.21.15.97:0/1516833843 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c031ba0 con 0x7fb3640e1060 2023-11-24T08:06:51.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7fe947c1c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe940070490 0x7fe9400b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7fe947c1c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94009a170 0x7fe9400c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe947c1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94015e880 0x7fe9401ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7f8b9ad9d640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7f8b9b59e640 1 -- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0d0280 msgr2=0x7f8b9c1f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7f8b9b59e640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0d0280 0x7f8b9c1f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7f8b9b59e640 1 -- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b9c0ce6f0 msgr2=0x7f8b9c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7f8b9b59e640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7f8b9b59e640 1 -- 172.21.15.97:0/1082112317 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840094d0 con 0x7f8b9c15d590 2023-11-24T08:06:51.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fb3729fa640 1 -- 172.21.15.97:0/1516833843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3640e1060 msgr2=0x7fb364038600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fb3729fa640 1 --2- 172.21.15.97:0/1516833843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3640e1060 0x7fb364038600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0097a0 tx=0x7fb35c02b8b0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe947c1c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400c9520 con 0x7fe94015e880 2023-11-24T08:06:51.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe947c1c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400c9800 con 0x7fe94009a170 2023-11-24T08:06:51.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe947c1c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400c9ae0 con 0x7fe940070490 2023-11-24T08:06:51.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe9451b7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94009a170 0x7fe9400c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe9459b8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe940070490 0x7fe9400b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe9459b8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe940070490 0x7fe9400b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36666/0 (socket says 172.21.15.97:36666) 2023-11-24T08:06:51.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fe9459b8640 1 -- 172.21.15.97:0/3086338099 learned_addr learned my addr 172.21.15.97:0/3086338099 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fb3729fa640 1 -- 172.21.15.97:0/1516833843 shutdown_connections 2023-11-24T08:06:51.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fb3729fa640 1 --2- 172.21.15.97:0/1516833843 >> v2:172.21.15.97:3300/0 conn(0x7fb364050da0 0x7fb364039e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fb3729fa640 1 --2- 172.21.15.97:0/1516833843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3640e1060 0x7fb364038600 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7fb3729fa640 1 -- 172.21.15.97:0/1516833843 >> 172.21.15.97:0/1516833843 conn(0x7fb364009f80 msgr2=0x7fb36400a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.563+0000 7f3d3effd640 1 -- 172.21.15.97:0/3140048212 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d44014070 con 0x7f3d48153a50 2023-11-24T08:06:51.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fb3729fa640 1 -- 172.21.15.97:0/1516833843 shutdown_connections 2023-11-24T08:06:51.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fe9459b8640 1 -- 172.21.15.97:0/3086338099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94009a170 msgr2=0x7fe9400c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fe9459b8640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94009a170 0x7fe9400c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fe9459b8640 1 -- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94015e880 msgr2=0x7fe9401ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fe9459b8640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94015e880 0x7fe9401ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fe9459b8640 1 -- 172.21.15.97:0/3086338099 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938009b30 con 0x7fe940070490 2023-11-24T08:06:51.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fb3729fa640 1 -- 172.21.15.97:0/1516833843 wait complete. 2023-11-24T08:06:51.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.564+0000 7fe9459b8640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe940070490 0x7fe9400b2770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00e870 tx=0x7fe93c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.562+0000 7fcc6effd640 1 -- 172.21.15.97:0/93755560 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60031640 con 0x7fcc7015d590 2023-11-24T08:06:51.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7fcc6effd640 1 -- 172.21.15.97:0/93755560 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc600317a0 con 0x7fcc7015d590 2023-11-24T08:06:51.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7fcc6effd640 1 -- 172.21.15.97:0/93755560 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60031b30 con 0x7fcc7015d590 2023-11-24T08:06:51.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7fe9367fc640 1 -- 172.21.15.97:0/3086338099 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0094f0 con 0x7fe940070490 2023-11-24T08:06:51.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7fe9367fc640 1 -- 172.21.15.97:0/3086338099 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00c940 con 0x7fe940070490 2023-11-24T08:06:51.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7fe9367fc640 1 -- 172.21.15.97:0/3086338099 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00ccf0 con 0x7fe940070490 2023-11-24T08:06:51.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7f3d3effd640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d2c06af10 0x7f3d2c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7f3d3effd640 1 -- 172.21.15.97:0/3140048212 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d44088fc0 con 0x7f3d48153a50 2023-11-24T08:06:51.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.565+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9400c9dc0 con 0x7fe940070490 2023-11-24T08:06:51.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.566+0000 7f3d4e21f640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d2c06af10 0x7f3d2c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.566+0000 7fcc7694c640 1 -- 172.21.15.97:0/93755560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 msgr2=0x7fcc700cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.566+0000 7fcc7694c640 1 --2- 172.21.15.97:0/93755560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc700cfb70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009870 tx=0x7fcc6002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.566+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9400ca8b0 con 0x7fe940070490 2023-11-24T08:06:51.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.566+0000 7f8b9b59e640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c15d590 0x7f8b9c0b4e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400c7f0 tx=0x7f8b9400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7fb3729fa640 1 Processor -- start 2023-11-24T08:06:51.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7f3d4e21f640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d2c06af10 0x7f3d2c06d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d40011360 tx=0x7f3d4000d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7f8b93fff640 1 -- 172.21.15.97:0/1082112317 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94007820 con 0x7f8b9c15d590 2023-11-24T08:06:51.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7f8b93fff640 1 -- 172.21.15.97:0/1082112317 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b94007980 con 0x7f8b9c15d590 2023-11-24T08:06:51.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7f8b93fff640 1 -- 172.21.15.97:0/1082112317 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94007d70 con 0x7f8b9c15d590 2023-11-24T08:06:51.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c0cd0c0 con 0x7f8b9c15d590 2023-11-24T08:06:51.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c0ca820 con 0x7f8b9c15d590 2023-11-24T08:06:51.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.568+0000 7fcc7694c640 1 -- 172.21.15.97:0/93755560 shutdown_connections 2023-11-24T08:06:51.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.568+0000 7fcc7694c640 1 --2- 172.21.15.97:0/93755560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700d00b0 0x7fcc700ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fcc7694c640 1 --2- 172.21.15.97:0/93755560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc700cfb70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fcc7694c640 1 -- 172.21.15.97:0/93755560 >> 172.21.15.97:0/93755560 conn(0x7fcc7009c540 msgr2=0x7fcc700d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.567+0000 7fb3729fa640 1 -- start start 2023-11-24T08:06:51.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fb3729fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb36403a3d0 0x7fb364186af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fb3729fa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb364050da0 0x7fb36417f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fb3729fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3640e1060 0x7fb36404a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fb3729fa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36417fe50 con 0x7fb364050da0 2023-11-24T08:06:51.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fb3729fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36404ae10 con 0x7fb3640e1060 2023-11-24T08:06:51.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fb3729fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb364185d10 con 0x7fb36403a3d0 2023-11-24T08:06:51.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.568+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94015b010 con 0x7fe940070490 2023-11-24T08:06:51.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.569+0000 7fb3711f7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb364050da0 0x7fb36417f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.570+0000 7fb3711f7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb364050da0 0x7fb36417f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57256/0 (socket says 172.21.15.97:57256) 2023-11-24T08:06:51.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.570+0000 7fb3711f7640 1 -- 172.21.15.97:0/2887693141 learned_addr learned my addr 172.21.15.97:0/2887693141 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.570+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b80005250 con 0x7f8b9c15d590 2023-11-24T08:06:51.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.570+0000 7fb3719f8640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb36403a3d0 0x7fb364186af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.570+0000 7fb3721f9640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3640e1060 0x7fb36404a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.570+0000 7fcc7694c640 1 -- 172.21.15.97:0/93755560 shutdown_connections 2023-11-24T08:06:51.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fb3711f7640 1 -- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb36403a3d0 msgr2=0x7fb364186af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fb3711f7640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb36403a3d0 0x7fb364186af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fb3711f7640 1 -- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3640e1060 msgr2=0x7fb36404a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fb3711f7640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3640e1060 0x7fb36404a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fb3711f7640 1 -- 172.21.15.97:0/2887693141 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c009400 con 0x7fb364050da0 2023-11-24T08:06:51.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7f3d3effd640 1 -- 172.21.15.97:0/3140048212 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d44054190 con 0x7f3d48153a50 2023-11-24T08:06:51.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.570+0000 7fe9367fc640 1 -- 172.21.15.97:0/3086338099 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe93c013470 con 0x7fe940070490 2023-11-24T08:06:51.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fcc7694c640 1 -- 172.21.15.97:0/93755560 wait complete. 2023-11-24T08:06:51.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fb3711f7640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb364050da0 0x7fb36417f910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb36800b4a0 tx=0x7fb36800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.571+0000 7fb3627fc640 1 -- 172.21.15.97:0/2887693141 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368010610 con 0x7fb364050da0 2023-11-24T08:06:51.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.572+0000 7fb3627fc640 1 -- 172.21.15.97:0/2887693141 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368010770 con 0x7fb364050da0 2023-11-24T08:06:51.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.572+0000 7fb3627fc640 1 -- 172.21.15.97:0/2887693141 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368010b20 con 0x7fb364050da0 2023-11-24T08:06:51.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.572+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb364185ff0 con 0x7fb364050da0 2023-11-24T08:06:51.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.572+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3641865b0 con 0x7fb364050da0 2023-11-24T08:06:51.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.572+0000 7f8b93fff640 1 -- 172.21.15.97:0/1082112317 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b94011600 con 0x7f8b9c15d590 2023-11-24T08:06:51.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.574+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36404d1d0 con 0x7fb364050da0 2023-11-24T08:06:51.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.574+0000 7f8b93fff640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b7c06af40 0x7f8b7c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.574+0000 7f8b93fff640 1 -- 172.21.15.97:0/1082112317 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b94089a60 con 0x7f8b9c15d590 2023-11-24T08:06:51.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.574+0000 7f8b9ad9d640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b7c06af40 0x7f8b7c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.575+0000 7f8b9ad9d640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b7c06af40 0x7f8b7c06d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0012e0 tx=0x7f8b8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.574+0000 7fcc7694c640 1 Processor -- start 2023-11-24T08:06:51.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.575+0000 7fcc7694c640 1 -- start start 2023-11-24T08:06:51.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.575+0000 7fe9367fc640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe92406af10 0x7fe92406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.575+0000 7fe9367fc640 1 -- 172.21.15.97:0/3086338099 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe93c089950 con 0x7fe940070490 2023-11-24T08:06:51.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.576+0000 7fe9451b7640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe92406af10 0x7fe92406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.576+0000 7fcc7694c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700ce6f0 0x7fcc7015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc7694c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc700d00b0 0x7fcc70156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc7694c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc7009e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc7694c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7006fa80 con 0x7fcc7015d590 2023-11-24T08:06:51.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc7694c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7009eb40 con 0x7fcc700d00b0 2023-11-24T08:06:51.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.576+0000 7fb3627fc640 1 -- 172.21.15.97:0/2887693141 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb368010c80 con 0x7fb364050da0 2023-11-24T08:06:51.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fb3627fc640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb35006ae90 0x7fb35006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fb3627fc640 1 -- 172.21.15.97:0/2887693141 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3680892a0 con 0x7fb364050da0 2023-11-24T08:06:51.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc7694c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7006f700 con 0x7fcc700ce6f0 2023-11-24T08:06:51.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc74ee9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc7009e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc74ee9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc7009e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57272/0 (socket says 172.21.15.97:57272) 2023-11-24T08:06:51.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc74ee9640 1 -- 172.21.15.97:0/1310319642 learned_addr learned my addr 172.21.15.97:0/1310319642 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:51.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fcc6f7fe640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc700d00b0 0x7fcc70156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc6ffff640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700ce6f0 0x7fcc7015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.577+0000 7fb3719f8640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb35006ae90 0x7fb35006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc74ee9640 1 -- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700ce6f0 msgr2=0x7fcc7015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc74ee9640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700ce6f0 0x7fcc7015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc74ee9640 1 -- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc700d00b0 msgr2=0x7fcc70156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc74ee9640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc700d00b0 0x7fcc70156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc74ee9640 1 -- 172.21.15.97:0/1310319642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600094d0 con 0x7fcc7015d590 2023-11-24T08:06:51.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc6ffff640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700ce6f0 0x7fcc7015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:51.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc6f7fe640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc700d00b0 0x7fcc70156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:51.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.578+0000 7fcc74ee9640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc7009e600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800b9a0 tx=0x7fcc6800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.579+0000 7fe9451b7640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe92406af10 0x7fe92406d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe9401fa370 tx=0x7fe930009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.579+0000 7fb3719f8640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb35006ae90 0x7fb35006d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb35c036000 tx=0x7fb35c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.582+0000 7fcc6cff9640 1 -- 172.21.15.97:0/1310319642 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800cba0 con 0x7fcc7015d590 2023-11-24T08:06:51.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.582+0000 7fcc6cff9640 1 -- 172.21.15.97:0/1310319642 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800cd00 con 0x7fcc7015d590 2023-11-24T08:06:51.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.582+0000 7fcc6cff9640 1 -- 172.21.15.97:0/1310319642 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68014680 con 0x7fcc7015d590 2023-11-24T08:06:51.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.582+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc70070e50 con 0x7fcc7015d590 2023-11-24T08:06:51.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.582+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc70071410 con 0x7fcc7015d590 2023-11-24T08:06:51.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.582+0000 7fb3627fc640 1 -- 172.21.15.97:0/2887693141 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb36404d1d0 con 0x7fb364050da0 2023-11-24T08:06:51.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.584+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7006fbc0 con 0x7fcc7015d590 2023-11-24T08:06:51.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.585+0000 7fcc6cff9640 1 -- 172.21.15.97:0/1310319642 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc6801d3b0 con 0x7fcc7015d590 2023-11-24T08:06:51.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.585+0000 7f8b93fff640 1 -- 172.21.15.97:0/1082112317 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b94054c30 con 0x7f8b9c15d590 2023-11-24T08:06:51.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.586+0000 7fcc6cff9640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcc5c06ae90 0x7fcc5c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:51.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.586+0000 7fcc6cff9640 1 -- 172.21.15.97:0/1310319642 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc68089400 con 0x7fcc7015d590 2023-11-24T08:06:51.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.587+0000 7fcc6ffff640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcc5c06ae90 0x7fcc5c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:51.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.588+0000 7fe9367fc640 1 -- 172.21.15.97:0/3086338099 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe93c054a90 con 0x7fe940070490 2023-11-24T08:06:51.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.588+0000 7fcc6ffff640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcc5c06ae90 0x7fcc5c06d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc60036000 tx=0x7fcc6003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:51.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.595+0000 7fcc6cff9640 1 -- 172.21.15.97:0/1310319642 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc7006fbc0 con 0x7fcc7015d590 2023-11-24T08:06:51.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.890+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c68005500 con 0x7f3c8004f8d0 2023-11-24T08:06:51.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.891+0000 7f3c84ff9640 1 -- 172.21.15.97:0/1769561027 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c880c1040 con 0x7f3c8004f8d0 2023-11-24T08:06:51.893 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:51.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.894+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3c6c06ae90 msgr2=0x7f3c6c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.895+0000 7f3c8d472640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3c6c06ae90 0x7f3c6c06d350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00b810 tx=0x7f3c7c008040 comp rx=0 tx=0).stop 2023-11-24T08:06:51.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.895+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8004f8d0 msgr2=0x7f3c801823d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.895+0000 7f3c8d472640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8004f8d0 0x7f3c801823d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c88050140 tx=0x7f3c880748f0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 shutdown_connections 2023-11-24T08:06:51.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3c6c06ae90 0x7f3c6c06d350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c80053790 0x7f3c8004aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8004f8d0 0x7f3c801823d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 --2- 172.21.15.97:0/1769561027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c80005e60 0x7f3c80047110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 >> 172.21.15.97:0/1769561027 conn(0x7f3c80009f80 msgr2=0x7f3c800e8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 shutdown_connections 2023-11-24T08:06:51.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.896+0000 7f3c8d472640 1 -- 172.21.15.97:0/1769561027 wait complete. 2023-11-24T08:06:51.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2023-11-24T08:06:51.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.936+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e5c1442b0 con 0x7f7e5c070ea0 2023-11-24T08:06:51.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.937+0000 7f7e58ff9640 1 -- 172.21.15.97:0/4076922206 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e4c040070 con 0x7f7e5c070ea0 2023-11-24T08:06:51.938 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:51.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.940+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7e4806ae40 msgr2=0x7f7e4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.940+0000 7f7e62456640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7e4806ae40 0x7f7e4806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009fd0 tx=0x7f7e5400b040 comp rx=0 tx=0).stop 2023-11-24T08:06:51.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e5c070ea0 msgr2=0x7f7e5c143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e5c070ea0 0x7f7e5c143d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009990 tx=0x7f7e4c004730 comp rx=0 tx=0).stop 2023-11-24T08:06:51.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 shutdown_connections 2023-11-24T08:06:51.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7e4806ae40 0x7f7e4806d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e5c14b2c0 0x7f7e5c162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5c0cf7d0 0x7f7e5c1f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 --2- 172.21.15.97:0/4076922206 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e5c070ea0 0x7f7e5c143d70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.941+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 >> 172.21.15.97:0/4076922206 conn(0x7f7e5c06a800 msgr2=0x7f7e5c0aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.942+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 shutdown_connections 2023-11-24T08:06:51.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.942+0000 7f7e62456640 1 -- 172.21.15.97:0/4076922206 wait complete. 2023-11-24T08:06:51.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.956+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8b800057d0 con 0x7f8b9c15d590 2023-11-24T08:06:51.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.957+0000 7f8b93fff640 1 -- 172.21.15.97:0/1082112317 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b94058250 con 0x7f8b9c15d590 2023-11-24T08:06:51.959 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:51.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b7c06af40 msgr2=0x7f8b7c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b7c06af40 0x7f8b7c06d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0012e0 tx=0x7f8b8c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:51.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c15d590 msgr2=0x7f8b9c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c15d590 0x7f8b9c0b4e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400c7f0 tx=0x7f8b9400ccb0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 shutdown_connections 2023-11-24T08:06:51.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b7c06af40 0x7f8b7c06d400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9c15d590 0x7f8b9c0b4e00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b9c0d0280 0x7f8b9c1f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 --2- 172.21.15.97:0/1082112317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8b9c0ce6f0 0x7f8b9c0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 >> 172.21.15.97:0/1082112317 conn(0x7f8b9c09c540 msgr2=0x7f8b9c06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.960+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 shutdown_connections 2023-11-24T08:06:51.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.961+0000 7f8ba118a640 1 -- 172.21.15.97:0/1082112317 wait complete. 2023-11-24T08:06:51.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2023-11-24T08:06:51.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2023-11-24T08:06:51.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.978+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c840057d0 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.978+0000 7f5c8b7fe640 1 -- 172.21.15.97:0/3581800868 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ca40b3090 con 0x7f5c9c0eacc0 2023-11-24T08:06:51.980 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9006ae90 msgr2=0x7f5c9006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9006ae90 0x7f5c9006d350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5c980092a0 tx=0x7f5c98009230 comp rx=0 tx=0).stop 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c9c0eacc0 msgr2=0x7f5c9c038ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c9c0eacc0 0x7f5c9c038ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4000b60 tx=0x7f5ca40687a0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 shutdown_connections 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9006ae90 0x7f5c9006d350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c9c0eacc0 0x7f5c9c038ed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c9c0067d0 0x7f5c9c038990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 --2- 172.21.15.97:0/3581800868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c9c005e50 0x7f5c9c17c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 >> 172.21.15.97:0/3581800868 conn(0x7f5c9c009f70 msgr2=0x7f5c9c04f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 shutdown_connections 2023-11-24T08:06:51.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.982+0000 7f5ca95e5640 1 -- 172.21.15.97:0/3581800868 wait complete. 2023-11-24T08:06:51.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.983+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe9400c9c20 con 0x7fe940070490 2023-11-24T08:06:51.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.984+0000 7fe9367fc640 1 -- 172.21.15.97:0/3086338099 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9400c9c20 con 0x7fe940070490 2023-11-24T08:06:51.986 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe92406af10 msgr2=0x7fe92406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe92406af10 0x7fe92406d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe9401fa370 tx=0x7fe930009040 comp rx=0 tx=0).stop 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe940070490 msgr2=0x7fe9400b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe940070490 0x7fe9400b2770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00e870 tx=0x7fe93c00ed30 comp rx=0 tx=0).stop 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 shutdown_connections 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe92406af10 0x7fe92406d3d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe94015e880 0x7fe9401ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94009a170 0x7fe9400c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 --2- 172.21.15.97:0/3086338099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe940070490 0x7fe9400b2770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 >> 172.21.15.97:0/3086338099 conn(0x7fe9400b2d00 msgr2=0x7fe94006ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 shutdown_connections 2023-11-24T08:06:51.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.986+0000 7fe947c1c640 1 -- 172.21.15.97:0/3086338099 wait complete. 2023-11-24T08:06:51.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.988+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d48071320 con 0x7f3d48153a50 2023-11-24T08:06:51.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.988+0000 7f3d3effd640 1 -- 172.21.15.97:0/3140048212 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d4401b090 con 0x7f3d48153a50 2023-11-24T08:06:51.990 INFO:teuthology.orchestra.run.smithi097.stdout:60129542147 2023-11-24T08:06:51.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d2c06af10 msgr2=0x7f3d2c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d2c06af10 0x7f3d2c06d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d40011360 tx=0x7f3d4000d040 comp rx=0 tx=0).stop 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d48153a50 msgr2=0x7f3d48071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d48153a50 0x7f3d48071840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400bed0 tx=0x7f3d4400f480 comp rx=0 tx=0).stop 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 shutdown_connections 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d2c06af10 0x7f3d2c06d3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d481598d0 0x7f3d48071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d48153a50 0x7f3d48071840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 --2- 172.21.15.97:0/3140048212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d480cf900 0x7f3d481ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:51.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 >> 172.21.15.97:0/3140048212 conn(0x7f3d4806a800 msgr2=0x7f3d4806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:51.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 shutdown_connections 2023-11-24T08:06:51.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.992+0000 7f3d50483640 1 -- 172.21.15.97:0/3140048212 wait complete. 2023-11-24T08:06:51.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.994+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb36404d1d0 con 0x7fb364050da0 2023-11-24T08:06:51.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.994+0000 7fb3627fc640 1 -- 172.21.15.97:0/2887693141 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb36404d1d0 con 0x7fb364050da0 2023-11-24T08:06:51.996 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb35006ae90 msgr2=0x7fb35006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb35006ae90 0x7fb35006d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb35c036000 tx=0x7fb35c03c040 comp rx=0 tx=0).stop 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb364050da0 msgr2=0x7fb36417f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb364050da0 0x7fb36417f910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb36800b4a0 tx=0x7fb36800b960 comp rx=0 tx=0).stop 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 shutdown_connections 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb35006ae90 0x7fb35006d350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3640e1060 0x7fb36404a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb364050da0 0x7fb36417f910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 --2- 172.21.15.97:0/2887693141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb36403a3d0 0x7fb364186af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 >> 172.21.15.97:0/2887693141 conn(0x7fb364009f80 msgr2=0x7fb3640e02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:52.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 shutdown_connections 2023-11-24T08:06:52.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:51.998+0000 7fb3729fa640 1 -- 172.21.15.97:0/2887693141 wait complete. 2023-11-24T08:06:52.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2023-11-24T08:06:52.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2023-11-24T08:06:52.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.007+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcc7006fbc0 con 0x7fcc7015d590 2023-11-24T08:06:52.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.007+0000 7fcc6cff9640 1 -- 172.21.15.97:0/1310319642 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc7006fbc0 con 0x7fcc7015d590 2023-11-24T08:06:52.009 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2023-11-24T08:06:52.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcc5c06ae90 msgr2=0x7fcc5c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcc5c06ae90 0x7fcc5c06d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc60036000 tx=0x7fcc6003c040 comp rx=0 tx=0).stop 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 msgr2=0x7fcc7009e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc7009e600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800b9a0 tx=0x7fcc6800be60 comp rx=0 tx=0).stop 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 shutdown_connections 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcc5c06ae90 0x7fcc5c06d350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc7015d590 0x7fcc7009e600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc700d00b0 0x7fcc70156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 --2- 172.21.15.97:0/1310319642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc700ce6f0 0x7fcc7015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:52.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 >> 172.21.15.97:0/1310319642 conn(0x7fcc7009c540 msgr2=0x7fcc7015c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:52.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 shutdown_connections 2023-11-24T08:06:52.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:52.011+0000 7fcc7694c640 1 -- 172.21.15.97:0/1310319642 wait complete. 2023-11-24T08:06:52.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.3 2023-11-24T08:06:52.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2023-11-24T08:06:52.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.7 2023-11-24T08:06:52.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:06:52.971 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:06:52.982 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:06:53.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:06:53.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:06:53.015 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:06:53.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:06:53.030 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:06:53.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.173+0000 7f3800ec9640 1 Processor -- start 2023-11-24T08:06:53.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.173+0000 7f3800ec9640 1 -- start start 2023-11-24T08:06:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.175+0000 7f3800ec9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f37fc0b1d90 0x7f37fc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.176+0000 7f3800ec9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc0b26b0 con 0x7f37fc0b47a0 2023-11-24T08:06:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.176+0000 7f3800ec9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc0ac970 con 0x7f37fc140870 2023-11-24T08:06:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.176+0000 7f3800ec9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc15e810 con 0x7f37fc0b1d90 2023-11-24T08:06:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.176+0000 7f37f9d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f37fc0b47a0 0x7f37fc0ada10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43568/0 (socket says 172.21.15.97:43568) 2023-11-24T08:06:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.176+0000 7f37f9d9b640 1 -- 172.21.15.97:0/1123439385 learned_addr learned my addr 172.21.15.97:0/1123439385 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.176+0000 7f37fa59c640 1 --2- 172.21.15.97:0/1123439385 >> v2:172.21.15.183:3300/0 conn(0x7f37fc0b1d90 0x7f37fc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.177+0000 7f37f959a640 1 -- 172.21.15.97:0/1123439385 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794239933 0 0) 0x7f37fc0b26b0 con 0x7f37fc0b47a0 2023-11-24T08:06:53.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.177+0000 7f37f959a640 1 -- 172.21.15.97:0/1123439385 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e4003520 con 0x7f37fc0b47a0 2023-11-24T08:06:53.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.177+0000 7f37fa59c640 1 -- 172.21.15.97:0/1123439385 >> v1:172.21.15.183:6789/0 conn(0x7f37fc140870 legacy=0x7f37fc0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.177+0000 7f37fa59c640 1 -- 172.21.15.97:0/1123439385 >> v1:172.21.15.97:6789/0 conn(0x7f37fc0b47a0 legacy=0x7f37fc0ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.177+0000 7f37fa59c640 1 -- 172.21.15.97:0/1123439385 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc0acc50 con 0x7f37fc0b1d90 2023-11-24T08:06:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.179+0000 7f37fa59c640 1 --2- 172.21.15.97:0/1123439385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc0b1d90 0x7f37fc0b2170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=362f567be2f12eb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.180+0000 7f37f959a640 1 -- 172.21.15.97:0/1123439385 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0031640 con 0x7f37fc0b1d90 2023-11-24T08:06:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.180+0000 7f37f959a640 1 -- 172.21.15.97:0/1123439385 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00317a0 con 0x7f37fc0b1d90 2023-11-24T08:06:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.180+0000 7f37f959a640 1 -- 172.21.15.97:0/1123439385 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0031b70 con 0x7f37fc0b1d90 2023-11-24T08:06:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.181+0000 7f3800ec9640 1 -- 172.21.15.97:0/1123439385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc0b1d90 msgr2=0x7f37fc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.181+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1123439385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc0b1d90 0x7f37fc0b2170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.181+0000 7f3800ec9640 1 -- 172.21.15.97:0/1123439385 shutdown_connections 2023-11-24T08:06:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.181+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1123439385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc0b1d90 0x7f37fc0b2170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.182+0000 7f3800ec9640 1 -- 172.21.15.97:0/1123439385 >> 172.21.15.97:0/1123439385 conn(0x7f37fc0aea00 msgr2=0x7f37fc0aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.182+0000 7f3800ec9640 1 -- 172.21.15.97:0/1123439385 shutdown_connections 2023-11-24T08:06:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.182+0000 7f3800ec9640 1 -- 172.21.15.97:0/1123439385 wait complete. 2023-11-24T08:06:53.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.185+0000 7f3800ec9640 1 Processor -- start 2023-11-24T08:06:53.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.186+0000 7f3800ec9640 1 -- start start 2023-11-24T08:06:53.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.188+0000 7f3800ec9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b1d90 0x7f37fc1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.189+0000 7f37fa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b1d90 0x7f37fc1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.189+0000 7f37fa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b1d90 0x7f37fc1588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57276/0 (socket says 172.21.15.97:57276) 2023-11-24T08:06:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.189+0000 7f3800ec9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc0b47a0 0x7f37fc15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.189+0000 7f37fa59c640 1 -- 172.21.15.97:0/1484959972 learned_addr learned my addr 172.21.15.97:0/1484959972 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.189+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc140870 0x7f37fc156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.190+0000 7f37f9d9b640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc0b47a0 0x7f37fc15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.190+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0c4810 con 0x7f37fc0b1d90 2023-11-24T08:06:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.190+0000 7f37fad9d640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc140870 0x7f37fc156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.190+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc0c4ad0 con 0x7f37fc140870 2023-11-24T08:06:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.190+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc1591b0 con 0x7f37fc0b47a0 2023-11-24T08:06:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.192+0000 7f37fad9d640 1 -- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc0b47a0 msgr2=0x7f37fc15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.192+0000 7f37fad9d640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc0b47a0 0x7f37fc15ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.192+0000 7f37fad9d640 1 -- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b1d90 msgr2=0x7f37fc1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.192+0000 7f37fad9d640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b1d90 0x7f37fc1588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.192+0000 7f37fad9d640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0009400 con 0x7f37fc140870 2023-11-24T08:06:53.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.193+0000 7f37fa59c640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b1d90 0x7f37fc1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:53.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.193+0000 7f37f9d9b640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc0b47a0 0x7f37fc15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:53.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.194+0000 7f37fad9d640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc140870 0x7f37fc156220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c730 tx=0x7f37f400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.194+0000 7f37eaffd640 1 -- 172.21.15.97:0/1484959972 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4003b70 con 0x7f37fc140870 2023-11-24T08:06:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.195+0000 7f37eaffd640 1 -- 172.21.15.97:0/1484959972 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4003cf0 con 0x7f37fc140870 2023-11-24T08:06:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.195+0000 7f37eaffd640 1 -- 172.21.15.97:0/1484959972 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4003ea0 con 0x7f37fc140870 2023-11-24T08:06:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.195+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc159490 con 0x7f37fc140870 2023-11-24T08:06:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.195+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc158e10 con 0x7f37fc140870 2023-11-24T08:06:53.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.197+0000 7f37e8ff9640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc067450 con 0x7f37fc140870 2023-11-24T08:06:53.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.199+0000 7f37eaffd640 1 -- 172.21.15.97:0/1484959972 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37f4005310 con 0x7f37fc140870 2023-11-24T08:06:53.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.200+0000 7f37eaffd640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37dc06ae40 0x7f37dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.201+0000 7f37eaffd640 1 -- 172.21.15.97:0/1484959972 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37f4089180 con 0x7f37fc140870 2023-11-24T08:06:53.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.202+0000 7f37fa59c640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37dc06ae40 0x7f37dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.203+0000 7f37fa59c640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37dc06ae40 0x7f37dc06d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f37f0000c00 tx=0x7f37f003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.214+0000 7f37eaffd640 1 -- 172.21.15.97:0/1484959972 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37f40542d0 con 0x7f37fc140870 2023-11-24T08:06:53.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.231+0000 7f961eb2c640 1 Processor -- start 2023-11-24T08:06:53.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.231+0000 7f961eb2c640 1 -- start start 2023-11-24T08:06:53.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.233+0000 7f961eb2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f961815d590 0x7f96180cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.233+0000 7f961eb2c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96180d00b0 0x7f96180ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.233+0000 7f961eb2c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96180b6750 con 0x7f96180ce6f0 2023-11-24T08:06:53.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.233+0000 7f961eb2c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180d0530 con 0x7f96180d00b0 2023-11-24T08:06:53.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.233+0000 7f961eb2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180cf1f0 con 0x7f961815d590 2023-11-24T08:06:53.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.234+0000 7f9617fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96180d00b0 0x7f96180ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.234+0000 7f961d0c9640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f96180ce6f0 0x7f96180d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50956/0 (socket says 172.21.15.97:50956) 2023-11-24T08:06:53.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.234+0000 7f961d0c9640 1 -- 172.21.15.97:0/770482183 learned_addr learned my addr 172.21.15.97:0/770482183 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:53.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.234+0000 7f961c8c8640 1 --2- 172.21.15.97:0/770482183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f961815d590 0x7f96180cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.235+0000 7f9617fff640 1 -- 172.21.15.97:0/770482183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f961815d590 msgr2=0x7f96180cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.235+0000 7f9617fff640 1 --2- 172.21.15.97:0/770482183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f961815d590 0x7f96180cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.235+0000 7f9617fff640 1 -- 172.21.15.97:0/770482183 >> v1:172.21.15.183:6789/0 conn(0x7f96180ce6f0 legacy=0x7f96180d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.235+0000 7f9617fff640 1 -- 172.21.15.97:0/770482183 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180cef10 con 0x7f96180d00b0 2023-11-24T08:06:53.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.237+0000 7f9617fff640 1 --2- 172.21.15.97:0/770482183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180ce1b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f96080097a0 tx=0x7f960802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef54ef69a53b768 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.237+0000 7f96177fe640 1 -- 172.21.15.97:0/770482183 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608031640 con 0x7f96180d00b0 2023-11-24T08:06:53.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.237+0000 7f96177fe640 1 -- 172.21.15.97:0/770482183 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96080317a0 con 0x7f96180d00b0 2023-11-24T08:06:53.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.237+0000 7f96177fe640 1 -- 172.21.15.97:0/770482183 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608031b70 con 0x7f96180d00b0 2023-11-24T08:06:53.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.238+0000 7f961eb2c640 1 -- 172.21.15.97:0/770482183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 msgr2=0x7f96180ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.238+0000 7f961eb2c640 1 --2- 172.21.15.97:0/770482183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180ce1b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f96080097a0 tx=0x7f960802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.239+0000 7f961eb2c640 1 -- 172.21.15.97:0/770482183 shutdown_connections 2023-11-24T08:06:53.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.239+0000 7f961eb2c640 1 --2- 172.21.15.97:0/770482183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180ce1b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.239+0000 7f961eb2c640 1 --2- 172.21.15.97:0/770482183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f961815d590 0x7f96180cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.239+0000 7f961eb2c640 1 -- 172.21.15.97:0/770482183 >> 172.21.15.97:0/770482183 conn(0x7f961809c540 msgr2=0x7f96180d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.239+0000 7f961eb2c640 1 -- 172.21.15.97:0/770482183 shutdown_connections 2023-11-24T08:06:53.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.239+0000 7f961eb2c640 1 -- 172.21.15.97:0/770482183 wait complete. 2023-11-24T08:06:53.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.242+0000 7f961eb2c640 1 Processor -- start 2023-11-24T08:06:53.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.242+0000 7f961eb2c640 1 -- start start 2023-11-24T08:06:53.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.244+0000 7f961eb2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96180ce6f0 0x7f96180cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.244+0000 7f961eb2c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.244+0000 7f961eb2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f961815d590 0x7f96181592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.245+0000 7f961eb2c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180cbee0 con 0x7f96180d00b0 2023-11-24T08:06:53.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.245+0000 7f961eb2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180cb2d0 con 0x7f961815d590 2023-11-24T08:06:53.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.245+0000 7f961eb2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180cb5b0 con 0x7f96180ce6f0 2023-11-24T08:06:53.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.245+0000 7f961c8c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96180ce6f0 0x7f96180cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.245+0000 7f961d0c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f961815d590 0x7f96181592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.246+0000 7f9617fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.246+0000 7f961d0c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f961815d590 0x7f96181592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58784/0 (socket says 172.21.15.97:58784) 2023-11-24T08:06:53.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.246+0000 7f961d0c9640 1 -- 172.21.15.97:0/662237496 learned_addr learned my addr 172.21.15.97:0/662237496 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.246+0000 7f961d0c9640 1 -- 172.21.15.97:0/662237496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96180ce6f0 msgr2=0x7f96180cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.247+0000 7f961d0c9640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96180ce6f0 0x7f96180cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.247+0000 7f961d0c9640 1 -- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 msgr2=0x7f96180c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.247+0000 7f961d0c9640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.247+0000 7f961d0c9640 1 -- 172.21.15.97:0/662237496 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009400 con 0x7f961815d590 2023-11-24T08:06:53.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.247+0000 7f9617fff640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:53.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.248+0000 7f961d0c9640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f961815d590 0x7f96181592c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f961000c9f0 tx=0x7f961000ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.248+0000 7f96157fa640 1 -- 172.21.15.97:0/662237496 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961000ab70 con 0x7f961815d590 2023-11-24T08:06:53.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.249+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96180cb890 con 0x7f961815d590 2023-11-24T08:06:53.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.249+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96180c8470 con 0x7f961815d590 2023-11-24T08:06:53.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.249+0000 7f96157fa640 1 -- 172.21.15.97:0/662237496 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961000acd0 con 0x7f961815d590 2023-11-24T08:06:53.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.249+0000 7f96157fa640 1 -- 172.21.15.97:0/662237496 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961000ab70 con 0x7f961815d590 2023-11-24T08:06:53.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.251+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8005250 con 0x7f961815d590 2023-11-24T08:06:53.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.253+0000 7f96157fa640 1 -- 172.21.15.97:0/662237496 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9610007070 con 0x7f961815d590 2023-11-24T08:06:53.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.254+0000 7f319759e640 1 Processor -- start 2023-11-24T08:06:53.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.254+0000 7f319759e640 1 -- start start 2023-11-24T08:06:53.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.255+0000 7f96157fa640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f960406aea0 0x7f960406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.256+0000 7f96157fa640 1 -- 172.21.15.97:0/662237496 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9610089540 con 0x7f961815d590 2023-11-24T08:06:53.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.256+0000 7f961c8c8640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f960406aea0 0x7f960406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.256+0000 7f319759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f319815d4b0 0x7f31980d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.256+0000 7f319759e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f31980cf9a0 0x7f31980cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.256+0000 7f319759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31980d0320 con 0x7f31980cddf0 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.256+0000 7f319759e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31980b2730 con 0x7f31980cf9a0 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.256+0000 7f319759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31980d1ec0 con 0x7f319815d4b0 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.257+0000 7f319659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f319815d4b0 0x7f31980d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.257+0000 7f3196d9d640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f31980cddf0 0x7f31980ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:50962/0 (socket says 172.21.15.97:50962) 2023-11-24T08:06:53.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.257+0000 7f3196d9d640 1 -- 172.21.15.97:0/2035728175 learned_addr learned my addr 172.21.15.97:0/2035728175 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:53.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.257+0000 7f3195d9b640 1 --2- 172.21.15.97:0/2035728175 >> v2:172.21.15.97:3300/0 conn(0x7f31980cf9a0 0x7f31980cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.258+0000 7f3195d9b640 1 -- 172.21.15.97:0/2035728175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f319815d4b0 msgr2=0x7f31980d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.258+0000 7f3195d9b640 1 --2- 172.21.15.97:0/2035728175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f319815d4b0 0x7f31980d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.258+0000 7f3195d9b640 1 -- 172.21.15.97:0/2035728175 >> v1:172.21.15.183:6789/0 conn(0x7f31980cddf0 legacy=0x7f31980ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.258+0000 7f3195d9b640 1 -- 172.21.15.97:0/2035728175 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980b29d0 con 0x7f31980cf9a0 2023-11-24T08:06:53.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.259+0000 7f961c8c8640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f960406aea0 0x7f960406d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f960c009b40 tx=0x7f960c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.260+0000 7f3195d9b640 1 --2- 172.21.15.97:0/2035728175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980cfde0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3180009a30 tx=0x7f318002bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f54b1f525d7b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.260+0000 7f319559a640 1 -- 172.21.15.97:0/2035728175 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318002d6c0 con 0x7f31980cf9a0 2023-11-24T08:06:53.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.260+0000 7f319559a640 1 -- 172.21.15.97:0/2035728175 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318002d820 con 0x7f31980cf9a0 2023-11-24T08:06:53.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.260+0000 7f319559a640 1 -- 172.21.15.97:0/2035728175 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318002dbb0 con 0x7f31980cf9a0 2023-11-24T08:06:53.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.261+0000 7f319759e640 1 -- 172.21.15.97:0/2035728175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 msgr2=0x7f31980cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.261+0000 7f319759e640 1 --2- 172.21.15.97:0/2035728175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980cfde0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3180009a30 tx=0x7f318002bb10 comp rx=0 tx=0).stop 2023-11-24T08:06:53.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.262+0000 7f319759e640 1 -- 172.21.15.97:0/2035728175 shutdown_connections 2023-11-24T08:06:53.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.262+0000 7f319759e640 1 --2- 172.21.15.97:0/2035728175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980cfde0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.262+0000 7f319759e640 1 --2- 172.21.15.97:0/2035728175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f319815d4b0 0x7f31980d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.262+0000 7f319759e640 1 -- 172.21.15.97:0/2035728175 >> 172.21.15.97:0/2035728175 conn(0x7f31980d3000 msgr2=0x7f31980d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.262+0000 7f319759e640 1 -- 172.21.15.97:0/2035728175 shutdown_connections 2023-11-24T08:06:53.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.262+0000 7f319759e640 1 -- 172.21.15.97:0/2035728175 wait complete. 2023-11-24T08:06:53.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.265+0000 7f319759e640 1 Processor -- start 2023-11-24T08:06:53.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.265+0000 7f319759e640 1 -- start start 2023-11-24T08:06:53.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.266+0000 7f96157fa640 1 -- 172.21.15.97:0/662237496 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96100545f0 con 0x7f961815d590 2023-11-24T08:06:53.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.267+0000 7f319759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980cddf0 0x7f31981f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.267+0000 7f319759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.267+0000 7f319759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f319815d4b0 0x7f31980a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.267+0000 7f319759e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981f2e70 con 0x7f31980cf9a0 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.267+0000 7f319759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981f7140 con 0x7f319815d4b0 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.267+0000 7f319759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31981f68a0 con 0x7f31980cddf0 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.268+0000 7f3195d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.268+0000 7f3195d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980b05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57328/0 (socket says 172.21.15.97:57328) 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.268+0000 7f3195d9b640 1 -- 172.21.15.97:0/656198043 learned_addr learned my addr 172.21.15.97:0/656198043 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.268+0000 7f319659c640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980cddf0 0x7f31981f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.268+0000 7f3196d9d640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f319815d4b0 0x7f31980a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.269+0000 7f3195d9b640 1 -- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980cddf0 msgr2=0x7f31981f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.269+0000 7f3195d9b640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980cddf0 0x7f31981f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.269+0000 7f3195d9b640 1 -- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f319815d4b0 msgr2=0x7f31980a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.269+0000 7f3195d9b640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f319815d4b0 0x7f31980a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.269+0000 7f3195d9b640 1 -- 172.21.15.97:0/656198043 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3180009400 con 0x7f31980cf9a0 2023-11-24T08:06:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.270+0000 7f3195d9b640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980b05b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3180037040 tx=0x7f31800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.270+0000 7f318effd640 1 -- 172.21.15.97:0/656198043 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180003810 con 0x7f31980cf9a0 2023-11-24T08:06:53.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.271+0000 7f318effd640 1 -- 172.21.15.97:0/656198043 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180003970 con 0x7f31980cf9a0 2023-11-24T08:06:53.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.271+0000 7f318effd640 1 -- 172.21.15.97:0/656198043 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180003810 con 0x7f31980cf9a0 2023-11-24T08:06:53.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.271+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319815da10 con 0x7f31980cf9a0 2023-11-24T08:06:53.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.272+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31981f6e60 con 0x7f31980cf9a0 2023-11-24T08:06:53.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.274+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31981f3020 con 0x7f31980cf9a0 2023-11-24T08:06:53.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.278+0000 7f318effd640 1 -- 172.21.15.97:0/656198043 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3180003ae0 con 0x7f31980cf9a0 2023-11-24T08:06:53.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.279+0000 7f318effd640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f317806af00 0x7f317806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.279+0000 7f318effd640 1 -- 172.21.15.97:0/656198043 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3180031070 con 0x7f31980cf9a0 2023-11-24T08:06:53.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.280+0000 7f319659c640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f317806af00 0x7f317806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.282+0000 7f319659c640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f317806af00 0x7f317806d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31900079a0 tx=0x7f3190008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.288+0000 7f318effd640 1 -- 172.21.15.97:0/656198043 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31981f3020 con 0x7f31980cf9a0 2023-11-24T08:06:53.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.314+0000 7f8be94e1640 1 Processor -- start 2023-11-24T08:06:53.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.315+0000 7f8be94e1640 1 -- start start 2023-11-24T08:06:53.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.316+0000 7f8be94e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc0e76d0 0x7f8bdc04c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.317+0000 7f8be94e1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8bdc053c00 0x7f8bdc006fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.317+0000 7f8be94e1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc057d50 con 0x7f8bdc058980 2023-11-24T08:06:53.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.317+0000 7f8be94e1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc006220 con 0x7f8bdc053c00 2023-11-24T08:06:53.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.317+0000 7f8be94e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc006500 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.317+0000 7f8be8ce0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8bdc053c00 0x7f8bdc006fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.317+0000 7f8be8ce0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8bdc053c00 0x7f8bdc006fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57330/0 (socket says 172.21.15.97:57330) 2023-11-24T08:06:53.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.317+0000 7f8be8ce0640 1 -- 172.21.15.97:0/971241265 learned_addr learned my addr 172.21.15.97:0/971241265 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.318+0000 7f8be8ce0640 1 -- 172.21.15.97:0/971241265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc0e76d0 msgr2=0x7f8bdc04c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.318+0000 7f8be8ce0640 1 --2- 172.21.15.97:0/971241265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc0e76d0 0x7f8bdc04c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.318+0000 7f8be8ce0640 1 -- 172.21.15.97:0/971241265 >> v1:172.21.15.97:6789/0 conn(0x7f8bdc058980 legacy=0x7f8bdc0534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.318+0000 7f8be8ce0640 1 -- 172.21.15.97:0/971241265 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0067e0 con 0x7f8bdc053c00 2023-11-24T08:06:53.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.320+0000 7f8be8ce0640 1 --2- 172.21.15.97:0/971241265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc006fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8be4000b60 tx=0x7f8be40a60b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95284d883d55a780 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.321+0000 7f825746b640 1 Processor -- start 2023-11-24T08:06:53.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.321+0000 7f8be2ffd640 1 -- 172.21.15.97:0/971241265 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40a6d10 con 0x7f8bdc053c00 2023-11-24T08:06:53.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.321+0000 7f8be2ffd640 1 -- 172.21.15.97:0/971241265 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be40ae440 con 0x7f8bdc053c00 2023-11-24T08:06:53.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.321+0000 7f8be2ffd640 1 -- 172.21.15.97:0/971241265 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40ae870 con 0x7f8bdc053c00 2023-11-24T08:06:53.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.322+0000 7f8be94e1640 1 -- 172.21.15.97:0/971241265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 msgr2=0x7f8bdc006fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.322+0000 7f825746b640 1 -- start start 2023-11-24T08:06:53.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.322+0000 7f8be94e1640 1 --2- 172.21.15.97:0/971241265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc006fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8be4000b60 tx=0x7f8be40a60b0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.323+0000 7f8be94e1640 1 -- 172.21.15.97:0/971241265 shutdown_connections 2023-11-24T08:06:53.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.323+0000 7f8be94e1640 1 --2- 172.21.15.97:0/971241265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc006fe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.323+0000 7f8be94e1640 1 --2- 172.21.15.97:0/971241265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc0e76d0 0x7f8bdc04c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.323+0000 7f8be94e1640 1 -- 172.21.15.97:0/971241265 >> 172.21.15.97:0/971241265 conn(0x7f8bdc058ea0 msgr2=0x7f8bdc059280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.323+0000 7f8be94e1640 1 -- 172.21.15.97:0/971241265 shutdown_connections 2023-11-24T08:06:53.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.323+0000 7f8be94e1640 1 -- 172.21.15.97:0/971241265 wait complete. 2023-11-24T08:06:53.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.324+0000 7f825746b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f825015d560 0x7f82500d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.324+0000 7f825746b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82500d1970 con 0x7f82500d0140 2023-11-24T08:06:53.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.324+0000 7f825746b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82500d1c50 con 0x7f82500b22b0 2023-11-24T08:06:53.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.324+0000 7f825746b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82500d1f30 con 0x7f825015d560 2023-11-24T08:06:53.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.324+0000 7f4080583640 1 Processor -- start 2023-11-24T08:06:53.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.324+0000 7f4080583640 1 -- start start 2023-11-24T08:06:53.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.325+0000 7f8255a08640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f82500d0140 0x7f82500b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43584/0 (socket says 172.21.15.97:43584) 2023-11-24T08:06:53.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.325+0000 7f8255a08640 1 -- 172.21.15.97:0/242816235 learned_addr learned my addr 172.21.15.97:0/242816235 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:53.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f8be94e1640 1 Processor -- start 2023-11-24T08:06:53.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f4080583640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4078161d30 0x7f40780b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f4080583640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078162110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f4080583640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f407806d3b0 0x7f4078162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f4080583640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40780702c0 con 0x7f407806d3b0 2023-11-24T08:06:53.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f4080583640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4078161b90 con 0x7f4078161d30 2023-11-24T08:06:53.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f4080583640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4078070840 con 0x7f40780b3a50 2023-11-24T08:06:53.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.327+0000 7f8255207640 1 --2- 172.21.15.97:0/242816235 >> v2:172.21.15.183:3300/0 conn(0x7f825015d560 0x7f82500d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.328+0000 7f8be94e1640 1 -- start start 2023-11-24T08:06:53.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.328+0000 7f407eb20640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f407806d3b0 0x7f4078162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.328+0000 7f407e31f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4078161d30 0x7f40780b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.328+0000 7f407e31f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4078161d30 0x7f40780b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58808/0 (socket says 172.21.15.97:58808) 2023-11-24T08:06:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.328+0000 7f407e31f640 1 -- 172.21.15.97:0/4221387370 learned_addr learned my addr 172.21.15.97:0/4221387370 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.328+0000 7f407db1e640 1 --2- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.328+0000 7f824ffff640 1 -- 172.21.15.97:0/242816235 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036052946 0 0) 0x7f82500d1970 con 0x7f82500d0140 2023-11-24T08:06:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.329+0000 7f824ffff640 1 -- 172.21.15.97:0/242816235 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8238003520 con 0x7f82500d0140 2023-11-24T08:06:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.329+0000 7f8255207640 1 -- 172.21.15.97:0/242816235 >> v1:172.21.15.183:6789/0 conn(0x7f82500b22b0 legacy=0x7f82500cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.329+0000 7f8255207640 1 -- 172.21.15.97:0/242816235 >> v1:172.21.15.97:6789/0 conn(0x7f82500d0140 legacy=0x7f82500b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.329+0000 7f8255207640 1 -- 172.21.15.97:0/242816235 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500d2210 con 0x7f825015d560 2023-11-24T08:06:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f8be94e1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc0594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f8be94e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc058980 0x7f8bdc0e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f8be94e1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bdc0e76d0 0x7f8bdc0e1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f8be94e1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc17d900 con 0x7f8bdc053c00 2023-11-24T08:06:53.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f8be94e1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc17dd90 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f407e31f640 1 -- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 msgr2=0x7f4078162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f407e31f640 1 --2- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f407e31f640 1 -- 172.21.15.97:0/4221387370 >> v2:172.21.15.97:3300/0 conn(0x7f407806d3b0 msgr2=0x7f4078162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f8be94e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0ea970 con 0x7f8bdc058980 2023-11-24T08:06:53.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f407e31f640 1 --2- 172.21.15.97:0/4221387370 >> v2:172.21.15.97:3300/0 conn(0x7f407806d3b0 0x7f4078162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.331+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc0594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.331+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc0594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57346/0 (socket says 172.21.15.97:57346) 2023-11-24T08:06:53.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.331+0000 7f8be3fff640 1 -- 172.21.15.97:0/984032852 learned_addr learned my addr 172.21.15.97:0/984032852 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.331+0000 7f8be8ce0640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bdc0e76d0 0x7f8bdc0e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.331+0000 7f8be37fe640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc058980 0x7f8bdc0e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.331+0000 7f8255207640 1 --2- 172.21.15.97:0/242816235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f825015d560 0x7f82500d0f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82480097a0 tx=0x7f824802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe2c28d591e79e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.330+0000 7f407e31f640 1 -- 172.21.15.97:0/4221387370 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4078162b90 con 0x7f4078161d30 2023-11-24T08:06:53.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.332+0000 7f407eb20640 1 --2- 172.21.15.97:0/4221387370 >> v2:172.21.15.97:3300/0 conn(0x7f407806d3b0 0x7f4078162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:53.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.332+0000 7f824ffff640 1 -- 172.21.15.97:0/242816235 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248030610 con 0x7f825015d560 2023-11-24T08:06:53.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.332+0000 7f8be8ce0640 1 -- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc058980 msgr2=0x7f8bdc0e0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.332+0000 7f8be8ce0640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc058980 0x7f8bdc0e0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.332+0000 7f8be8ce0640 1 -- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 msgr2=0x7f8bdc0594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f8be8ce0640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc0594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f8be8ce0640 1 -- 172.21.15.97:0/984032852 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be404f090 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.332+0000 7f824ffff640 1 -- 172.21.15.97:0/242816235 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248030770 con 0x7f825015d560 2023-11-24T08:06:53.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.332+0000 7f824ffff640 1 -- 172.21.15.97:0/242816235 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248030b00 con 0x7f825015d560 2023-11-24T08:06:53.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f8be37fe640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc058980 0x7f8bdc0e0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:53.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f407e31f640 1 --2- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4078161d30 0x7f40780b3510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f40780b1880 tx=0x7f407402b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=344d82a948453a72 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f8be3fff640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc0594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:53.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f825746b640 1 -- 172.21.15.97:0/242816235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f825015d560 msgr2=0x7f82500d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f825746b640 1 --2- 172.21.15.97:0/242816235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f825015d560 0x7f82500d0f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82480097a0 tx=0x7f824802b960 comp rx=0 tx=0).stop 2023-11-24T08:06:53.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.333+0000 7f8be8ce0640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bdc0e76d0 0x7f8bdc0e1240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8be40620a0 tx=0x7f8be40687a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f825746b640 1 -- 172.21.15.97:0/242816235 shutdown_connections 2023-11-24T08:06:53.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f407d31d640 1 -- 172.21.15.97:0/4221387370 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074031890 con 0x7f4078161d30 2023-11-24T08:06:53.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f825746b640 1 --2- 172.21.15.97:0/242816235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f825015d560 0x7f82500d0f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f407d31d640 1 -- 172.21.15.97:0/4221387370 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40740319f0 con 0x7f4078161d30 2023-11-24T08:06:53.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f407d31d640 1 -- 172.21.15.97:0/4221387370 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074031dc0 con 0x7f4078161d30 2023-11-24T08:06:53.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f825746b640 1 -- 172.21.15.97:0/242816235 >> 172.21.15.97:0/242816235 conn(0x7f82500d3020 msgr2=0x7f82500d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f825746b640 1 -- 172.21.15.97:0/242816235 shutdown_connections 2023-11-24T08:06:53.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f8be0ff9640 1 -- 172.21.15.97:0/984032852 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40b7600 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f8be0ff9640 1 -- 172.21.15.97:0/984032852 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be40b7760 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f8be0ff9640 1 -- 172.21.15.97:0/984032852 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40b7b10 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc03c670 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.334+0000 7f825746b640 1 -- 172.21.15.97:0/242816235 wait complete. 2023-11-24T08:06:53.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.335+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc17d2b0 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.335+0000 7f4080583640 1 -- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4078161d30 msgr2=0x7f40780b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.335+0000 7f4080583640 1 --2- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4078161d30 0x7f40780b3510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f40780b1880 tx=0x7f407402b930 comp rx=0 tx=0).stop 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f4080583640 1 -- 172.21.15.97:0/4221387370 shutdown_connections 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f4080583640 1 --2- 172.21.15.97:0/4221387370 >> v2:172.21.15.97:3300/0 conn(0x7f407806d3b0 0x7f4078162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f4080583640 1 --2- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f4080583640 1 --2- 172.21.15.97:0/4221387370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4078161d30 0x7f40780b3510 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f4080583640 1 -- 172.21.15.97:0/4221387370 >> 172.21.15.97:0/4221387370 conn(0x7f40780b0be0 msgr2=0x7f40780b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f4080583640 1 -- 172.21.15.97:0/4221387370 shutdown_connections 2023-11-24T08:06:53.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc17dab0 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.336+0000 7f4080583640 1 -- 172.21.15.97:0/4221387370 wait complete. 2023-11-24T08:06:53.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.339+0000 7f8be0ff9640 1 -- 172.21.15.97:0/984032852 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8be40b5040 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.339+0000 7f825746b640 1 Processor -- start 2023-11-24T08:06:53.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.339+0000 7f716dab4640 1 Processor -- start 2023-11-24T08:06:53.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.339+0000 7f4080583640 1 Processor -- start 2023-11-24T08:06:53.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.340+0000 7f825746b640 1 -- start start 2023-11-24T08:06:53.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.340+0000 7f716dab4640 1 -- start start 2023-11-24T08:06:53.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.340+0000 7f8be0ff9640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8bd006af10 0x7f8bd006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.340+0000 7f8be0ff9640 1 -- 172.21.15.97:0/984032852 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8be4125760 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.340+0000 7f4080583640 1 -- start start 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.341+0000 7f4080583640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407806d3b0 0x7f40780ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.341+0000 7f4080583640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.341+0000 7f4080583640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4078161d30 0x7f40780ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.341+0000 7f4080583640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407815a1a0 con 0x7f4078161d30 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.341+0000 7f4080583640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078159590 con 0x7f407806d3b0 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.341+0000 7f4080583640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4078159870 con 0x7f40780b3a50 2023-11-24T08:06:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.341+0000 7f8be3fff640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8bd006af10 0x7f8bd006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f825746b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82500b22b0 0x7f82501f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f825746b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82500d0140 0x7f82500afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f825746b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825015d560 0x7f8250152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f825746b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82500b0130 con 0x7f82500b22b0 2023-11-24T08:06:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f825746b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82500b03d0 con 0x7f82500d0140 2023-11-24T08:06:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f825746b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82500b06b0 con 0x7f825015d560 2023-11-24T08:06:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f8255207640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82500b22b0 0x7f82501f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.342+0000 7f8255a08640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825015d560 0x7f8250152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f407e31f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407806d3b0 0x7f40780ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f8be3fff640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8bd006af10 0x7f8bd006d3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009e60 tx=0x7f8bd80091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f407eb20640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4078161d30 0x7f40780ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f407eb20640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4078161d30 0x7f40780ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57364/0 (socket says 172.21.15.97:57364) 2023-11-24T08:06:53.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f407eb20640 1 -- 172.21.15.97:0/18596570 learned_addr learned my addr 172.21.15.97:0/18596570 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f716dab4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815ce90 0x7f716815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f8254a06640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82500d0140 0x7f82500afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f8254a06640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82500d0140 0x7f82500afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58840/0 (socket says 172.21.15.97:58840) 2023-11-24T08:06:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f8254a06640 1 -- 172.21.15.97:0/2035230333 learned_addr learned my addr 172.21.15.97:0/2035230333 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f8254a06640 1 -- 172.21.15.97:0/2035230333 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825015d560 msgr2=0x7f8250152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f8254a06640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825015d560 0x7f8250152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f8254a06640 1 -- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82500b22b0 msgr2=0x7f82501f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.343+0000 7f407db1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f716dab4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716815d830 con 0x7f7168153950 2023-11-24T08:06:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f716dab4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7168153d30 con 0x7f716806c470 2023-11-24T08:06:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f71677fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7168153950 0x7f71680cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43588/0 (socket says 172.21.15.97:43588) 2023-11-24T08:06:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f71677fe640 1 -- 172.21.15.97:0/4109613387 learned_addr learned my addr 172.21.15.97:0/4109613387 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f716dab4640 1 -- 172.21.15.97:0/4109613387 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71680b2b70 con 0x7f716815ce90 2023-11-24T08:06:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f8254a06640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82500b22b0 0x7f82501f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f7166ffd640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815ce90 0x7f716815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f407eb20640 1 -- 172.21.15.97:0/18596570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 msgr2=0x7f4078158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f407eb20640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f407eb20640 1 -- 172.21.15.97:0/18596570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407806d3b0 msgr2=0x7f40780ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f407eb20640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407806d3b0 0x7f40780ad980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f407eb20640 1 -- 172.21.15.97:0/18596570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4070009a70 con 0x7f4078161d30 2023-11-24T08:06:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f8254a06640 1 -- 172.21.15.97:0/2035230333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8248009400 con 0x7f82500d0140 2023-11-24T08:06:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.344+0000 7f8255207640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82500b22b0 0x7f82501f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102144202 0 0) 0x7f716815d830 con 0x7f7168153950 2023-11-24T08:06:53.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7150003520 con 0x7f7168153950 2023-11-24T08:06:53.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f8254a06640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82500d0140 0x7f82500afbf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f824000c870 tx=0x7f824000cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1734953448 0 0) 0x7f7150003520 con 0x7f7168153950 2023-11-24T08:06:53.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f407eb20640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4078161d30 0x7f40780ab470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f407000eed0 tx=0x7f407000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815ce90 msgr2=0x7f716815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815ce90 0x7f716815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 >> v1:172.21.15.183:6789/0 conn(0x7f716806c470 legacy=0x7f716806c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680b2e50 con 0x7f7168153950 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f7160001a10 con 0x7f7168153950 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 >> v1:172.21.15.97:6789/0 conn(0x7f7168153950 legacy=0x7f71680cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.345+0000 7f71667fc640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500039a0 0x7f7150003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f71667fc640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500047c0 0x7f7150004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f71667fc640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815ce90 0x7f7150005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680b2b70 con 0x7f71500039a0 2023-11-24T08:06:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7150009a40 con 0x7f71500047c0 2023-11-24T08:06:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7150009bb0 con 0x7f716815ce90 2023-11-24T08:06:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f406effd640 1 -- 172.21.15.97:0/18596570 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070010040 con 0x7f4078161d30 2023-11-24T08:06:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f406effd640 1 -- 172.21.15.97:0/18596570 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407000bd20 con 0x7f4078161d30 2023-11-24T08:06:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f406effd640 1 -- 172.21.15.97:0/18596570 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070003bb0 con 0x7f4078161d30 2023-11-24T08:06:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f71677fe640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500039a0 0x7f7150003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.346+0000 7f7166ffd640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500047c0 0x7f7150004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.347+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40740094d0 con 0x7f4078161d30 2023-11-24T08:06:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.347+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4078159e30 con 0x7f4078161d30 2023-11-24T08:06:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.347+0000 7f71677fe640 1 -- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815ce90 msgr2=0x7f7150005180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:06:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.347+0000 7f71677fe640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815ce90 0x7f7150005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.347+0000 7f71677fe640 1 -- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500047c0 msgr2=0x7f7150004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.347+0000 7f71677fe640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500047c0 0x7f7150004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.347+0000 7f71677fe640 1 -- 172.21.15.97:0/4109613387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680b2e50 con 0x7f71500039a0 2023-11-24T08:06:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.348+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407815a310 con 0x7f4078161d30 2023-11-24T08:06:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.348+0000 7f71677fe640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500039a0 0x7f7150003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f716000a850 tx=0x7f71500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452ce8e6fa2ad554 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.349+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600072d0 con 0x7f71500039a0 2023-11-24T08:06:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.350+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716002f070 con 0x7f71500039a0 2023-11-24T08:06:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.350+0000 7f71667fc640 1 -- 172.21.15.97:0/4109613387 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600076f0 con 0x7f71500039a0 2023-11-24T08:06:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.351+0000 7f716dab4640 1 -- 172.21.15.97:0/4109613387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500039a0 msgr2=0x7f7150003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.350+0000 7f406effd640 1 -- 172.21.15.97:0/18596570 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f407001d410 con 0x7f4078161d30 2023-11-24T08:06:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.351+0000 7f716dab4640 1 --2- 172.21.15.97:0/4109613387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f71500039a0 0x7f7150003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f716000a850 tx=0x7f71500057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.351+0000 7f7167fff640 1 -- 172.21.15.97:0/4109613387 reap_dead start 2023-11-24T08:06:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.351+0000 7f716dab4640 1 -- 172.21.15.97:0/4109613387 shutdown_connections 2023-11-24T08:06:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.351+0000 7f716dab4640 1 -- 172.21.15.97:0/4109613387 >> 172.21.15.97:0/4109613387 conn(0x7f71680b0be0 msgr2=0x7f71680b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.351+0000 7f716dab4640 1 -- 172.21.15.97:0/4109613387 shutdown_connections 2023-11-24T08:06:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.351+0000 7f716dab4640 1 -- 172.21.15.97:0/4109613387 wait complete. 2023-11-24T08:06:53.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.352+0000 7f406effd640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f405c06ae90 0x7f405c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.352+0000 7f406effd640 1 -- 172.21.15.97:0/18596570 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4070089da0 con 0x7f4078161d30 2023-11-24T08:06:53.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.353+0000 7f407e31f640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f405c06ae90 0x7f405c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.354+0000 7f716dab4640 1 Processor -- start 2023-11-24T08:06:53.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.354+0000 7f407e31f640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f405c06ae90 0x7f405c06d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4074036000 tx=0x7f407403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.354+0000 7f716dab4640 1 -- start start 2023-11-24T08:06:53.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.354+0000 7f824dffb640 1 -- 172.21.15.97:0/2035230333 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8240003b70 con 0x7f82500d0140 2023-11-24T08:06:53.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.355+0000 7f824dffb640 1 -- 172.21.15.97:0/2035230333 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8240003cf0 con 0x7f82500d0140 2023-11-24T08:06:53.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.355+0000 7f8be0ff9640 1 -- 172.21.15.97:0/984032852 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8bdc17dab0 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.355+0000 7f824dffb640 1 -- 172.21.15.97:0/2035230333 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824000aa90 con 0x7f82500d0140 2023-11-24T08:06:53.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.356+0000 7f716dab4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500039a0 0x7f71680aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.356+0000 7f716dab4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f716814c2f0 0x7f716814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.356+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825015dac0 con 0x7f82500d0140 2023-11-24T08:06:53.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.357+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82500b0c70 con 0x7f82500d0140 2023-11-24T08:06:53.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.356+0000 7f716dab4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815b720 0x7f716814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.356+0000 7f716dab4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716814e040 con 0x7f716814c2f0 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.356+0000 7f716dab4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716814ca60 con 0x7f71500039a0 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.356+0000 7f716dab4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716814cd40 con 0x7f716815b720 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.357+0000 7f71677fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500039a0 0x7f71680aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.357+0000 7f7166ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f716814c2f0 0x7f716814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.357+0000 7f7166ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f716814c2f0 0x7f716814db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57378/0 (socket says 172.21.15.97:57378) 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.357+0000 7f7166ffd640 1 -- 172.21.15.97:0/3061788031 learned_addr learned my addr 172.21.15.97:0/3061788031 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.358+0000 7f7167fff640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815b720 0x7f716814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.358+0000 7f7166ffd640 1 -- 172.21.15.97:0/3061788031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815b720 msgr2=0x7f716814b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.358+0000 7f7166ffd640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815b720 0x7f716814b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.358+0000 7f7166ffd640 1 -- 172.21.15.97:0/3061788031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500039a0 msgr2=0x7f71680aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.358+0000 7f7166ffd640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500039a0 0x7f71680aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.358+0000 7f7166ffd640 1 -- 172.21.15.97:0/3061788031 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716814d020 con 0x7f716814c2f0 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.359+0000 7f7166ffd640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f716814c2f0 0x7f716814db00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097c0 tx=0x7f715c009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.360+0000 7f714ffff640 1 -- 172.21.15.97:0/3061788031 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c012040 con 0x7f716814c2f0 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.360+0000 7f714ffff640 1 -- 172.21.15.97:0/3061788031 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c00b830 con 0x7f716814c2f0 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.360+0000 7f714ffff640 1 -- 172.21.15.97:0/3061788031 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c003f20 con 0x7f716814c2f0 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.362+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716814d300 con 0x7f716814c2f0 2023-11-24T08:06:53.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.362+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8250067450 con 0x7f82500d0140 2023-11-24T08:06:53.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.363+0000 7f406effd640 1 -- 172.21.15.97:0/18596570 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4070054e30 con 0x7f4078161d30 2023-11-24T08:06:53.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.363+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716814c730 con 0x7f716814c2f0 2023-11-24T08:06:53.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.363+0000 7f824dffb640 1 -- 172.21.15.97:0/2035230333 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f824000abf0 con 0x7f82500d0140 2023-11-24T08:06:53.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.365+0000 7f824dffb640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f823c06ae70 0x7f823c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.365+0000 7f824dffb640 1 -- 172.21.15.97:0/2035230333 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8240089540 con 0x7f82500d0140 2023-11-24T08:06:53.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.366+0000 7f714ffff640 1 -- 172.21.15.97:0/3061788031 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f715c018430 con 0x7f716814c2f0 2023-11-24T08:06:53.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.367+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716814d820 con 0x7f716814c2f0 2023-11-24T08:06:53.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.368+0000 7f714ffff640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f715406ae90 0x7f715406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.368+0000 7f714ffff640 1 -- 172.21.15.97:0/3061788031 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f715c089430 con 0x7f716814c2f0 2023-11-24T08:06:53.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.369+0000 7f71677fe640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f715406ae90 0x7f715406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.370+0000 7f8255207640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f823c06ae70 0x7f823c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.370+0000 7f71677fe640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f715406ae90 0x7f715406d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7160034000 tx=0x7f7160030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.372+0000 7f8255207640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f823c06ae70 0x7f823c06d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8248036000 tx=0x7f824803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.377+0000 7f714ffff640 1 -- 172.21.15.97:0/3061788031 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f716814d820 con 0x7f716814c2f0 2023-11-24T08:06:53.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.378+0000 7f824dffb640 1 -- 172.21.15.97:0/2035230333 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8240054550 con 0x7f82500d0140 2023-11-24T08:06:53.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.387+0000 7f85d65dc640 1 Processor -- start 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.387+0000 7f85d65dc640 1 -- start start 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.389+0000 7f85d65dc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85d0153950 0x7f85d00cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.389+0000 7f85d65dc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85d015ce90 0x7f85d015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.389+0000 7f85d65dc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d01598a0 0x7f85d0159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.389+0000 7f85d65dc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d015d860 con 0x7f85d015ce90 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.389+0000 7f85d65dc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d0153d30 con 0x7f85d0153950 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.389+0000 7f85d65dc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00b2b70 con 0x7f85d01598a0 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.390+0000 7f85cffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85d0153950 0x7f85d00cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.390+0000 7f85cffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85d0153950 0x7f85d00cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:58862/0 (socket says 172.21.15.97:58862) 2023-11-24T08:06:53.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.390+0000 7f85cffff640 1 -- 172.21.15.97:0/62771822 learned_addr learned my addr 172.21.15.97:0/62771822 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.390+0000 7f85cf7fe640 1 --2- 172.21.15.97:0/62771822 >> v2:172.21.15.97:3300/0 conn(0x7f85d015ce90 0x7f85d015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.391+0000 7f85cf7fe640 1 -- 172.21.15.97:0/62771822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d01598a0 msgr2=0x7f85d0159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.391+0000 7f85cf7fe640 1 --2- 172.21.15.97:0/62771822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d01598a0 0x7f85d0159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.391+0000 7f85cf7fe640 1 -- 172.21.15.97:0/62771822 >> v2:172.21.15.183:3300/0 conn(0x7f85d0153950 msgr2=0x7f85d00cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.392+0000 7f85cf7fe640 1 --2- 172.21.15.97:0/62771822 >> v2:172.21.15.183:3300/0 conn(0x7f85d0153950 0x7f85d00cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.392+0000 7f85cf7fe640 1 -- 172.21.15.97:0/62771822 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00b2e50 con 0x7f85d015ce90 2023-11-24T08:06:53.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.394+0000 7f85cf7fe640 1 --2- 172.21.15.97:0/62771822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d015ce90 0x7f85d015d320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f85d015dfb0 tx=0x7f85c802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6031c376c569ceab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.397+0000 7f85ceffd640 1 -- 172.21.15.97:0/62771822 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c802cbf0 con 0x7f85d015ce90 2023-11-24T08:06:53.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.397+0000 7f85ceffd640 1 -- 172.21.15.97:0/62771822 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c802cd50 con 0x7f85d015ce90 2023-11-24T08:06:53.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.397+0000 7f85ceffd640 1 -- 172.21.15.97:0/62771822 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8034660 con 0x7f85d015ce90 2023-11-24T08:06:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.398+0000 7f85d65dc640 1 -- 172.21.15.97:0/62771822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d015ce90 msgr2=0x7f85d015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.398+0000 7f85d65dc640 1 --2- 172.21.15.97:0/62771822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d015ce90 0x7f85d015d320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f85d015dfb0 tx=0x7f85c802be40 comp rx=0 tx=0).stop 2023-11-24T08:06:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.398+0000 7f85d65dc640 1 -- 172.21.15.97:0/62771822 shutdown_connections 2023-11-24T08:06:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.398+0000 7f85d65dc640 1 --2- 172.21.15.97:0/62771822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d01598a0 0x7f85d0159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.398+0000 7f85d65dc640 1 --2- 172.21.15.97:0/62771822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d015ce90 0x7f85d015d320 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f85d015dfb0 tx=0x7f85c802be40 comp rx=0 tx=0).stop 2023-11-24T08:06:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.398+0000 7f85d65dc640 1 --2- 172.21.15.97:0/62771822 >> v2:172.21.15.183:3300/0 conn(0x7f85d0153950 0x7f85d00cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.398+0000 7f85d65dc640 1 -- 172.21.15.97:0/62771822 >> 172.21.15.97:0/62771822 conn(0x7f85d00b0be0 msgr2=0x7f85d00b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.399+0000 7f85d65dc640 1 -- 172.21.15.97:0/62771822 shutdown_connections 2023-11-24T08:06:53.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.399+0000 7f85d65dc640 1 -- 172.21.15.97:0/62771822 wait complete. 2023-11-24T08:06:53.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.402+0000 7f85d65dc640 1 Processor -- start 2023-11-24T08:06:53.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.402+0000 7f85d65dc640 1 -- start start 2023-11-24T08:06:53.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.404+0000 7f85d65dc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d0153950 0x7f85d01485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.405+0000 7f85d65dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d01598a0 0x7f85d00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.405+0000 7f85cffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d0153950 0x7f85d01485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.405+0000 7f85cffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d0153950 0x7f85d01485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:36798/0 (socket says 172.21.15.97:36798) 2023-11-24T08:06:53.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.405+0000 7f85cf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d01598a0 0x7f85d00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.405+0000 7f85cf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d01598a0 0x7f85d00cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57398/0 (socket says 172.21.15.97:57398) 2023-11-24T08:06:53.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.405+0000 7f85d65dc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85d00cda40 0x7f85d014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.406+0000 7f85cf7fe640 1 -- 172.21.15.97:0/496124672 learned_addr learned my addr 172.21.15.97:0/496124672 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:53.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.406+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01e2aa0 con 0x7f85d01598a0 2023-11-24T08:06:53.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.406+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01e2d80 con 0x7f85d00cda40 2023-11-24T08:06:53.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.406+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01e3060 con 0x7f85d0153950 2023-11-24T08:06:53.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.406+0000 7f85d4b79640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85d00cda40 0x7f85d014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.407+0000 7f85cf7fe640 1 -- 172.21.15.97:0/496124672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d0153950 msgr2=0x7f85d01485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.407+0000 7f85cf7fe640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d0153950 0x7f85d01485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.407+0000 7f85cf7fe640 1 -- 172.21.15.97:0/496124672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85d00cda40 msgr2=0x7f85d014db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.407+0000 7f85cf7fe640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85d00cda40 0x7f85d014db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.407+0000 7f85cf7fe640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8009a70 con 0x7f85d01598a0 2023-11-24T08:06:53.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.407+0000 7f85cf7fe640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d01598a0 0x7f85d00cd500 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f85c802c450 tx=0x7f85c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.408+0000 7f85ccff9640 1 -- 172.21.15.97:0/496124672 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8003b90 con 0x7f85d01598a0 2023-11-24T08:06:53.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.408+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d01e3340 con 0x7f85d01598a0 2023-11-24T08:06:53.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.408+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d01e3900 con 0x7f85d01598a0 2023-11-24T08:06:53.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.409+0000 7f85ccff9640 1 -- 172.21.15.97:0/496124672 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8003d10 con 0x7f85d01598a0 2023-11-24T08:06:53.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.409+0000 7f85ccff9640 1 -- 172.21.15.97:0/496124672 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8004270 con 0x7f85d01598a0 2023-11-24T08:06:53.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.412+0000 7f85ccff9640 1 -- 172.21.15.97:0/496124672 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85c803b050 con 0x7f85d01598a0 2023-11-24T08:06:53.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.412+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b0005250 con 0x7f85d01598a0 2023-11-24T08:06:53.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.421+0000 7f85ccff9640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85bc06ae40 0x7f85bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.421+0000 7f85ccff9640 1 -- 172.21.15.97:0/496124672 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85c80abc80 con 0x7f85d01598a0 2023-11-24T08:06:53.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.424+0000 7f85cffff640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85bc06ae40 0x7f85bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.424+0000 7f85ccff9640 1 -- 172.21.15.97:0/496124672 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85c8076d40 con 0x7f85d01598a0 2023-11-24T08:06:53.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.425+0000 7f85cffff640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85bc06ae40 0x7f85bc06d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85d01f2420 tx=0x7f85c000b260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.619+0000 7f37e8ff9640 1 -- 172.21.15.97:0/1484959972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37fc0b2580 con 0x7f37fc140870 2023-11-24T08:06:53.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.620+0000 7f37eaffd640 1 -- 172.21.15.97:0/1484959972 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37f40578f0 con 0x7f37fc140870 2023-11-24T08:06:53.624 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.623+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37dc06ae40 msgr2=0x7f37dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.623+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37dc06ae40 0x7f37dc06d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f37f0000c00 tx=0x7f37f003d040 comp rx=0 tx=0).stop 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.623+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc140870 msgr2=0x7f37fc156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.623+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc140870 0x7f37fc156220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c730 tx=0x7f37f400cbf0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.624+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 shutdown_connections 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.624+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37dc06ae40 0x7f37dc06d300 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f37f0000c00 tx=0x7f37f003d040 comp rx=0 tx=0).stop 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.624+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37fc140870 0x7f37fc156220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.624+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37fc0b47a0 0x7f37fc15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.624+0000 7f3800ec9640 1 --2- 172.21.15.97:0/1484959972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37fc0b1d90 0x7f37fc1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.624+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 >> 172.21.15.97:0/1484959972 conn(0x7f37fc0aea00 msgr2=0x7f37fc070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.626+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 shutdown_connections 2023-11-24T08:06:53.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.626+0000 7f3800ec9640 1 -- 172.21.15.97:0/1484959972 wait complete. 2023-11-24T08:06:53.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.2 2023-11-24T08:06:53.654 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.676+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95f80057d0 con 0x7f961815d590 2023-11-24T08:06:53.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.677+0000 7f96157fa640 1 -- 172.21.15.97:0/662237496 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9610017020 con 0x7f961815d590 2023-11-24T08:06:53.679 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:53.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.680+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f960406aea0 msgr2=0x7f960406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.680+0000 7f961eb2c640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f960406aea0 0x7f960406d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f960c009b40 tx=0x7f960c009190 comp rx=0 tx=0).stop 2023-11-24T08:06:53.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.680+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f961815d590 msgr2=0x7f96181592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.680+0000 7f961eb2c640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f961815d590 0x7f96181592c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f961000c9f0 tx=0x7f961000ceb0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 shutdown_connections 2023-11-24T08:06:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f960406aea0 0x7f960406d360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f961815d590 0x7f96181592c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180d00b0 0x7f96180c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 --2- 172.21.15.97:0/662237496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96180ce6f0 0x7f96180cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 >> 172.21.15.97:0/662237496 conn(0x7f961809c540 msgr2=0x7f961806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 shutdown_connections 2023-11-24T08:06:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.681+0000 7f961eb2c640 1 -- 172.21.15.97:0/662237496 wait complete. 2023-11-24T08:06:53.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.698+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3198067450 con 0x7f31980cf9a0 2023-11-24T08:06:53.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.699+0000 7f318effd640 1 -- 172.21.15.97:0/656198043 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3180076e80 con 0x7f31980cf9a0 2023-11-24T08:06:53.701 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:53.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.701+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f317806af00 msgr2=0x7f317806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f317806af00 0x7f317806d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31900079a0 tx=0x7f3190008040 comp rx=0 tx=0).stop 2023-11-24T08:06:53.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 msgr2=0x7f31980b05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980b05b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3180037040 tx=0x7f31800046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 shutdown_connections 2023-11-24T08:06:53.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f317806af00 0x7f317806d3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f319815d4b0 0x7f31980a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31980cf9a0 0x7f31980b05b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 --2- 172.21.15.97:0/656198043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31980cddf0 0x7f31981f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 >> 172.21.15.97:0/656198043 conn(0x7f31980d3000 msgr2=0x7f31980b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.702+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 shutdown_connections 2023-11-24T08:06:53.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.703+0000 7f319759e640 1 -- 172.21.15.97:0/656198043 wait complete. 2023-11-24T08:06:53.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.0 2023-11-24T08:06:53.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.706+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40780675d0 con 0x7f4078161d30 2023-11-24T08:06:53.708 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.709 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2023-11-24T08:06:53.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.706+0000 7f406effd640 1 -- 172.21.15.97:0/18596570 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4070018090 con 0x7f4078161d30 2023-11-24T08:06:53.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f405c06ae90 msgr2=0x7f405c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f405c06ae90 0x7f405c06d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4074036000 tx=0x7f407403c040 comp rx=0 tx=0).stop 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4078161d30 msgr2=0x7f40780ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4078161d30 0x7f40780ab470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f407000eed0 tx=0x7f407000b480 comp rx=0 tx=0).stop 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 shutdown_connections 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f405c06ae90 0x7f405c06d350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4078161d30 0x7f40780ab470 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780b3a50 0x7f4078158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 --2- 172.21.15.97:0/18596570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407806d3b0 0x7f40780ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.709+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 >> 172.21.15.97:0/18596570 conn(0x7f40780b0be0 msgr2=0x7f40780aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.710+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 shutdown_connections 2023-11-24T08:06:53.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.710+0000 7f4080583640 1 -- 172.21.15.97:0/18596570 wait complete. 2023-11-24T08:06:53.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2023-11-24T08:06:53.726 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.3 2023-11-24T08:06:53.730 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.772+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f825015ca10 con 0x7f82500d0140 2023-11-24T08:06:53.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.773+0000 7f824dffb640 1 -- 172.21.15.97:0/2035230333 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8240003e60 con 0x7f82500d0140 2023-11-24T08:06:53.774 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:53.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.774+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bdc17dab0 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f823c06ae70 msgr2=0x7f823c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f823c06ae70 0x7f823c06d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8248036000 tx=0x7f824803b040 comp rx=0 tx=0).stop 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82500d0140 msgr2=0x7f82500afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82500d0140 0x7f82500afbf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f824000c870 tx=0x7f824000cd30 comp rx=0 tx=0).stop 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 shutdown_connections 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f823c06ae70 0x7f823c06d330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825015d560 0x7f8250152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82500d0140 0x7f82500afbf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 --2- 172.21.15.97:0/2035230333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82500b22b0 0x7f82501f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 >> 172.21.15.97:0/2035230333 conn(0x7f82500d3020 msgr2=0x7f825006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 shutdown_connections 2023-11-24T08:06:53.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f825746b640 1 -- 172.21.15.97:0/2035230333 wait complete. 2023-11-24T08:06:53.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.775+0000 7f8be0ff9640 1 -- 172.21.15.97:0/984032852 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bdc17dab0 con 0x7f8bdc0e76d0 2023-11-24T08:06:53.778 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:53.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8bd006af10 msgr2=0x7f8bd006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8bd006af10 0x7f8bd006d3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009e60 tx=0x7f8bd80091c0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bdc0e76d0 msgr2=0x7f8bdc0e1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bdc0e76d0 0x7f8bdc0e1240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8be40620a0 tx=0x7f8be40687a0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 shutdown_connections 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8bd006af10 0x7f8bd006d3d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bdc0e76d0 0x7f8bdc0e1240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bdc058980 0x7f8bdc0e0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.777+0000 7f8be94e1640 1 --2- 172.21.15.97:0/984032852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8bdc053c00 0x7f8bdc0594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.778+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 >> 172.21.15.97:0/984032852 conn(0x7f8bdc058ea0 msgr2=0x7f8bdc053fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.778+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 shutdown_connections 2023-11-24T08:06:53.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.778+0000 7f8be94e1640 1 -- 172.21.15.97:0/984032852 wait complete. 2023-11-24T08:06:53.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.786+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f716814d820 con 0x7f716814c2f0 2023-11-24T08:06:53.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.787+0000 7f714ffff640 1 -- 172.21.15.97:0/3061788031 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f716814d820 con 0x7f716814c2f0 2023-11-24T08:06:53.789 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:53.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f715406ae90 msgr2=0x7f715406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f715406ae90 0x7f715406d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7160034000 tx=0x7f7160030000 comp rx=0 tx=0).stop 2023-11-24T08:06:53.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f716814c2f0 msgr2=0x7f716814db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f716814c2f0 0x7f716814db00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097c0 tx=0x7f715c009c80 comp rx=0 tx=0).stop 2023-11-24T08:06:53.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 shutdown_connections 2023-11-24T08:06:53.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f715406ae90 0x7f715406d350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f716815b720 0x7f716814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f716814c2f0 0x7f716814db00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 --2- 172.21.15.97:0/3061788031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71500039a0 0x7f71680aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 >> 172.21.15.97:0/3061788031 conn(0x7f71680b0be0 msgr2=0x7f7168152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 shutdown_connections 2023-11-24T08:06:53.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.789+0000 7f716dab4640 1 -- 172.21.15.97:0/3061788031 wait complete. 2023-11-24T08:06:53.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.1 2023-11-24T08:06:53.796 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2023-11-24T08:06:53.802 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.4 2023-11-24T08:06:53.808 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.808+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f85b0005500 con 0x7f85d01598a0 2023-11-24T08:06:53.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.808+0000 7f85ccff9640 1 -- 172.21.15.97:0/496124672 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85c804d090 con 0x7f85d01598a0 2023-11-24T08:06:53.810 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2023-11-24T08:06:53.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.810+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85bc06ae40 msgr2=0x7f85bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.810+0000 7f85d65dc640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85bc06ae40 0x7f85bc06d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85d01f2420 tx=0x7f85c000b260 comp rx=0 tx=0).stop 2023-11-24T08:06:53.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.810+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d01598a0 msgr2=0x7f85d00cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.810+0000 7f85d65dc640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d01598a0 0x7f85d00cd500 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f85c802c450 tx=0x7f85c8004a40 comp rx=0 tx=0).stop 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 shutdown_connections 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85bc06ae40 0x7f85bc06d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85d00cda40 0x7f85d014db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85d01598a0 0x7f85d00cd500 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 --2- 172.21.15.97:0/496124672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85d0153950 0x7f85d01485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 >> 172.21.15.97:0/496124672 conn(0x7f85d00b0be0 msgr2=0x7f85d00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 shutdown_connections 2023-11-24T08:06:53.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:53.811+0000 7f85d65dc640 1 -- 172.21.15.97:0/496124672 wait complete. 2023-11-24T08:06:53.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2023-11-24T08:06:53.828 DEBUG:teuthology.parallel:result is None 2023-11-24T08:06:53.828 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:06:53.829 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:06:54.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.074+0000 7fe76ab7a640 1 Processor -- start 2023-11-24T08:06:54.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.074+0000 7fe76ab7a640 1 -- start start 2023-11-24T08:06:54.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.075+0000 7fe76ab7a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe764143c40 0x7fe764071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.075+0000 7fe76ab7a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7640717d0 0x7fe7640cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe76ab7a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe764070e50 con 0x7fe7640cca40 2023-11-24T08:06:54.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe76ab7a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640723c0 con 0x7fe764143c40 2023-11-24T08:06:54.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe76ab7a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640cce70 con 0x7fe7640717d0 2023-11-24T08:06:54.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe769b78640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe764143c40 0x7fe764071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe769b78640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe764143c40 0x7fe764071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57412/0 (socket says 172.21.15.97:57412) 2023-11-24T08:06:54.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe769b78640 1 -- 172.21.15.97:0/603367020 learned_addr learned my addr 172.21.15.97:0/603367020 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:54.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe769b78640 1 -- 172.21.15.97:0/603367020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7640717d0 msgr2=0x7fe7640cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:54.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe769b78640 1 --2- 172.21.15.97:0/603367020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7640717d0 0x7fe7640cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe769b78640 1 -- 172.21.15.97:0/603367020 >> v1:172.21.15.183:6789/0 conn(0x7fe7640cca40 legacy=0x7fe76415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:54.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.076+0000 7fe769b78640 1 -- 172.21.15.97:0/603367020 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76406e170 con 0x7fe764143c40 2023-11-24T08:06:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.077+0000 7fe769b78640 1 --2- 172.21.15.97:0/603367020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe764143c40 0x7fe764071290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe760009870 tx=0x7fe76002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190b78f89c38be52 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.077+0000 7fe768b76640 1 -- 172.21.15.97:0/603367020 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600317c0 con 0x7fe764143c40 2023-11-24T08:06:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe768b76640 1 -- 172.21.15.97:0/603367020 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760031920 con 0x7fe764143c40 2023-11-24T08:06:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe768b76640 1 -- 172.21.15.97:0/603367020 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760031cb0 con 0x7fe764143c40 2023-11-24T08:06:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 -- 172.21.15.97:0/603367020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe764143c40 msgr2=0x7fe764071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/603367020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe764143c40 0x7fe764071290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe760009870 tx=0x7fe76002b860 comp rx=0 tx=0).stop 2023-11-24T08:06:54.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 -- 172.21.15.97:0/603367020 shutdown_connections 2023-11-24T08:06:54.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/603367020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7640717d0 0x7fe7640cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/603367020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe764143c40 0x7fe764071290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 -- 172.21.15.97:0/603367020 >> 172.21.15.97:0/603367020 conn(0x7fe76406a800 msgr2=0x7fe76406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:54.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 -- 172.21.15.97:0/603367020 shutdown_connections 2023-11-24T08:06:54.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.078+0000 7fe76ab7a640 1 -- 172.21.15.97:0/603367020 wait complete. 2023-11-24T08:06:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.080+0000 7fe76ab7a640 1 Processor -- start 2023-11-24T08:06:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.080+0000 7fe76ab7a640 1 -- start start 2023-11-24T08:06:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe76ab7a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7640717d0 0x7fe7641e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe76ab7a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7640cca40 0x7fe76415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe76ab7a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe764143c40 0x7fe7640adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe76ab7a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641f0c50 con 0x7fe7640717d0 2023-11-24T08:06:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe76ab7a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641e43a0 con 0x7fe7640cca40 2023-11-24T08:06:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe76ab7a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641e3790 con 0x7fe764143c40 2023-11-24T08:06:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769b78640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7640717d0 0x7fe7641e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769b78640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7640717d0 0x7fe7641e4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57426/0 (socket says 172.21.15.97:57426) 2023-11-24T08:06:54.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769b78640 1 -- 172.21.15.97:0/461445331 learned_addr learned my addr 172.21.15.97:0/461445331 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769377640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7640cca40 0x7fe76415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769b78640 1 -- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe764143c40 msgr2=0x7fe7640adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769b78640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe764143c40 0x7fe7640adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769b78640 1 -- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7640cca40 msgr2=0x7fe76415a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.081+0000 7fe769b78640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7640cca40 0x7fe76415a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe769b78640 1 -- 172.21.15.97:0/461445331 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600094d0 con 0x7fe7640717d0 2023-11-24T08:06:54.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe769377640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7640cca40 0x7fe76415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:54.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe769b78640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7640717d0 0x7fe7641e4830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe7600090b0 tx=0x7fe7600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe75a7fc640 1 -- 172.21.15.97:0/461445331 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600328e0 con 0x7fe7640717d0 2023-11-24T08:06:54.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe75a7fc640 1 -- 172.21.15.97:0/461445331 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760032a60 con 0x7fe7640717d0 2023-11-24T08:06:54.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7641e3a70 con 0x7fe7640717d0 2023-11-24T08:06:54.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe75a7fc640 1 -- 172.21.15.97:0/461445331 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760032e10 con 0x7fe7640717d0 2023-11-24T08:06:54.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.082+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7641e4030 con 0x7fe7640717d0 2023-11-24T08:06:54.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.083+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe764067450 con 0x7fe7640717d0 2023-11-24T08:06:54.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.084+0000 7fe75a7fc640 1 -- 172.21.15.97:0/461445331 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe76004d3f0 con 0x7fe7640717d0 2023-11-24T08:06:54.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.085+0000 7fe75a7fc640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe74806ae40 0x7fe74806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.085+0000 7fe75a7fc640 1 -- 172.21.15.97:0/461445331 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7600ab5b0 con 0x7fe7640717d0 2023-11-24T08:06:54.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.085+0000 7fe769377640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe74806ae40 0x7fe74806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.086+0000 7fe769377640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe74806ae40 0x7fe74806d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe754006fd0 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.089+0000 7fe75a7fc640 1 -- 172.21.15.97:0/461445331 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7600765a0 con 0x7fe7640717d0 2023-11-24T08:06:54.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.262+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7640cb190 con 0x7fe74806ae40 2023-11-24T08:06:54.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.283+0000 7fe75a7fc640 1 -- 172.21.15.97:0/461445331 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264354 (secure 0 0 0) 0x7fe7640cb190 con 0x7fe74806ae40 2023-11-24T08:06:54.289 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:54.290 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.289+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe74806ae40 msgr2=0x7fe74806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.289+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe74806ae40 0x7fe74806d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe754006fd0 tx=0x7fe754008040 comp rx=0 tx=0).stop 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.289+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7640717d0 msgr2=0x7fe7641e4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.289+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7640717d0 0x7fe7641e4830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe7600090b0 tx=0x7fe7600046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 shutdown_connections 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe74806ae40 0x7fe74806d300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe764143c40 0x7fe7640adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7640cca40 0x7fe76415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 --2- 172.21.15.97:0/461445331 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7640717d0 0x7fe7641e4830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 >> 172.21.15.97:0/461445331 conn(0x7fe76406a800 msgr2=0x7fe76413fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 shutdown_connections 2023-11-24T08:06:54.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.290+0000 7fe76ab7a640 1 -- 172.21.15.97:0/461445331 wait complete. 2023-11-24T08:06:54.311 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-24T08:06:53.271781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223492,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751228,"statfs":{"total":773094113280,"available":772865257472,"internally_reserved":0,"allocated":3055616,"data_stored":1816564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.187214"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967929+0000","last_change":"2023-11-24T08:06:42.136230+0000","last_active":"2023-11-24T08:06:43.967929+0000","last_peered":"2023-11-24T08:06:43.967929+0000","last_clean":"2023-11-24T08:06:43.967929+0000","last_became_active":"2023-11-24T08:06:42.133570+0000","last_became_peered":"2023-11-24T08:06:42.133570+0000","last_unstale":"2023-11-24T08:06:43.967929+0000","last_undegraded":"2023-11-24T08:06:43.967929+0000","last_fullsized":"2023-11-24T08:06:43.967929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086899+0000","last_change":"2023-11-24T08:06:42.107193+0000","last_active":"2023-11-24T08:06:43.086899+0000","last_peered":"2023-11-24T08:06:43.086899+0000","last_clean":"2023-11-24T08:06:43.086899+0000","last_became_active":"2023-11-24T08:06:42.106907+0000","last_became_peered":"2023-11-24T08:06:42.106907+0000","last_unstale":"2023-11-24T08:06:43.086899+0000","last_undegraded":"2023-11-24T08:06:43.086899+0000","last_fullsized":"2023-11-24T08:06:43.086899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963992+0000","last_change":"2023-11-24T08:06:42.108263+0000","last_active":"2023-11-24T08:06:43.963992+0000","last_peered":"2023-11-24T08:06:43.963992+0000","last_clean":"2023-11-24T08:06:43.963992+0000","last_became_active":"2023-11-24T08:06:42.107647+0000","last_became_peered":"2023-11-24T08:06:42.107647+0000","last_unstale":"2023-11-24T08:06:43.963992+0000","last_undegraded":"2023-11-24T08:06:43.963992+0000","last_fullsized":"2023-11-24T08:06:43.963992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:27.401933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091686+0000","last_change":"2023-11-24T08:06:42.122069+0000","last_active":"2023-11-24T08:06:43.091686+0000","last_peered":"2023-11-24T08:06:43.091686+0000","last_clean":"2023-11-24T08:06:43.091686+0000","last_became_active":"2023-11-24T08:06:42.121385+0000","last_became_peered":"2023-11-24T08:06:42.121385+0000","last_unstale":"2023-11-24T08:06:43.091686+0000","last_undegraded":"2023-11-24T08:06:43.091686+0000","last_fullsized":"2023-11-24T08:06:43.091686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966552+0000","last_change":"2023-11-24T08:06:42.132197+0000","last_active":"2023-11-24T08:06:43.966552+0000","last_peered":"2023-11-24T08:06:43.966552+0000","last_clean":"2023-11-24T08:06:43.966552+0000","last_became_active":"2023-11-24T08:06:42.131870+0000","last_became_peered":"2023-11-24T08:06:42.131870+0000","last_unstale":"2023-11-24T08:06:43.966552+0000","last_undegraded":"2023-11-24T08:06:43.966552+0000","last_fullsized":"2023-11-24T08:06:43.966552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091338+0000","last_change":"2023-11-24T08:06:42.125563+0000","last_active":"2023-11-24T08:06:43.091338+0000","last_peered":"2023-11-24T08:06:43.091338+0000","last_clean":"2023-11-24T08:06:43.091338+0000","last_became_active":"2023-11-24T08:06:42.125192+0000","last_became_peered":"2023-11-24T08:06:42.125192+0000","last_unstale":"2023-11-24T08:06:43.091338+0000","last_undegraded":"2023-11-24T08:06:43.091338+0000","last_fullsized":"2023-11-24T08:06:43.091338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966278+0000","last_change":"2023-11-24T08:06:42.122907+0000","last_active":"2023-11-24T08:06:43.966278+0000","last_peered":"2023-11-24T08:06:43.966278+0000","last_clean":"2023-11-24T08:06:43.966278+0000","last_became_active":"2023-11-24T08:06:42.122580+0000","last_became_peered":"2023-11-24T08:06:42.122580+0000","last_unstale":"2023-11-24T08:06:43.966278+0000","last_undegraded":"2023-11-24T08:06:43.966278+0000","last_fullsized":"2023-11-24T08:06:43.966278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966567+0000","last_change":"2023-11-24T08:06:42.121885+0000","last_active":"2023-11-24T08:06:43.966567+0000","last_peered":"2023-11-24T08:06:43.966567+0000","last_clean":"2023-11-24T08:06:43.966567+0000","last_became_active":"2023-11-24T08:06:42.121567+0000","last_became_peered":"2023-11-24T08:06:42.121567+0000","last_unstale":"2023-11-24T08:06:43.966567+0000","last_undegraded":"2023-11-24T08:06:43.966567+0000","last_fullsized":"2023-11-24T08:06:43.966567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968008+0000","last_change":"2023-11-24T08:06:42.136825+0000","last_active":"2023-11-24T08:06:43.968008+0000","last_peered":"2023-11-24T08:06:43.968008+0000","last_clean":"2023-11-24T08:06:43.968008+0000","last_became_active":"2023-11-24T08:06:42.136570+0000","last_became_peered":"2023-11-24T08:06:42.136570+0000","last_unstale":"2023-11-24T08:06:43.968008+0000","last_undegraded":"2023-11-24T08:06:43.968008+0000","last_fullsized":"2023-11-24T08:06:43.968008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476754+0000","last_change":"2023-11-24T08:06:42.133333+0000","last_active":"2023-11-24T08:06:43.476754+0000","last_peered":"2023-11-24T08:06:43.476754+0000","last_clean":"2023-11-24T08:06:43.476754+0000","last_became_active":"2023-11-24T08:06:42.133051+0000","last_became_peered":"2023-11-24T08:06:42.133051+0000","last_unstale":"2023-11-24T08:06:43.476754+0000","last_undegraded":"2023-11-24T08:06:43.476754+0000","last_fullsized":"2023-11-24T08:06:43.476754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476581+0000","last_change":"2023-11-24T08:06:42.130796+0000","last_active":"2023-11-24T08:06:43.476581+0000","last_peered":"2023-11-24T08:06:43.476581+0000","last_clean":"2023-11-24T08:06:43.476581+0000","last_became_active":"2023-11-24T08:06:42.130502+0000","last_became_peered":"2023-11-24T08:06:42.130502+0000","last_unstale":"2023-11-24T08:06:43.476581+0000","last_undegraded":"2023-11-24T08:06:43.476581+0000","last_fullsized":"2023-11-24T08:06:43.476581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966612+0000","last_change":"2023-11-24T08:06:42.126261+0000","last_active":"2023-11-24T08:06:43.966612+0000","last_peered":"2023-11-24T08:06:43.966612+0000","last_clean":"2023-11-24T08:06:43.966612+0000","last_became_active":"2023-11-24T08:06:42.125771+0000","last_became_peered":"2023-11-24T08:06:42.125771+0000","last_unstale":"2023-11-24T08:06:43.966612+0000","last_undegraded":"2023-11-24T08:06:43.966612+0000","last_fullsized":"2023-11-24T08:06:43.966612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:16.965524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966004+0000","last_change":"2023-11-24T08:06:42.122706+0000","last_active":"2023-11-24T08:06:43.966004+0000","last_peered":"2023-11-24T08:06:43.966004+0000","last_clean":"2023-11-24T08:06:43.966004+0000","last_became_active":"2023-11-24T08:06:42.122378+0000","last_became_peered":"2023-11-24T08:06:42.122378+0000","last_unstale":"2023-11-24T08:06:43.966004+0000","last_undegraded":"2023-11-24T08:06:43.966004+0000","last_fullsized":"2023-11-24T08:06:43.966004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963516+0000","last_change":"2023-11-24T08:06:42.106916+0000","last_active":"2023-11-24T08:06:43.963516+0000","last_peered":"2023-11-24T08:06:43.963516+0000","last_clean":"2023-11-24T08:06:43.963516+0000","last_became_active":"2023-11-24T08:06:42.106633+0000","last_became_peered":"2023-11-24T08:06:42.106633+0000","last_unstale":"2023-11-24T08:06:43.963516+0000","last_undegraded":"2023-11-24T08:06:43.963516+0000","last_fullsized":"2023-11-24T08:06:43.963516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:48:07.993924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086431+0000","last_change":"2023-11-24T08:06:42.099238+0000","last_active":"2023-11-24T08:06:43.086431+0000","last_peered":"2023-11-24T08:06:43.086431+0000","last_clean":"2023-11-24T08:06:43.086431+0000","last_became_active":"2023-11-24T08:06:42.098972+0000","last_became_peered":"2023-11-24T08:06:42.098972+0000","last_unstale":"2023-11-24T08:06:43.086431+0000","last_undegraded":"2023-11-24T08:06:43.086431+0000","last_fullsized":"2023-11-24T08:06:43.086431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090638+0000","last_change":"2023-11-24T08:06:42.127641+0000","last_active":"2023-11-24T08:06:43.090638+0000","last_peered":"2023-11-24T08:06:43.090638+0000","last_clean":"2023-11-24T08:06:43.090638+0000","last_became_active":"2023-11-24T08:06:42.127276+0000","last_became_peered":"2023-11-24T08:06:42.127276+0000","last_unstale":"2023-11-24T08:06:43.090638+0000","last_undegraded":"2023-11-24T08:06:43.090638+0000","last_fullsized":"2023-11-24T08:06:43.090638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092315+0000","last_change":"2023-11-24T08:06:42.129079+0000","last_active":"2023-11-24T08:06:43.092315+0000","last_peered":"2023-11-24T08:06:43.092315+0000","last_clean":"2023-11-24T08:06:43.092315+0000","last_became_active":"2023-11-24T08:06:42.128796+0000","last_became_peered":"2023-11-24T08:06:42.128796+0000","last_unstale":"2023-11-24T08:06:43.092315+0000","last_undegraded":"2023-11-24T08:06:43.092315+0000","last_fullsized":"2023-11-24T08:06:43.092315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346604+0000","last_change":"2023-11-24T08:06:42.122648+0000","last_active":"2023-11-24T08:06:43.346604+0000","last_peered":"2023-11-24T08:06:43.346604+0000","last_clean":"2023-11-24T08:06:43.346604+0000","last_became_active":"2023-11-24T08:06:42.122184+0000","last_became_peered":"2023-11-24T08:06:42.122184+0000","last_unstale":"2023-11-24T08:06:43.346604+0000","last_undegraded":"2023-11-24T08:06:43.346604+0000","last_fullsized":"2023-11-24T08:06:43.346604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:47.554125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968216+0000","last_change":"2023-11-24T08:06:42.136398+0000","last_active":"2023-11-24T08:06:43.968216+0000","last_peered":"2023-11-24T08:06:43.968216+0000","last_clean":"2023-11-24T08:06:43.968216+0000","last_became_active":"2023-11-24T08:06:42.133633+0000","last_became_peered":"2023-11-24T08:06:42.133633+0000","last_unstale":"2023-11-24T08:06:43.968216+0000","last_undegraded":"2023-11-24T08:06:43.968216+0000","last_fullsized":"2023-11-24T08:06:43.968216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:45:50.299537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476680+0000","last_change":"2023-11-24T08:06:42.134200+0000","last_active":"2023-11-24T08:06:43.476680+0000","last_peered":"2023-11-24T08:06:43.476680+0000","last_clean":"2023-11-24T08:06:43.476680+0000","last_became_active":"2023-11-24T08:06:42.133905+0000","last_became_peered":"2023-11-24T08:06:42.133905+0000","last_unstale":"2023-11-24T08:06:43.476680+0000","last_undegraded":"2023-11-24T08:06:43.476680+0000","last_fullsized":"2023-11-24T08:06:43.476680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963640+0000","last_change":"2023-11-24T08:06:42.117257+0000","last_active":"2023-11-24T08:06:43.963640+0000","last_peered":"2023-11-24T08:06:43.963640+0000","last_clean":"2023-11-24T08:06:43.963640+0000","last_became_active":"2023-11-24T08:06:42.116917+0000","last_became_peered":"2023-11-24T08:06:42.116917+0000","last_unstale":"2023-11-24T08:06:43.963640+0000","last_undegraded":"2023-11-24T08:06:43.963640+0000","last_fullsized":"2023-11-24T08:06:43.963640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:56.791724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091695+0000","last_change":"2023-11-24T08:06:42.136875+0000","last_active":"2023-11-24T08:06:43.091695+0000","last_peered":"2023-11-24T08:06:43.091695+0000","last_clean":"2023-11-24T08:06:43.091695+0000","last_became_active":"2023-11-24T08:06:42.136572+0000","last_became_peered":"2023-11-24T08:06:42.136572+0000","last_unstale":"2023-11-24T08:06:43.091695+0000","last_undegraded":"2023-11-24T08:06:43.091695+0000","last_fullsized":"2023-11-24T08:06:43.091695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.120702+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.120446+0000","last_became_peered":"2023-11-24T08:06:42.120446+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:06.281138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090758+0000","last_change":"2023-11-24T08:06:42.117026+0000","last_active":"2023-11-24T08:06:43.090758+0000","last_peered":"2023-11-24T08:06:43.090758+0000","last_clean":"2023-11-24T08:06:43.090758+0000","last_became_active":"2023-11-24T08:06:42.115990+0000","last_became_peered":"2023-11-24T08:06:42.115990+0000","last_unstale":"2023-11-24T08:06:43.090758+0000","last_undegraded":"2023-11-24T08:06:43.090758+0000","last_fullsized":"2023-11-24T08:06:43.090758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966398+0000","last_change":"2023-11-24T08:06:42.107007+0000","last_active":"2023-11-24T08:06:43.966398+0000","last_peered":"2023-11-24T08:06:43.966398+0000","last_clean":"2023-11-24T08:06:43.966398+0000","last_became_active":"2023-11-24T08:06:42.103402+0000","last_became_peered":"2023-11-24T08:06:42.103402+0000","last_unstale":"2023-11-24T08:06:43.966398+0000","last_undegraded":"2023-11-24T08:06:43.966398+0000","last_fullsized":"2023-11-24T08:06:43.966398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476753+0000","last_change":"2023-11-24T08:06:42.126780+0000","last_active":"2023-11-24T08:06:43.476753+0000","last_peered":"2023-11-24T08:06:43.476753+0000","last_clean":"2023-11-24T08:06:43.476753+0000","last_became_active":"2023-11-24T08:06:42.126540+0000","last_became_peered":"2023-11-24T08:06:42.126540+0000","last_unstale":"2023-11-24T08:06:43.476753+0000","last_undegraded":"2023-11-24T08:06:43.476753+0000","last_fullsized":"2023-11-24T08:06:43.476753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086799+0000","last_change":"2023-11-24T08:06:42.100776+0000","last_active":"2023-11-24T08:06:43.086799+0000","last_peered":"2023-11-24T08:06:43.086799+0000","last_clean":"2023-11-24T08:06:43.086799+0000","last_became_active":"2023-11-24T08:06:42.098840+0000","last_became_peered":"2023-11-24T08:06:42.098840+0000","last_unstale":"2023-11-24T08:06:43.086799+0000","last_undegraded":"2023-11-24T08:06:43.086799+0000","last_fullsized":"2023-11-24T08:06:43.086799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966796+0000","last_change":"2023-11-24T08:06:42.114236+0000","last_active":"2023-11-24T08:06:43.966796+0000","last_peered":"2023-11-24T08:06:43.966796+0000","last_clean":"2023-11-24T08:06:43.966796+0000","last_became_active":"2023-11-24T08:06:42.113925+0000","last_became_peered":"2023-11-24T08:06:42.113925+0000","last_unstale":"2023-11-24T08:06:43.966796+0000","last_undegraded":"2023-11-24T08:06:43.966796+0000","last_fullsized":"2023-11-24T08:06:43.966796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964102+0000","last_change":"2023-11-24T08:06:42.110806+0000","last_active":"2023-11-24T08:06:43.964102+0000","last_peered":"2023-11-24T08:06:43.964102+0000","last_clean":"2023-11-24T08:06:43.964102+0000","last_became_active":"2023-11-24T08:06:42.110398+0000","last_became_peered":"2023-11-24T08:06:42.110398+0000","last_unstale":"2023-11-24T08:06:43.964102+0000","last_undegraded":"2023-11-24T08:06:43.964102+0000","last_fullsized":"2023-11-24T08:06:43.964102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:11.994031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092483+0000","last_change":"2023-11-24T08:06:42.119038+0000","last_active":"2023-11-24T08:06:43.092483+0000","last_peered":"2023-11-24T08:06:43.092483+0000","last_clean":"2023-11-24T08:06:43.092483+0000","last_became_active":"2023-11-24T08:06:42.116791+0000","last_became_peered":"2023-11-24T08:06:42.116791+0000","last_unstale":"2023-11-24T08:06:43.092483+0000","last_undegraded":"2023-11-24T08:06:43.092483+0000","last_fullsized":"2023-11-24T08:06:43.092483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346553+0000","last_change":"2023-11-24T08:06:42.118075+0000","last_active":"2023-11-24T08:06:43.346553+0000","last_peered":"2023-11-24T08:06:43.346553+0000","last_clean":"2023-11-24T08:06:43.346553+0000","last_became_active":"2023-11-24T08:06:42.117879+0000","last_became_peered":"2023-11-24T08:06:42.117879+0000","last_unstale":"2023-11-24T08:06:43.346553+0000","last_undegraded":"2023-11-24T08:06:43.346553+0000","last_fullsized":"2023-11-24T08:06:43.346553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475999+0000","last_change":"2023-11-24T08:06:42.118534+0000","last_active":"2023-11-24T08:06:43.475999+0000","last_peered":"2023-11-24T08:06:43.475999+0000","last_clean":"2023-11-24T08:06:43.475999+0000","last_became_active":"2023-11-24T08:06:42.118081+0000","last_became_peered":"2023-11-24T08:06:42.118081+0000","last_unstale":"2023-11-24T08:06:43.475999+0000","last_undegraded":"2023-11-24T08:06:43.475999+0000","last_fullsized":"2023-11-24T08:06:43.475999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966118+0000","last_change":"2023-11-24T08:06:42.105896+0000","last_active":"2023-11-24T08:06:43.966118+0000","last_peered":"2023-11-24T08:06:43.966118+0000","last_clean":"2023-11-24T08:06:43.966118+0000","last_became_active":"2023-11-24T08:06:42.105293+0000","last_became_peered":"2023-11-24T08:06:42.105293+0000","last_unstale":"2023-11-24T08:06:43.966118+0000","last_undegraded":"2023-11-24T08:06:43.966118+0000","last_fullsized":"2023-11-24T08:06:43.966118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:10.645249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966071+0000","last_change":"2023-11-24T08:06:41.631971+0000","last_active":"2023-11-24T08:06:43.966071+0000","last_peered":"2023-11-24T08:06:43.966071+0000","last_clean":"2023-11-24T08:06:43.966071+0000","last_became_active":"2023-11-24T08:06:41.631383+0000","last_became_peered":"2023-11-24T08:06:41.631383+0000","last_unstale":"2023-11-24T08:06:43.966071+0000","last_undegraded":"2023-11-24T08:06:43.966071+0000","last_fullsized":"2023-11-24T08:06:43.966071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963857+0000","last_change":"2023-11-24T08:06:42.118716+0000","last_active":"2023-11-24T08:06:43.963857+0000","last_peered":"2023-11-24T08:06:43.963857+0000","last_clean":"2023-11-24T08:06:43.963857+0000","last_became_active":"2023-11-24T08:06:42.118356+0000","last_became_peered":"2023-11-24T08:06:42.118356+0000","last_unstale":"2023-11-24T08:06:43.963857+0000","last_undegraded":"2023-11-24T08:06:43.963857+0000","last_fullsized":"2023-11-24T08:06:43.963857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:29:52.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475919+0000","last_change":"2023-11-24T08:06:41.639457+0000","last_active":"2023-11-24T08:06:43.475919+0000","last_peered":"2023-11-24T08:06:43.475919+0000","last_clean":"2023-11-24T08:06:43.475919+0000","last_became_active":"2023-11-24T08:06:41.638910+0000","last_became_peered":"2023-11-24T08:06:41.638910+0000","last_unstale":"2023-11-24T08:06:43.475919+0000","last_undegraded":"2023-11-24T08:06:43.475919+0000","last_fullsized":"2023-11-24T08:06:43.475919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965906+0000","last_change":"2023-11-24T08:06:41.639144+0000","last_active":"2023-11-24T08:06:43.965906+0000","last_peered":"2023-11-24T08:06:43.965906+0000","last_clean":"2023-11-24T08:06:43.965906+0000","last_became_active":"2023-11-24T08:06:41.638849+0000","last_became_peered":"2023-11-24T08:06:41.638849+0000","last_unstale":"2023-11-24T08:06:43.965906+0000","last_undegraded":"2023-11-24T08:06:43.965906+0000","last_fullsized":"2023-11-24T08:06:43.965906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966325+0000","last_change":"2023-11-24T08:06:42.107129+0000","last_active":"2023-11-24T08:06:43.966325+0000","last_peered":"2023-11-24T08:06:43.966325+0000","last_clean":"2023-11-24T08:06:43.966325+0000","last_became_active":"2023-11-24T08:06:42.106875+0000","last_became_peered":"2023-11-24T08:06:42.106875+0000","last_unstale":"2023-11-24T08:06:43.966325+0000","last_undegraded":"2023-11-24T08:06:43.966325+0000","last_fullsized":"2023-11-24T08:06:43.966325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090871+0000","last_change":"2023-11-24T08:06:41.643162+0000","last_active":"2023-11-24T08:06:43.090871+0000","last_peered":"2023-11-24T08:06:43.090871+0000","last_clean":"2023-11-24T08:06:43.090871+0000","last_became_active":"2023-11-24T08:06:41.642111+0000","last_became_peered":"2023-11-24T08:06:41.642111+0000","last_unstale":"2023-11-24T08:06:43.090871+0000","last_undegraded":"2023-11-24T08:06:43.090871+0000","last_fullsized":"2023-11-24T08:06:43.090871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086444+0000","last_change":"2023-11-24T08:06:42.102972+0000","last_active":"2023-11-24T08:06:43.086444+0000","last_peered":"2023-11-24T08:06:43.086444+0000","last_clean":"2023-11-24T08:06:43.086444+0000","last_became_active":"2023-11-24T08:06:42.102488+0000","last_became_peered":"2023-11-24T08:06:42.102488+0000","last_unstale":"2023-11-24T08:06:43.086444+0000","last_undegraded":"2023-11-24T08:06:43.086444+0000","last_fullsized":"2023-11-24T08:06:43.086444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476748+0000","last_change":"2023-11-24T08:06:41.644502+0000","last_active":"2023-11-24T08:06:43.476748+0000","last_peered":"2023-11-24T08:06:43.476748+0000","last_clean":"2023-11-24T08:06:43.476748+0000","last_became_active":"2023-11-24T08:06:41.644195+0000","last_became_peered":"2023-11-24T08:06:41.644195+0000","last_unstale":"2023-11-24T08:06:43.476748+0000","last_undegraded":"2023-11-24T08:06:43.476748+0000","last_fullsized":"2023-11-24T08:06:43.476748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091370+0000","last_change":"2023-11-24T08:06:42.128953+0000","last_active":"2023-11-24T08:06:43.091370+0000","last_peered":"2023-11-24T08:06:43.091370+0000","last_clean":"2023-11-24T08:06:43.091370+0000","last_became_active":"2023-11-24T08:06:42.128626+0000","last_became_peered":"2023-11-24T08:06:42.128626+0000","last_unstale":"2023-11-24T08:06:43.091370+0000","last_undegraded":"2023-11-24T08:06:43.091370+0000","last_fullsized":"2023-11-24T08:06:43.091370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091492+0000","last_change":"2023-11-24T08:06:41.640464+0000","last_active":"2023-11-24T08:06:43.091492+0000","last_peered":"2023-11-24T08:06:43.091492+0000","last_clean":"2023-11-24T08:06:43.091492+0000","last_became_active":"2023-11-24T08:06:41.640192+0000","last_became_peered":"2023-11-24T08:06:41.640192+0000","last_unstale":"2023-11-24T08:06:43.091492+0000","last_undegraded":"2023-11-24T08:06:43.091492+0000","last_fullsized":"2023-11-24T08:06:43.091492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:40.469927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963979+0000","last_change":"2023-11-24T08:06:42.132751+0000","last_active":"2023-11-24T08:06:43.963979+0000","last_peered":"2023-11-24T08:06:43.963979+0000","last_clean":"2023-11-24T08:06:43.963979+0000","last_became_active":"2023-11-24T08:06:42.132521+0000","last_became_peered":"2023-11-24T08:06:42.132521+0000","last_unstale":"2023-11-24T08:06:43.963979+0000","last_undegraded":"2023-11-24T08:06:43.963979+0000","last_fullsized":"2023-11-24T08:06:43.963979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:57.695423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086753+0000","last_change":"2023-11-24T08:06:41.639732+0000","last_active":"2023-11-24T08:06:43.086753+0000","last_peered":"2023-11-24T08:06:43.086753+0000","last_clean":"2023-11-24T08:06:43.086753+0000","last_became_active":"2023-11-24T08:06:41.639425+0000","last_became_peered":"2023-11-24T08:06:41.639425+0000","last_unstale":"2023-11-24T08:06:43.086753+0000","last_undegraded":"2023-11-24T08:06:43.086753+0000","last_fullsized":"2023-11-24T08:06:43.086753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966735+0000","last_change":"2023-11-24T08:06:42.128585+0000","last_active":"2023-11-24T08:06:43.966735+0000","last_peered":"2023-11-24T08:06:43.966735+0000","last_clean":"2023-11-24T08:06:43.966735+0000","last_became_active":"2023-11-24T08:06:42.125584+0000","last_became_peered":"2023-11-24T08:06:42.125584+0000","last_unstale":"2023-11-24T08:06:43.966735+0000","last_undegraded":"2023-11-24T08:06:43.966735+0000","last_fullsized":"2023-11-24T08:06:43.966735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:49.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476560+0000","last_change":"2023-11-24T08:06:41.633239+0000","last_active":"2023-11-24T08:06:43.476560+0000","last_peered":"2023-11-24T08:06:43.476560+0000","last_clean":"2023-11-24T08:06:43.476560+0000","last_became_active":"2023-11-24T08:06:41.632918+0000","last_became_peered":"2023-11-24T08:06:41.632918+0000","last_unstale":"2023-11-24T08:06:43.476560+0000","last_undegraded":"2023-11-24T08:06:43.476560+0000","last_fullsized":"2023-11-24T08:06:43.476560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:46.220387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967524+0000","last_change":"2023-11-24T08:06:42.132872+0000","last_active":"2023-11-24T08:06:43.967524+0000","last_peered":"2023-11-24T08:06:43.967524+0000","last_clean":"2023-11-24T08:06:43.967524+0000","last_became_active":"2023-11-24T08:06:42.124186+0000","last_became_peered":"2023-11-24T08:06:42.124186+0000","last_unstale":"2023-11-24T08:06:43.967524+0000","last_undegraded":"2023-11-24T08:06:43.967524+0000","last_fullsized":"2023-11-24T08:06:43.967524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963962+0000","last_change":"2023-11-24T08:06:41.628869+0000","last_active":"2023-11-24T08:06:43.963962+0000","last_peered":"2023-11-24T08:06:43.963962+0000","last_clean":"2023-11-24T08:06:43.963962+0000","last_became_active":"2023-11-24T08:06:41.628535+0000","last_became_peered":"2023-11-24T08:06:41.628535+0000","last_unstale":"2023-11-24T08:06:43.963962+0000","last_undegraded":"2023-11-24T08:06:43.963962+0000","last_fullsized":"2023-11-24T08:06:43.963962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:03:24.083142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963641+0000","last_change":"2023-11-24T08:06:42.124842+0000","last_active":"2023-11-24T08:06:43.963641+0000","last_peered":"2023-11-24T08:06:43.963641+0000","last_clean":"2023-11-24T08:06:43.963641+0000","last_became_active":"2023-11-24T08:06:42.124506+0000","last_became_peered":"2023-11-24T08:06:42.124506+0000","last_unstale":"2023-11-24T08:06:43.963641+0000","last_undegraded":"2023-11-24T08:06:43.963641+0000","last_fullsized":"2023-11-24T08:06:43.963641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:39.047223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092249+0000","last_change":"2023-11-24T08:06:41.643552+0000","last_active":"2023-11-24T08:06:43.092249+0000","last_peered":"2023-11-24T08:06:43.092249+0000","last_clean":"2023-11-24T08:06:43.092249+0000","last_became_active":"2023-11-24T08:06:41.641818+0000","last_became_peered":"2023-11-24T08:06:41.641818+0000","last_unstale":"2023-11-24T08:06:43.092249+0000","last_undegraded":"2023-11-24T08:06:43.092249+0000","last_fullsized":"2023-11-24T08:06:43.092249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:01.271650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966965+0000","last_change":"2023-11-24T08:06:42.132641+0000","last_active":"2023-11-24T08:06:43.966965+0000","last_peered":"2023-11-24T08:06:43.966965+0000","last_clean":"2023-11-24T08:06:43.966965+0000","last_became_active":"2023-11-24T08:06:42.132319+0000","last_became_peered":"2023-11-24T08:06:42.132319+0000","last_unstale":"2023-11-24T08:06:43.966965+0000","last_undegraded":"2023-11-24T08:06:43.966965+0000","last_fullsized":"2023-11-24T08:06:43.966965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475880+0000","last_change":"2023-11-24T08:06:41.639310+0000","last_active":"2023-11-24T08:06:43.475880+0000","last_peered":"2023-11-24T08:06:43.475880+0000","last_clean":"2023-11-24T08:06:43.475880+0000","last_became_active":"2023-11-24T08:06:41.638938+0000","last_became_peered":"2023-11-24T08:06:41.638938+0000","last_unstale":"2023-11-24T08:06:43.475880+0000","last_undegraded":"2023-11-24T08:06:43.475880+0000","last_fullsized":"2023-11-24T08:06:43.475880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476046+0000","last_change":"2023-11-24T08:06:42.109812+0000","last_active":"2023-11-24T08:06:43.476046+0000","last_peered":"2023-11-24T08:06:43.476046+0000","last_clean":"2023-11-24T08:06:43.476046+0000","last_became_active":"2023-11-24T08:06:42.109207+0000","last_became_peered":"2023-11-24T08:06:42.109207+0000","last_unstale":"2023-11-24T08:06:43.476046+0000","last_undegraded":"2023-11-24T08:06:43.476046+0000","last_fullsized":"2023-11-24T08:06:43.476046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346250+0000","last_change":"2023-11-24T08:06:41.632992+0000","last_active":"2023-11-24T08:06:43.346250+0000","last_peered":"2023-11-24T08:06:43.346250+0000","last_clean":"2023-11-24T08:06:43.346250+0000","last_became_active":"2023-11-24T08:06:41.632700+0000","last_became_peered":"2023-11-24T08:06:41.632700+0000","last_unstale":"2023-11-24T08:06:43.346250+0000","last_undegraded":"2023-11-24T08:06:43.346250+0000","last_fullsized":"2023-11-24T08:06:43.346250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:12.440430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966636+0000","last_change":"2023-11-24T08:06:42.132583+0000","last_active":"2023-11-24T08:06:43.966636+0000","last_peered":"2023-11-24T08:06:43.966636+0000","last_clean":"2023-11-24T08:06:43.966636+0000","last_became_active":"2023-11-24T08:06:42.132277+0000","last_became_peered":"2023-11-24T08:06:42.132277+0000","last_unstale":"2023-11-24T08:06:43.966636+0000","last_undegraded":"2023-11-24T08:06:43.966636+0000","last_fullsized":"2023-11-24T08:06:43.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967404+0000","last_change":"2023-11-24T08:06:41.625650+0000","last_active":"2023-11-24T08:06:43.967404+0000","last_peered":"2023-11-24T08:06:43.967404+0000","last_clean":"2023-11-24T08:06:43.967404+0000","last_became_active":"2023-11-24T08:06:41.625353+0000","last_became_peered":"2023-11-24T08:06:41.625353+0000","last_unstale":"2023-11-24T08:06:43.967404+0000","last_undegraded":"2023-11-24T08:06:43.967404+0000","last_fullsized":"2023-11-24T08:06:43.967404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:18:14.524913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966991+0000","last_change":"2023-11-24T08:06:42.134924+0000","last_active":"2023-11-24T08:06:43.966991+0000","last_peered":"2023-11-24T08:06:43.966991+0000","last_clean":"2023-11-24T08:06:43.966991+0000","last_became_active":"2023-11-24T08:06:42.134575+0000","last_became_peered":"2023-11-24T08:06:42.134575+0000","last_unstale":"2023-11-24T08:06:43.966991+0000","last_undegraded":"2023-11-24T08:06:43.966991+0000","last_fullsized":"2023-11-24T08:06:43.966991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346717+0000","last_change":"2023-11-24T08:06:41.629479+0000","last_active":"2023-11-24T08:06:43.346717+0000","last_peered":"2023-11-24T08:06:43.346717+0000","last_clean":"2023-11-24T08:06:43.346717+0000","last_became_active":"2023-11-24T08:06:41.629108+0000","last_became_peered":"2023-11-24T08:06:41.629108+0000","last_unstale":"2023-11-24T08:06:43.346717+0000","last_undegraded":"2023-11-24T08:06:43.346717+0000","last_fullsized":"2023-11-24T08:06:43.346717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:15.631786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968280+0000","last_change":"2023-11-24T08:06:42.135144+0000","last_active":"2023-11-24T08:06:43.968280+0000","last_peered":"2023-11-24T08:06:43.968280+0000","last_clean":"2023-11-24T08:06:43.968280+0000","last_became_active":"2023-11-24T08:06:42.134822+0000","last_became_peered":"2023-11-24T08:06:42.134822+0000","last_unstale":"2023-11-24T08:06:43.968280+0000","last_undegraded":"2023-11-24T08:06:43.968280+0000","last_fullsized":"2023-11-24T08:06:43.968280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:07.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086868+0000","last_change":"2023-11-24T08:06:41.628750+0000","last_active":"2023-11-24T08:06:43.086868+0000","last_peered":"2023-11-24T08:06:43.086868+0000","last_clean":"2023-11-24T08:06:43.086868+0000","last_became_active":"2023-11-24T08:06:41.628251+0000","last_became_peered":"2023-11-24T08:06:41.628251+0000","last_unstale":"2023-11-24T08:06:43.086868+0000","last_undegraded":"2023-11-24T08:06:43.086868+0000","last_fullsized":"2023-11-24T08:06:43.086868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092304+0000","last_change":"2023-11-24T08:06:42.120468+0000","last_active":"2023-11-24T08:06:43.092304+0000","last_peered":"2023-11-24T08:06:43.092304+0000","last_clean":"2023-11-24T08:06:43.092304+0000","last_became_active":"2023-11-24T08:06:42.116425+0000","last_became_peered":"2023-11-24T08:06:42.116425+0000","last_unstale":"2023-11-24T08:06:43.092304+0000","last_undegraded":"2023-11-24T08:06:43.092304+0000","last_fullsized":"2023-11-24T08:06:43.092304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346545+0000","last_change":"2023-11-24T08:06:41.644211+0000","last_active":"2023-11-24T08:06:43.346545+0000","last_peered":"2023-11-24T08:06:43.346545+0000","last_clean":"2023-11-24T08:06:43.346545+0000","last_became_active":"2023-11-24T08:06:41.643571+0000","last_became_peered":"2023-11-24T08:06:41.643571+0000","last_unstale":"2023-11-24T08:06:43.346545+0000","last_undegraded":"2023-11-24T08:06:43.346545+0000","last_fullsized":"2023-11-24T08:06:43.346545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:26.632317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967813+0000","last_change":"2023-11-24T08:06:42.134167+0000","last_active":"2023-11-24T08:06:43.967813+0000","last_peered":"2023-11-24T08:06:43.967813+0000","last_clean":"2023-11-24T08:06:43.967813+0000","last_became_active":"2023-11-24T08:06:42.133214+0000","last_became_peered":"2023-11-24T08:06:42.133214+0000","last_unstale":"2023-11-24T08:06:43.967813+0000","last_undegraded":"2023-11-24T08:06:43.967813+0000","last_fullsized":"2023-11-24T08:06:43.967813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:06:42.117866+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:06:42.117866+0000","last_peered":"2023-11-24T08:06:42.117866+0000","last_clean":"2023-11-24T08:06:42.117866+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:06:42.117866+0000","last_undegraded":"2023-11-24T08:06:42.117866+0000","last_fullsized":"2023-11-24T08:06:42.117866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090597+0000","last_change":"2023-11-24T08:06:41.643269+0000","last_active":"2023-11-24T08:06:43.090597+0000","last_peered":"2023-11-24T08:06:43.090597+0000","last_clean":"2023-11-24T08:06:43.090597+0000","last_became_active":"2023-11-24T08:06:41.642053+0000","last_became_peered":"2023-11-24T08:06:41.642053+0000","last_unstale":"2023-11-24T08:06:43.090597+0000","last_undegraded":"2023-11-24T08:06:43.090597+0000","last_fullsized":"2023-11-24T08:06:43.090597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:26.168539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.127685+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.127439+0000","last_became_peered":"2023-11-24T08:06:42.127439+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965579+0000","last_change":"2023-11-24T08:06:41.633662+0000","last_active":"2023-11-24T08:06:43.965579+0000","last_peered":"2023-11-24T08:06:43.965579+0000","last_clean":"2023-11-24T08:06:43.965579+0000","last_became_active":"2023-11-24T08:06:41.633379+0000","last_became_peered":"2023-11-24T08:06:41.633379+0000","last_unstale":"2023-11-24T08:06:43.965579+0000","last_undegraded":"2023-11-24T08:06:43.965579+0000","last_fullsized":"2023-11-24T08:06:43.965579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963412+0000","last_change":"2023-11-24T08:06:42.115320+0000","last_active":"2023-11-24T08:06:43.963412+0000","last_peered":"2023-11-24T08:06:43.963412+0000","last_clean":"2023-11-24T08:06:43.963412+0000","last_became_active":"2023-11-24T08:06:42.115112+0000","last_became_peered":"2023-11-24T08:06:42.115112+0000","last_unstale":"2023-11-24T08:06:43.963412+0000","last_undegraded":"2023-11-24T08:06:43.963412+0000","last_fullsized":"2023-11-24T08:06:43.963412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:57:01.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346517+0000","last_change":"2023-11-24T08:06:41.626881+0000","last_active":"2023-11-24T08:06:43.346517+0000","last_peered":"2023-11-24T08:06:43.346517+0000","last_clean":"2023-11-24T08:06:43.346517+0000","last_became_active":"2023-11-24T08:06:41.626584+0000","last_became_peered":"2023-11-24T08:06:41.626584+0000","last_unstale":"2023-11-24T08:06:43.346517+0000","last_undegraded":"2023-11-24T08:06:43.346517+0000","last_fullsized":"2023-11-24T08:06:43.346517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086532+0000","last_change":"2023-11-24T08:06:42.098608+0000","last_active":"2023-11-24T08:06:43.086532+0000","last_peered":"2023-11-24T08:06:43.086532+0000","last_clean":"2023-11-24T08:06:43.086532+0000","last_became_active":"2023-11-24T08:06:42.097283+0000","last_became_peered":"2023-11-24T08:06:42.097283+0000","last_unstale":"2023-11-24T08:06:43.086532+0000","last_undegraded":"2023-11-24T08:06:43.086532+0000","last_fullsized":"2023-11-24T08:06:43.086532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092482+0000","last_change":"2023-11-24T08:06:41.642174+0000","last_active":"2023-11-24T08:06:43.092482+0000","last_peered":"2023-11-24T08:06:43.092482+0000","last_clean":"2023-11-24T08:06:43.092482+0000","last_became_active":"2023-11-24T08:06:41.639506+0000","last_became_peered":"2023-11-24T08:06:41.639506+0000","last_unstale":"2023-11-24T08:06:43.092482+0000","last_undegraded":"2023-11-24T08:06:43.092482+0000","last_fullsized":"2023-11-24T08:06:43.092482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:25.898898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966317+0000","last_change":"2023-11-24T08:06:42.113349+0000","last_active":"2023-11-24T08:06:43.966317+0000","last_peered":"2023-11-24T08:06:43.966317+0000","last_clean":"2023-11-24T08:06:43.966317+0000","last_became_active":"2023-11-24T08:06:42.112363+0000","last_became_peered":"2023-11-24T08:06:42.112363+0000","last_unstale":"2023-11-24T08:06:43.966317+0000","last_undegraded":"2023-11-24T08:06:43.966317+0000","last_fullsized":"2023-11-24T08:06:43.966317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:39.659839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086651+0000","last_change":"2023-11-24T08:06:41.628541+0000","last_active":"2023-11-24T08:06:43.086651+0000","last_peered":"2023-11-24T08:06:43.086651+0000","last_clean":"2023-11-24T08:06:43.086651+0000","last_became_active":"2023-11-24T08:06:41.627852+0000","last_became_peered":"2023-11-24T08:06:41.627852+0000","last_unstale":"2023-11-24T08:06:43.086651+0000","last_undegraded":"2023-11-24T08:06:43.086651+0000","last_fullsized":"2023-11-24T08:06:43.086651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:47.669843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091336+0000","last_change":"2023-11-24T08:06:42.123280+0000","last_active":"2023-11-24T08:06:43.091336+0000","last_peered":"2023-11-24T08:06:43.091336+0000","last_clean":"2023-11-24T08:06:43.091336+0000","last_became_active":"2023-11-24T08:06:42.122955+0000","last_became_peered":"2023-11-24T08:06:42.122955+0000","last_unstale":"2023-11-24T08:06:43.091336+0000","last_undegraded":"2023-11-24T08:06:43.091336+0000","last_fullsized":"2023-11-24T08:06:43.091336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968092+0000","last_change":"2023-11-24T08:06:41.640956+0000","last_active":"2023-11-24T08:06:43.968092+0000","last_peered":"2023-11-24T08:06:43.968092+0000","last_clean":"2023-11-24T08:06:43.968092+0000","last_became_active":"2023-11-24T08:06:41.640647+0000","last_became_peered":"2023-11-24T08:06:41.640647+0000","last_unstale":"2023-11-24T08:06:43.968092+0000","last_undegraded":"2023-11-24T08:06:43.968092+0000","last_fullsized":"2023-11-24T08:06:43.968092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:01.459437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086672+0000","last_change":"2023-11-24T08:06:42.101030+0000","last_active":"2023-11-24T08:06:43.086672+0000","last_peered":"2023-11-24T08:06:43.086672+0000","last_clean":"2023-11-24T08:06:43.086672+0000","last_became_active":"2023-11-24T08:06:42.100750+0000","last_became_peered":"2023-11-24T08:06:42.100750+0000","last_unstale":"2023-11-24T08:06:43.086672+0000","last_undegraded":"2023-11-24T08:06:43.086672+0000","last_fullsized":"2023-11-24T08:06:43.086672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:44.312692+0000","last_change":"2023-11-24T08:06:41.639221+0000","last_active":"2023-11-24T08:06:44.312692+0000","last_peered":"2023-11-24T08:06:44.312692+0000","last_clean":"2023-11-24T08:06:44.312692+0000","last_became_active":"2023-11-24T08:06:41.638888+0000","last_became_peered":"2023-11-24T08:06:41.638888+0000","last_unstale":"2023-11-24T08:06:44.312692+0000","last_undegraded":"2023-11-24T08:06:44.312692+0000","last_fullsized":"2023-11-24T08:06:44.312692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:38.326101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966489+0000","last_change":"2023-11-24T08:06:42.123237+0000","last_active":"2023-11-24T08:06:43.966489+0000","last_peered":"2023-11-24T08:06:43.966489+0000","last_clean":"2023-11-24T08:06:43.966489+0000","last_became_active":"2023-11-24T08:06:42.122966+0000","last_became_peered":"2023-11-24T08:06:42.122966+0000","last_unstale":"2023-11-24T08:06:43.966489+0000","last_undegraded":"2023-11-24T08:06:43.966489+0000","last_fullsized":"2023-11-24T08:06:43.966489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476853+0000","last_change":"2023-11-24T08:06:41.635985+0000","last_active":"2023-11-24T08:06:43.476853+0000","last_peered":"2023-11-24T08:06:43.476853+0000","last_clean":"2023-11-24T08:06:43.476853+0000","last_became_active":"2023-11-24T08:06:41.634284+0000","last_became_peered":"2023-11-24T08:06:41.634284+0000","last_unstale":"2023-11-24T08:06:43.476853+0000","last_undegraded":"2023-11-24T08:06:43.476853+0000","last_fullsized":"2023-11-24T08:06:43.476853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963977+0000","last_change":"2023-11-24T08:06:42.104357+0000","last_active":"2023-11-24T08:06:43.963977+0000","last_peered":"2023-11-24T08:06:43.963977+0000","last_clean":"2023-11-24T08:06:43.963977+0000","last_became_active":"2023-11-24T08:06:42.103319+0000","last_became_peered":"2023-11-24T08:06:42.103319+0000","last_unstale":"2023-11-24T08:06:43.963977+0000","last_undegraded":"2023-11-24T08:06:43.963977+0000","last_fullsized":"2023-11-24T08:06:43.963977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:25.354171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966408+0000","last_change":"2023-11-24T08:06:41.635130+0000","last_active":"2023-11-24T08:06:43.966408+0000","last_peered":"2023-11-24T08:06:43.966408+0000","last_clean":"2023-11-24T08:06:43.966408+0000","last_became_active":"2023-11-24T08:06:41.634857+0000","last_became_peered":"2023-11-24T08:06:41.634857+0000","last_unstale":"2023-11-24T08:06:43.966408+0000","last_undegraded":"2023-11-24T08:06:43.966408+0000","last_fullsized":"2023-11-24T08:06:43.966408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967411+0000","last_change":"2023-11-24T08:06:42.109364+0000","last_active":"2023-11-24T08:06:43.967411+0000","last_peered":"2023-11-24T08:06:43.967411+0000","last_clean":"2023-11-24T08:06:43.967411+0000","last_became_active":"2023-11-24T08:06:42.108977+0000","last_became_peered":"2023-11-24T08:06:42.108977+0000","last_unstale":"2023-11-24T08:06:43.967411+0000","last_undegraded":"2023-11-24T08:06:43.967411+0000","last_fullsized":"2023-11-24T08:06:43.967411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086495+0000","last_change":"2023-11-24T08:06:41.630908+0000","last_active":"2023-11-24T08:06:43.086495+0000","last_peered":"2023-11-24T08:06:43.086495+0000","last_clean":"2023-11-24T08:06:43.086495+0000","last_became_active":"2023-11-24T08:06:41.630585+0000","last_became_peered":"2023-11-24T08:06:41.630585+0000","last_unstale":"2023-11-24T08:06:43.086495+0000","last_undegraded":"2023-11-24T08:06:43.086495+0000","last_fullsized":"2023-11-24T08:06:43.086495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966678+0000","last_change":"2023-11-24T08:06:42.102831+0000","last_active":"2023-11-24T08:06:43.966678+0000","last_peered":"2023-11-24T08:06:43.966678+0000","last_clean":"2023-11-24T08:06:43.966678+0000","last_became_active":"2023-11-24T08:06:42.100929+0000","last_became_peered":"2023-11-24T08:06:42.100929+0000","last_unstale":"2023-11-24T08:06:43.966678+0000","last_undegraded":"2023-11-24T08:06:43.966678+0000","last_fullsized":"2023-11-24T08:06:43.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086955+0000","last_change":"2023-11-24T08:06:41.628964+0000","last_active":"2023-11-24T08:06:43.086955+0000","last_peered":"2023-11-24T08:06:43.086955+0000","last_clean":"2023-11-24T08:06:43.086955+0000","last_became_active":"2023-11-24T08:06:41.628682+0000","last_became_peered":"2023-11-24T08:06:41.628682+0000","last_unstale":"2023-11-24T08:06:43.086955+0000","last_undegraded":"2023-11-24T08:06:43.086955+0000","last_fullsized":"2023-11-24T08:06:43.086955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966228+0000","last_change":"2023-11-24T08:06:42.108598+0000","last_active":"2023-11-24T08:06:43.966228+0000","last_peered":"2023-11-24T08:06:43.966228+0000","last_clean":"2023-11-24T08:06:43.966228+0000","last_became_active":"2023-11-24T08:06:42.107835+0000","last_became_peered":"2023-11-24T08:06:42.107835+0000","last_unstale":"2023-11-24T08:06:43.966228+0000","last_undegraded":"2023-11-24T08:06:43.966228+0000","last_fullsized":"2023-11-24T08:06:43.966228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967014+0000","last_change":"2023-11-24T08:06:41.636550+0000","last_active":"2023-11-24T08:06:43.967014+0000","last_peered":"2023-11-24T08:06:43.967014+0000","last_clean":"2023-11-24T08:06:43.967014+0000","last_became_active":"2023-11-24T08:06:41.635883+0000","last_became_peered":"2023-11-24T08:06:41.635883+0000","last_unstale":"2023-11-24T08:06:43.967014+0000","last_undegraded":"2023-11-24T08:06:43.967014+0000","last_fullsized":"2023-11-24T08:06:43.967014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476030+0000","last_change":"2023-11-24T08:06:42.120896+0000","last_active":"2023-11-24T08:06:43.476030+0000","last_peered":"2023-11-24T08:06:43.476030+0000","last_clean":"2023-11-24T08:06:43.476030+0000","last_became_active":"2023-11-24T08:06:42.120699+0000","last_became_peered":"2023-11-24T08:06:42.120699+0000","last_unstale":"2023-11-24T08:06:43.476030+0000","last_undegraded":"2023-11-24T08:06:43.476030+0000","last_fullsized":"2023-11-24T08:06:43.476030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091224+0000","last_change":"2023-11-24T08:06:42.127564+0000","last_active":"2023-11-24T08:06:43.091224+0000","last_peered":"2023-11-24T08:06:43.091224+0000","last_clean":"2023-11-24T08:06:43.091224+0000","last_became_active":"2023-11-24T08:06:42.127280+0000","last_became_peered":"2023-11-24T08:06:42.127280+0000","last_unstale":"2023-11-24T08:06:43.091224+0000","last_undegraded":"2023-11-24T08:06:43.091224+0000","last_fullsized":"2023-11-24T08:06:43.091224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967373+0000","last_change":"2023-11-24T08:06:41.640662+0000","last_active":"2023-11-24T08:06:43.967373+0000","last_peered":"2023-11-24T08:06:43.967373+0000","last_clean":"2023-11-24T08:06:43.967373+0000","last_became_active":"2023-11-24T08:06:41.640349+0000","last_became_peered":"2023-11-24T08:06:41.640349+0000","last_unstale":"2023-11-24T08:06:43.967373+0000","last_undegraded":"2023-11-24T08:06:43.967373+0000","last_fullsized":"2023-11-24T08:06:43.967373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092068+0000","last_change":"2023-11-24T08:06:42.122723+0000","last_active":"2023-11-24T08:06:43.092068+0000","last_peered":"2023-11-24T08:06:43.092068+0000","last_clean":"2023-11-24T08:06:43.092068+0000","last_became_active":"2023-11-24T08:06:42.122440+0000","last_became_peered":"2023-11-24T08:06:42.122440+0000","last_unstale":"2023-11-24T08:06:43.092068+0000","last_undegraded":"2023-11-24T08:06:43.092068+0000","last_fullsized":"2023-11-24T08:06:43.092068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967777+0000","last_change":"2023-11-24T08:06:41.643783+0000","last_active":"2023-11-24T08:06:43.967777+0000","last_peered":"2023-11-24T08:06:43.967777+0000","last_clean":"2023-11-24T08:06:43.967777+0000","last_became_active":"2023-11-24T08:06:41.643547+0000","last_became_peered":"2023-11-24T08:06:41.643547+0000","last_unstale":"2023-11-24T08:06:43.967777+0000","last_undegraded":"2023-11-24T08:06:43.967777+0000","last_fullsized":"2023-11-24T08:06:43.967777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963856+0000","last_change":"2023-11-24T08:06:42.132774+0000","last_active":"2023-11-24T08:06:43.963856+0000","last_peered":"2023-11-24T08:06:43.963856+0000","last_clean":"2023-11-24T08:06:43.963856+0000","last_became_active":"2023-11-24T08:06:42.132564+0000","last_became_peered":"2023-11-24T08:06:42.132564+0000","last_unstale":"2023-11-24T08:06:43.963856+0000","last_undegraded":"2023-11-24T08:06:43.963856+0000","last_fullsized":"2023-11-24T08:06:43.963856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:39:33.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966291+0000","last_change":"2023-11-24T08:06:41.626427+0000","last_active":"2023-11-24T08:06:43.966291+0000","last_peered":"2023-11-24T08:06:43.966291+0000","last_clean":"2023-11-24T08:06:43.966291+0000","last_became_active":"2023-11-24T08:06:41.625025+0000","last_became_peered":"2023-11-24T08:06:41.625025+0000","last_unstale":"2023-11-24T08:06:43.966291+0000","last_undegraded":"2023-11-24T08:06:43.966291+0000","last_fullsized":"2023-11-24T08:06:43.966291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966230+0000","last_change":"2023-11-24T08:06:42.122014+0000","last_active":"2023-11-24T08:06:43.966230+0000","last_peered":"2023-11-24T08:06:43.966230+0000","last_clean":"2023-11-24T08:06:43.966230+0000","last_became_active":"2023-11-24T08:06:42.121753+0000","last_became_peered":"2023-11-24T08:06:42.121753+0000","last_unstale":"2023-11-24T08:06:43.966230+0000","last_undegraded":"2023-11-24T08:06:43.966230+0000","last_fullsized":"2023-11-24T08:06:43.966230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964226+0000","last_change":"2023-11-24T08:06:41.633665+0000","last_active":"2023-11-24T08:06:43.964226+0000","last_peered":"2023-11-24T08:06:43.964226+0000","last_clean":"2023-11-24T08:06:43.964226+0000","last_became_active":"2023-11-24T08:06:41.633430+0000","last_became_peered":"2023-11-24T08:06:41.633430+0000","last_unstale":"2023-11-24T08:06:43.964226+0000","last_undegraded":"2023-11-24T08:06:43.964226+0000","last_fullsized":"2023-11-24T08:06:43.964226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:05:34.192369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":823296,"data_stored":669826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.792}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":78876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":669882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8460000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.96}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0049999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:06:54.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:06:54.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.560+0000 7f94ca3d5640 1 Processor -- start 2023-11-24T08:06:54.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.561+0000 7f94ca3d5640 1 -- start start 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94ca3d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 0x7f94c40ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94ca3d5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f94c40ced60 0x7f94c40d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94ca3d5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c40b3400 con 0x7f94c40d1d20 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94ca3d5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40d1390 con 0x7f94c40ced60 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94ca3d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40d21b0 con 0x7f94c415d610 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94c8972640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f94c40d1d20 0x7f94c40cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43592/0 (socket says 172.21.15.97:43592) 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94c8972640 1 -- 172.21.15.97:0/231327594 learned_addr learned my addr 172.21.15.97:0/231327594 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94c37fe640 1 --2- 172.21.15.97:0/231327594 >> v2:172.21.15.183:3300/0 conn(0x7f94c40ced60 0x7f94c40d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.562+0000 7f94c3fff640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 0x7f94c40ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293670116 0 0) 0x7f94c40b3400 con 0x7f94c40d1d20 2023-11-24T08:06:54.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b0003520 con 0x7f94c40d1d20 2023-11-24T08:06:54.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3684198573 0 0) 0x7f94b0003520 con 0x7f94c40d1d20 2023-11-24T08:06:54.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 msgr2=0x7f94c40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:54.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 0x7f94c40ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 >> v2:172.21.15.183:3300/0 conn(0x7f94c40ced60 msgr2=0x7f94c40d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:54.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 --2- 172.21.15.97:0/231327594 >> v2:172.21.15.183:3300/0 conn(0x7f94c40ced60 0x7f94c40d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40b27f0 con 0x7f94c40d1d20 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f94bc001670 con 0x7f94c40d1d20 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 >> v1:172.21.15.97:6789/0 conn(0x7f94c40d1d20 legacy=0x7f94c40cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0003970 0x7f94b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 0x7f94b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40d1390 con 0x7f94b0004d00 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40d21b0 con 0x7f94b0003970 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.563+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b000b980 con 0x7f94c415d610 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c8972640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c3fff640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0003970 0x7f94b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c37fe640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 0x7f94b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c8972640 1 -- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 msgr2=0x7f94b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c8972640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415d610 0x7f94b00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c8972640 1 -- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0003970 msgr2=0x7f94b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c8972640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94b0003970 0x7f94b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.564+0000 7f94c8972640 1 -- 172.21.15.97:0/231327594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0003520 con 0x7f94b0004d00 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.565+0000 7f94c8972640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94b0005180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c290 tx=0x7f94b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e622b5cb49132be0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.565+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc005ad0 con 0x7f94b0004d00 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.565+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc005c30 con 0x7f94b0004d00 2023-11-24T08:06:54.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.565+0000 7f94c2ffd640 1 -- 172.21.15.97:0/231327594 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc02c8d0 con 0x7f94b0004d00 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.566+0000 7f94ca3d5640 1 -- 172.21.15.97:0/231327594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 msgr2=0x7f94b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.566+0000 7f94ca3d5640 1 --2- 172.21.15.97:0/231327594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94b0005180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c290 tx=0x7f94b00057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.566+0000 7f94c8972640 1 -- 172.21.15.97:0/231327594 reap_dead start 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.566+0000 7f94ca3d5640 1 -- 172.21.15.97:0/231327594 shutdown_connections 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.566+0000 7f94ca3d5640 1 -- 172.21.15.97:0/231327594 >> 172.21.15.97:0/231327594 conn(0x7f94c409c540 msgr2=0x7f94c40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.566+0000 7f94ca3d5640 1 -- 172.21.15.97:0/231327594 shutdown_connections 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.566+0000 7f94ca3d5640 1 -- 172.21.15.97:0/231327594 wait complete. 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.568+0000 7f94ca3d5640 1 Processor -- start 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.568+0000 7f94ca3d5640 1 -- start start 2023-11-24T08:06:54.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94ca3d5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94c4151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94ca3d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415ee40 0x7f94c40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94ca3d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c4158e20 0x7f94c41592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94ca3d5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41597f0 con 0x7f94b0004d00 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94ca3d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c415f340 con 0x7f94c4158e20 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94ca3d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c415f620 con 0x7f94c415ee40 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94c4151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94c4151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57458/0 (socket says 172.21.15.97:57458) 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 -- 172.21.15.97:0/4048679478 learned_addr learned my addr 172.21.15.97:0/4048679478 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c37fe640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415ee40 0x7f94c40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c8972640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c4158e20 0x7f94c41592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 -- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415ee40 msgr2=0x7f94c40cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415ee40 0x7f94c40cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 -- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c4158e20 msgr2=0x7f94c41592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c4158e20 0x7f94c41592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.569+0000 7f94c3fff640 1 -- 172.21.15.97:0/4048679478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c415f900 con 0x7f94b0004d00 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.570+0000 7f94c3fff640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94c4151f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009fb0 tx=0x7f94b40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.570+0000 7f94c0ff9640 1 -- 172.21.15.97:0/4048679478 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b400e030 con 0x7f94b0004d00 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.570+0000 7f94c0ff9640 1 -- 172.21.15.97:0/4048679478 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4016470 con 0x7f94b0004d00 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.570+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c415fbe0 con 0x7f94b0004d00 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.570+0000 7f94c0ff9640 1 -- 172.21.15.97:0/4048679478 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4016820 con 0x7f94b0004d00 2023-11-24T08:06:54.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.570+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c41524c0 con 0x7f94b0004d00 2023-11-24T08:06:54.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.571+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c40675d0 con 0x7f94b0004d00 2023-11-24T08:06:54.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.572+0000 7f94c0ff9640 1 -- 172.21.15.97:0/4048679478 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94b4016980 con 0x7f94b0004d00 2023-11-24T08:06:54.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.573+0000 7f94c0ff9640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f94a406ae70 0x7f94a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:54.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.573+0000 7f94c0ff9640 1 -- 172.21.15.97:0/4048679478 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94b400f070 con 0x7f94b0004d00 2023-11-24T08:06:54.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.573+0000 7f94c37fe640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f94a406ae70 0x7f94a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:54.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.574+0000 7f94c37fe640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f94a406ae70 0x7f94a406d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94c40b9230 tx=0x7f94ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:54.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.577+0000 7f94c0ff9640 1 -- 172.21.15.97:0/4048679478 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94b4055600 con 0x7f94b0004d00 2023-11-24T08:06:54.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.750+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94c40b3090 con 0x7f94a406ae70 2023-11-24T08:06:54.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.770+0000 7f94c0ff9640 1 -- 172.21.15.97:0/4048679478 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264354 (secure 0 0 0) 0x7f94ac009600 con 0x7f94a406ae70 2023-11-24T08:06:54.775 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:54.776 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:06:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f94a406ae70 msgr2=0x7f94a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f94a406ae70 0x7f94a406d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94c40b9230 tx=0x7f94ac008040 comp rx=0 tx=0).stop 2023-11-24T08:06:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 msgr2=0x7f94c4151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94c4151f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009fb0 tx=0x7f94b40115a0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 shutdown_connections 2023-11-24T08:06:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f94a406ae70 0x7f94a406d330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c4158e20 0x7f94c41592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415ee40 0x7f94c40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 --2- 172.21.15.97:0/4048679478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94b0004d00 0x7f94c4151f80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 >> 172.21.15.97:0/4048679478 conn(0x7f94c409c540 msgr2=0x7f94c40d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 shutdown_connections 2023-11-24T08:06:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:54.775+0000 7f94ca3d5640 1 -- 172.21.15.97:0/4048679478 wait complete. 2023-11-24T08:06:54.794 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-24T08:06:53.271781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223492,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751228,"statfs":{"total":773094113280,"available":772865257472,"internally_reserved":0,"allocated":3055616,"data_stored":1816564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.187214"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967929+0000","last_change":"2023-11-24T08:06:42.136230+0000","last_active":"2023-11-24T08:06:43.967929+0000","last_peered":"2023-11-24T08:06:43.967929+0000","last_clean":"2023-11-24T08:06:43.967929+0000","last_became_active":"2023-11-24T08:06:42.133570+0000","last_became_peered":"2023-11-24T08:06:42.133570+0000","last_unstale":"2023-11-24T08:06:43.967929+0000","last_undegraded":"2023-11-24T08:06:43.967929+0000","last_fullsized":"2023-11-24T08:06:43.967929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086899+0000","last_change":"2023-11-24T08:06:42.107193+0000","last_active":"2023-11-24T08:06:43.086899+0000","last_peered":"2023-11-24T08:06:43.086899+0000","last_clean":"2023-11-24T08:06:43.086899+0000","last_became_active":"2023-11-24T08:06:42.106907+0000","last_became_peered":"2023-11-24T08:06:42.106907+0000","last_unstale":"2023-11-24T08:06:43.086899+0000","last_undegraded":"2023-11-24T08:06:43.086899+0000","last_fullsized":"2023-11-24T08:06:43.086899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963992+0000","last_change":"2023-11-24T08:06:42.108263+0000","last_active":"2023-11-24T08:06:43.963992+0000","last_peered":"2023-11-24T08:06:43.963992+0000","last_clean":"2023-11-24T08:06:43.963992+0000","last_became_active":"2023-11-24T08:06:42.107647+0000","last_became_peered":"2023-11-24T08:06:42.107647+0000","last_unstale":"2023-11-24T08:06:43.963992+0000","last_undegraded":"2023-11-24T08:06:43.963992+0000","last_fullsized":"2023-11-24T08:06:43.963992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:27.401933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091686+0000","last_change":"2023-11-24T08:06:42.122069+0000","last_active":"2023-11-24T08:06:43.091686+0000","last_peered":"2023-11-24T08:06:43.091686+0000","last_clean":"2023-11-24T08:06:43.091686+0000","last_became_active":"2023-11-24T08:06:42.121385+0000","last_became_peered":"2023-11-24T08:06:42.121385+0000","last_unstale":"2023-11-24T08:06:43.091686+0000","last_undegraded":"2023-11-24T08:06:43.091686+0000","last_fullsized":"2023-11-24T08:06:43.091686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966552+0000","last_change":"2023-11-24T08:06:42.132197+0000","last_active":"2023-11-24T08:06:43.966552+0000","last_peered":"2023-11-24T08:06:43.966552+0000","last_clean":"2023-11-24T08:06:43.966552+0000","last_became_active":"2023-11-24T08:06:42.131870+0000","last_became_peered":"2023-11-24T08:06:42.131870+0000","last_unstale":"2023-11-24T08:06:43.966552+0000","last_undegraded":"2023-11-24T08:06:43.966552+0000","last_fullsized":"2023-11-24T08:06:43.966552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091338+0000","last_change":"2023-11-24T08:06:42.125563+0000","last_active":"2023-11-24T08:06:43.091338+0000","last_peered":"2023-11-24T08:06:43.091338+0000","last_clean":"2023-11-24T08:06:43.091338+0000","last_became_active":"2023-11-24T08:06:42.125192+0000","last_became_peered":"2023-11-24T08:06:42.125192+0000","last_unstale":"2023-11-24T08:06:43.091338+0000","last_undegraded":"2023-11-24T08:06:43.091338+0000","last_fullsized":"2023-11-24T08:06:43.091338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966278+0000","last_change":"2023-11-24T08:06:42.122907+0000","last_active":"2023-11-24T08:06:43.966278+0000","last_peered":"2023-11-24T08:06:43.966278+0000","last_clean":"2023-11-24T08:06:43.966278+0000","last_became_active":"2023-11-24T08:06:42.122580+0000","last_became_peered":"2023-11-24T08:06:42.122580+0000","last_unstale":"2023-11-24T08:06:43.966278+0000","last_undegraded":"2023-11-24T08:06:43.966278+0000","last_fullsized":"2023-11-24T08:06:43.966278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966567+0000","last_change":"2023-11-24T08:06:42.121885+0000","last_active":"2023-11-24T08:06:43.966567+0000","last_peered":"2023-11-24T08:06:43.966567+0000","last_clean":"2023-11-24T08:06:43.966567+0000","last_became_active":"2023-11-24T08:06:42.121567+0000","last_became_peered":"2023-11-24T08:06:42.121567+0000","last_unstale":"2023-11-24T08:06:43.966567+0000","last_undegraded":"2023-11-24T08:06:43.966567+0000","last_fullsized":"2023-11-24T08:06:43.966567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:21:55.599349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968008+0000","last_change":"2023-11-24T08:06:42.136825+0000","last_active":"2023-11-24T08:06:43.968008+0000","last_peered":"2023-11-24T08:06:43.968008+0000","last_clean":"2023-11-24T08:06:43.968008+0000","last_became_active":"2023-11-24T08:06:42.136570+0000","last_became_peered":"2023-11-24T08:06:42.136570+0000","last_unstale":"2023-11-24T08:06:43.968008+0000","last_undegraded":"2023-11-24T08:06:43.968008+0000","last_fullsized":"2023-11-24T08:06:43.968008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476754+0000","last_change":"2023-11-24T08:06:42.133333+0000","last_active":"2023-11-24T08:06:43.476754+0000","last_peered":"2023-11-24T08:06:43.476754+0000","last_clean":"2023-11-24T08:06:43.476754+0000","last_became_active":"2023-11-24T08:06:42.133051+0000","last_became_peered":"2023-11-24T08:06:42.133051+0000","last_unstale":"2023-11-24T08:06:43.476754+0000","last_undegraded":"2023-11-24T08:06:43.476754+0000","last_fullsized":"2023-11-24T08:06:43.476754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476581+0000","last_change":"2023-11-24T08:06:42.130796+0000","last_active":"2023-11-24T08:06:43.476581+0000","last_peered":"2023-11-24T08:06:43.476581+0000","last_clean":"2023-11-24T08:06:43.476581+0000","last_became_active":"2023-11-24T08:06:42.130502+0000","last_became_peered":"2023-11-24T08:06:42.130502+0000","last_unstale":"2023-11-24T08:06:43.476581+0000","last_undegraded":"2023-11-24T08:06:43.476581+0000","last_fullsized":"2023-11-24T08:06:43.476581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966612+0000","last_change":"2023-11-24T08:06:42.126261+0000","last_active":"2023-11-24T08:06:43.966612+0000","last_peered":"2023-11-24T08:06:43.966612+0000","last_clean":"2023-11-24T08:06:43.966612+0000","last_became_active":"2023-11-24T08:06:42.125771+0000","last_became_peered":"2023-11-24T08:06:42.125771+0000","last_unstale":"2023-11-24T08:06:43.966612+0000","last_undegraded":"2023-11-24T08:06:43.966612+0000","last_fullsized":"2023-11-24T08:06:43.966612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:16.965524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966004+0000","last_change":"2023-11-24T08:06:42.122706+0000","last_active":"2023-11-24T08:06:43.966004+0000","last_peered":"2023-11-24T08:06:43.966004+0000","last_clean":"2023-11-24T08:06:43.966004+0000","last_became_active":"2023-11-24T08:06:42.122378+0000","last_became_peered":"2023-11-24T08:06:42.122378+0000","last_unstale":"2023-11-24T08:06:43.966004+0000","last_undegraded":"2023-11-24T08:06:43.966004+0000","last_fullsized":"2023-11-24T08:06:43.966004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963516+0000","last_change":"2023-11-24T08:06:42.106916+0000","last_active":"2023-11-24T08:06:43.963516+0000","last_peered":"2023-11-24T08:06:43.963516+0000","last_clean":"2023-11-24T08:06:43.963516+0000","last_became_active":"2023-11-24T08:06:42.106633+0000","last_became_peered":"2023-11-24T08:06:42.106633+0000","last_unstale":"2023-11-24T08:06:43.963516+0000","last_undegraded":"2023-11-24T08:06:43.963516+0000","last_fullsized":"2023-11-24T08:06:43.963516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:48:07.993924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086431+0000","last_change":"2023-11-24T08:06:42.099238+0000","last_active":"2023-11-24T08:06:43.086431+0000","last_peered":"2023-11-24T08:06:43.086431+0000","last_clean":"2023-11-24T08:06:43.086431+0000","last_became_active":"2023-11-24T08:06:42.098972+0000","last_became_peered":"2023-11-24T08:06:42.098972+0000","last_unstale":"2023-11-24T08:06:43.086431+0000","last_undegraded":"2023-11-24T08:06:43.086431+0000","last_fullsized":"2023-11-24T08:06:43.086431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090638+0000","last_change":"2023-11-24T08:06:42.127641+0000","last_active":"2023-11-24T08:06:43.090638+0000","last_peered":"2023-11-24T08:06:43.090638+0000","last_clean":"2023-11-24T08:06:43.090638+0000","last_became_active":"2023-11-24T08:06:42.127276+0000","last_became_peered":"2023-11-24T08:06:42.127276+0000","last_unstale":"2023-11-24T08:06:43.090638+0000","last_undegraded":"2023-11-24T08:06:43.090638+0000","last_fullsized":"2023-11-24T08:06:43.090638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092315+0000","last_change":"2023-11-24T08:06:42.129079+0000","last_active":"2023-11-24T08:06:43.092315+0000","last_peered":"2023-11-24T08:06:43.092315+0000","last_clean":"2023-11-24T08:06:43.092315+0000","last_became_active":"2023-11-24T08:06:42.128796+0000","last_became_peered":"2023-11-24T08:06:42.128796+0000","last_unstale":"2023-11-24T08:06:43.092315+0000","last_undegraded":"2023-11-24T08:06:43.092315+0000","last_fullsized":"2023-11-24T08:06:43.092315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:47:35.234414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346604+0000","last_change":"2023-11-24T08:06:42.122648+0000","last_active":"2023-11-24T08:06:43.346604+0000","last_peered":"2023-11-24T08:06:43.346604+0000","last_clean":"2023-11-24T08:06:43.346604+0000","last_became_active":"2023-11-24T08:06:42.122184+0000","last_became_peered":"2023-11-24T08:06:42.122184+0000","last_unstale":"2023-11-24T08:06:43.346604+0000","last_undegraded":"2023-11-24T08:06:43.346604+0000","last_fullsized":"2023-11-24T08:06:43.346604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:47.554125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968216+0000","last_change":"2023-11-24T08:06:42.136398+0000","last_active":"2023-11-24T08:06:43.968216+0000","last_peered":"2023-11-24T08:06:43.968216+0000","last_clean":"2023-11-24T08:06:43.968216+0000","last_became_active":"2023-11-24T08:06:42.133633+0000","last_became_peered":"2023-11-24T08:06:42.133633+0000","last_unstale":"2023-11-24T08:06:43.968216+0000","last_undegraded":"2023-11-24T08:06:43.968216+0000","last_fullsized":"2023-11-24T08:06:43.968216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:45:50.299537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476680+0000","last_change":"2023-11-24T08:06:42.134200+0000","last_active":"2023-11-24T08:06:43.476680+0000","last_peered":"2023-11-24T08:06:43.476680+0000","last_clean":"2023-11-24T08:06:43.476680+0000","last_became_active":"2023-11-24T08:06:42.133905+0000","last_became_peered":"2023-11-24T08:06:42.133905+0000","last_unstale":"2023-11-24T08:06:43.476680+0000","last_undegraded":"2023-11-24T08:06:43.476680+0000","last_fullsized":"2023-11-24T08:06:43.476680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963640+0000","last_change":"2023-11-24T08:06:42.117257+0000","last_active":"2023-11-24T08:06:43.963640+0000","last_peered":"2023-11-24T08:06:43.963640+0000","last_clean":"2023-11-24T08:06:43.963640+0000","last_became_active":"2023-11-24T08:06:42.116917+0000","last_became_peered":"2023-11-24T08:06:42.116917+0000","last_unstale":"2023-11-24T08:06:43.963640+0000","last_undegraded":"2023-11-24T08:06:43.963640+0000","last_fullsized":"2023-11-24T08:06:43.963640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:35:56.791724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091695+0000","last_change":"2023-11-24T08:06:42.136875+0000","last_active":"2023-11-24T08:06:43.091695+0000","last_peered":"2023-11-24T08:06:43.091695+0000","last_clean":"2023-11-24T08:06:43.091695+0000","last_became_active":"2023-11-24T08:06:42.136572+0000","last_became_peered":"2023-11-24T08:06:42.136572+0000","last_unstale":"2023-11-24T08:06:43.091695+0000","last_undegraded":"2023-11-24T08:06:43.091695+0000","last_fullsized":"2023-11-24T08:06:43.091695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.120702+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.120446+0000","last_became_peered":"2023-11-24T08:06:42.120446+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:06.281138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090758+0000","last_change":"2023-11-24T08:06:42.117026+0000","last_active":"2023-11-24T08:06:43.090758+0000","last_peered":"2023-11-24T08:06:43.090758+0000","last_clean":"2023-11-24T08:06:43.090758+0000","last_became_active":"2023-11-24T08:06:42.115990+0000","last_became_peered":"2023-11-24T08:06:42.115990+0000","last_unstale":"2023-11-24T08:06:43.090758+0000","last_undegraded":"2023-11-24T08:06:43.090758+0000","last_fullsized":"2023-11-24T08:06:43.090758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966398+0000","last_change":"2023-11-24T08:06:42.107007+0000","last_active":"2023-11-24T08:06:43.966398+0000","last_peered":"2023-11-24T08:06:43.966398+0000","last_clean":"2023-11-24T08:06:43.966398+0000","last_became_active":"2023-11-24T08:06:42.103402+0000","last_became_peered":"2023-11-24T08:06:42.103402+0000","last_unstale":"2023-11-24T08:06:43.966398+0000","last_undegraded":"2023-11-24T08:06:43.966398+0000","last_fullsized":"2023-11-24T08:06:43.966398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:28:50.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476753+0000","last_change":"2023-11-24T08:06:42.126780+0000","last_active":"2023-11-24T08:06:43.476753+0000","last_peered":"2023-11-24T08:06:43.476753+0000","last_clean":"2023-11-24T08:06:43.476753+0000","last_became_active":"2023-11-24T08:06:42.126540+0000","last_became_peered":"2023-11-24T08:06:42.126540+0000","last_unstale":"2023-11-24T08:06:43.476753+0000","last_undegraded":"2023-11-24T08:06:43.476753+0000","last_fullsized":"2023-11-24T08:06:43.476753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086799+0000","last_change":"2023-11-24T08:06:42.100776+0000","last_active":"2023-11-24T08:06:43.086799+0000","last_peered":"2023-11-24T08:06:43.086799+0000","last_clean":"2023-11-24T08:06:43.086799+0000","last_became_active":"2023-11-24T08:06:42.098840+0000","last_became_peered":"2023-11-24T08:06:42.098840+0000","last_unstale":"2023-11-24T08:06:43.086799+0000","last_undegraded":"2023-11-24T08:06:43.086799+0000","last_fullsized":"2023-11-24T08:06:43.086799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966796+0000","last_change":"2023-11-24T08:06:42.114236+0000","last_active":"2023-11-24T08:06:43.966796+0000","last_peered":"2023-11-24T08:06:43.966796+0000","last_clean":"2023-11-24T08:06:43.966796+0000","last_became_active":"2023-11-24T08:06:42.113925+0000","last_became_peered":"2023-11-24T08:06:42.113925+0000","last_unstale":"2023-11-24T08:06:43.966796+0000","last_undegraded":"2023-11-24T08:06:43.966796+0000","last_fullsized":"2023-11-24T08:06:43.966796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964102+0000","last_change":"2023-11-24T08:06:42.110806+0000","last_active":"2023-11-24T08:06:43.964102+0000","last_peered":"2023-11-24T08:06:43.964102+0000","last_clean":"2023-11-24T08:06:43.964102+0000","last_became_active":"2023-11-24T08:06:42.110398+0000","last_became_peered":"2023-11-24T08:06:42.110398+0000","last_unstale":"2023-11-24T08:06:43.964102+0000","last_undegraded":"2023-11-24T08:06:43.964102+0000","last_fullsized":"2023-11-24T08:06:43.964102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:11.994031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092483+0000","last_change":"2023-11-24T08:06:42.119038+0000","last_active":"2023-11-24T08:06:43.092483+0000","last_peered":"2023-11-24T08:06:43.092483+0000","last_clean":"2023-11-24T08:06:43.092483+0000","last_became_active":"2023-11-24T08:06:42.116791+0000","last_became_peered":"2023-11-24T08:06:42.116791+0000","last_unstale":"2023-11-24T08:06:43.092483+0000","last_undegraded":"2023-11-24T08:06:43.092483+0000","last_fullsized":"2023-11-24T08:06:43.092483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:08.382303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346553+0000","last_change":"2023-11-24T08:06:42.118075+0000","last_active":"2023-11-24T08:06:43.346553+0000","last_peered":"2023-11-24T08:06:43.346553+0000","last_clean":"2023-11-24T08:06:43.346553+0000","last_became_active":"2023-11-24T08:06:42.117879+0000","last_became_peered":"2023-11-24T08:06:42.117879+0000","last_unstale":"2023-11-24T08:06:43.346553+0000","last_undegraded":"2023-11-24T08:06:43.346553+0000","last_fullsized":"2023-11-24T08:06:43.346553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475999+0000","last_change":"2023-11-24T08:06:42.118534+0000","last_active":"2023-11-24T08:06:43.475999+0000","last_peered":"2023-11-24T08:06:43.475999+0000","last_clean":"2023-11-24T08:06:43.475999+0000","last_became_active":"2023-11-24T08:06:42.118081+0000","last_became_peered":"2023-11-24T08:06:42.118081+0000","last_unstale":"2023-11-24T08:06:43.475999+0000","last_undegraded":"2023-11-24T08:06:43.475999+0000","last_fullsized":"2023-11-24T08:06:43.475999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966118+0000","last_change":"2023-11-24T08:06:42.105896+0000","last_active":"2023-11-24T08:06:43.966118+0000","last_peered":"2023-11-24T08:06:43.966118+0000","last_clean":"2023-11-24T08:06:43.966118+0000","last_became_active":"2023-11-24T08:06:42.105293+0000","last_became_peered":"2023-11-24T08:06:42.105293+0000","last_unstale":"2023-11-24T08:06:43.966118+0000","last_undegraded":"2023-11-24T08:06:43.966118+0000","last_fullsized":"2023-11-24T08:06:43.966118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:10.645249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966071+0000","last_change":"2023-11-24T08:06:41.631971+0000","last_active":"2023-11-24T08:06:43.966071+0000","last_peered":"2023-11-24T08:06:43.966071+0000","last_clean":"2023-11-24T08:06:43.966071+0000","last_became_active":"2023-11-24T08:06:41.631383+0000","last_became_peered":"2023-11-24T08:06:41.631383+0000","last_unstale":"2023-11-24T08:06:43.966071+0000","last_undegraded":"2023-11-24T08:06:43.966071+0000","last_fullsized":"2023-11-24T08:06:43.966071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963857+0000","last_change":"2023-11-24T08:06:42.118716+0000","last_active":"2023-11-24T08:06:43.963857+0000","last_peered":"2023-11-24T08:06:43.963857+0000","last_clean":"2023-11-24T08:06:43.963857+0000","last_became_active":"2023-11-24T08:06:42.118356+0000","last_became_peered":"2023-11-24T08:06:42.118356+0000","last_unstale":"2023-11-24T08:06:43.963857+0000","last_undegraded":"2023-11-24T08:06:43.963857+0000","last_fullsized":"2023-11-24T08:06:43.963857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:29:52.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475919+0000","last_change":"2023-11-24T08:06:41.639457+0000","last_active":"2023-11-24T08:06:43.475919+0000","last_peered":"2023-11-24T08:06:43.475919+0000","last_clean":"2023-11-24T08:06:43.475919+0000","last_became_active":"2023-11-24T08:06:41.638910+0000","last_became_peered":"2023-11-24T08:06:41.638910+0000","last_unstale":"2023-11-24T08:06:43.475919+0000","last_undegraded":"2023-11-24T08:06:43.475919+0000","last_fullsized":"2023-11-24T08:06:43.475919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965906+0000","last_change":"2023-11-24T08:06:41.639144+0000","last_active":"2023-11-24T08:06:43.965906+0000","last_peered":"2023-11-24T08:06:43.965906+0000","last_clean":"2023-11-24T08:06:43.965906+0000","last_became_active":"2023-11-24T08:06:41.638849+0000","last_became_peered":"2023-11-24T08:06:41.638849+0000","last_unstale":"2023-11-24T08:06:43.965906+0000","last_undegraded":"2023-11-24T08:06:43.965906+0000","last_fullsized":"2023-11-24T08:06:43.965906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966325+0000","last_change":"2023-11-24T08:06:42.107129+0000","last_active":"2023-11-24T08:06:43.966325+0000","last_peered":"2023-11-24T08:06:43.966325+0000","last_clean":"2023-11-24T08:06:43.966325+0000","last_became_active":"2023-11-24T08:06:42.106875+0000","last_became_peered":"2023-11-24T08:06:42.106875+0000","last_unstale":"2023-11-24T08:06:43.966325+0000","last_undegraded":"2023-11-24T08:06:43.966325+0000","last_fullsized":"2023-11-24T08:06:43.966325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:02.793175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090871+0000","last_change":"2023-11-24T08:06:41.643162+0000","last_active":"2023-11-24T08:06:43.090871+0000","last_peered":"2023-11-24T08:06:43.090871+0000","last_clean":"2023-11-24T08:06:43.090871+0000","last_became_active":"2023-11-24T08:06:41.642111+0000","last_became_peered":"2023-11-24T08:06:41.642111+0000","last_unstale":"2023-11-24T08:06:43.090871+0000","last_undegraded":"2023-11-24T08:06:43.090871+0000","last_fullsized":"2023-11-24T08:06:43.090871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086444+0000","last_change":"2023-11-24T08:06:42.102972+0000","last_active":"2023-11-24T08:06:43.086444+0000","last_peered":"2023-11-24T08:06:43.086444+0000","last_clean":"2023-11-24T08:06:43.086444+0000","last_became_active":"2023-11-24T08:06:42.102488+0000","last_became_peered":"2023-11-24T08:06:42.102488+0000","last_unstale":"2023-11-24T08:06:43.086444+0000","last_undegraded":"2023-11-24T08:06:43.086444+0000","last_fullsized":"2023-11-24T08:06:43.086444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476748+0000","last_change":"2023-11-24T08:06:41.644502+0000","last_active":"2023-11-24T08:06:43.476748+0000","last_peered":"2023-11-24T08:06:43.476748+0000","last_clean":"2023-11-24T08:06:43.476748+0000","last_became_active":"2023-11-24T08:06:41.644195+0000","last_became_peered":"2023-11-24T08:06:41.644195+0000","last_unstale":"2023-11-24T08:06:43.476748+0000","last_undegraded":"2023-11-24T08:06:43.476748+0000","last_fullsized":"2023-11-24T08:06:43.476748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091370+0000","last_change":"2023-11-24T08:06:42.128953+0000","last_active":"2023-11-24T08:06:43.091370+0000","last_peered":"2023-11-24T08:06:43.091370+0000","last_clean":"2023-11-24T08:06:43.091370+0000","last_became_active":"2023-11-24T08:06:42.128626+0000","last_became_peered":"2023-11-24T08:06:42.128626+0000","last_unstale":"2023-11-24T08:06:43.091370+0000","last_undegraded":"2023-11-24T08:06:43.091370+0000","last_fullsized":"2023-11-24T08:06:43.091370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091492+0000","last_change":"2023-11-24T08:06:41.640464+0000","last_active":"2023-11-24T08:06:43.091492+0000","last_peered":"2023-11-24T08:06:43.091492+0000","last_clean":"2023-11-24T08:06:43.091492+0000","last_became_active":"2023-11-24T08:06:41.640192+0000","last_became_peered":"2023-11-24T08:06:41.640192+0000","last_unstale":"2023-11-24T08:06:43.091492+0000","last_undegraded":"2023-11-24T08:06:43.091492+0000","last_fullsized":"2023-11-24T08:06:43.091492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:40.469927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963979+0000","last_change":"2023-11-24T08:06:42.132751+0000","last_active":"2023-11-24T08:06:43.963979+0000","last_peered":"2023-11-24T08:06:43.963979+0000","last_clean":"2023-11-24T08:06:43.963979+0000","last_became_active":"2023-11-24T08:06:42.132521+0000","last_became_peered":"2023-11-24T08:06:42.132521+0000","last_unstale":"2023-11-24T08:06:43.963979+0000","last_undegraded":"2023-11-24T08:06:43.963979+0000","last_fullsized":"2023-11-24T08:06:43.963979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:57.695423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086753+0000","last_change":"2023-11-24T08:06:41.639732+0000","last_active":"2023-11-24T08:06:43.086753+0000","last_peered":"2023-11-24T08:06:43.086753+0000","last_clean":"2023-11-24T08:06:43.086753+0000","last_became_active":"2023-11-24T08:06:41.639425+0000","last_became_peered":"2023-11-24T08:06:41.639425+0000","last_unstale":"2023-11-24T08:06:43.086753+0000","last_undegraded":"2023-11-24T08:06:43.086753+0000","last_fullsized":"2023-11-24T08:06:43.086753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966735+0000","last_change":"2023-11-24T08:06:42.128585+0000","last_active":"2023-11-24T08:06:43.966735+0000","last_peered":"2023-11-24T08:06:43.966735+0000","last_clean":"2023-11-24T08:06:43.966735+0000","last_became_active":"2023-11-24T08:06:42.125584+0000","last_became_peered":"2023-11-24T08:06:42.125584+0000","last_unstale":"2023-11-24T08:06:43.966735+0000","last_undegraded":"2023-11-24T08:06:43.966735+0000","last_fullsized":"2023-11-24T08:06:43.966735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:49.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476560+0000","last_change":"2023-11-24T08:06:41.633239+0000","last_active":"2023-11-24T08:06:43.476560+0000","last_peered":"2023-11-24T08:06:43.476560+0000","last_clean":"2023-11-24T08:06:43.476560+0000","last_became_active":"2023-11-24T08:06:41.632918+0000","last_became_peered":"2023-11-24T08:06:41.632918+0000","last_unstale":"2023-11-24T08:06:43.476560+0000","last_undegraded":"2023-11-24T08:06:43.476560+0000","last_fullsized":"2023-11-24T08:06:43.476560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:46.220387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967524+0000","last_change":"2023-11-24T08:06:42.132872+0000","last_active":"2023-11-24T08:06:43.967524+0000","last_peered":"2023-11-24T08:06:43.967524+0000","last_clean":"2023-11-24T08:06:43.967524+0000","last_became_active":"2023-11-24T08:06:42.124186+0000","last_became_peered":"2023-11-24T08:06:42.124186+0000","last_unstale":"2023-11-24T08:06:43.967524+0000","last_undegraded":"2023-11-24T08:06:43.967524+0000","last_fullsized":"2023-11-24T08:06:43.967524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963962+0000","last_change":"2023-11-24T08:06:41.628869+0000","last_active":"2023-11-24T08:06:43.963962+0000","last_peered":"2023-11-24T08:06:43.963962+0000","last_clean":"2023-11-24T08:06:43.963962+0000","last_became_active":"2023-11-24T08:06:41.628535+0000","last_became_peered":"2023-11-24T08:06:41.628535+0000","last_unstale":"2023-11-24T08:06:43.963962+0000","last_undegraded":"2023-11-24T08:06:43.963962+0000","last_fullsized":"2023-11-24T08:06:43.963962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:03:24.083142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963641+0000","last_change":"2023-11-24T08:06:42.124842+0000","last_active":"2023-11-24T08:06:43.963641+0000","last_peered":"2023-11-24T08:06:43.963641+0000","last_clean":"2023-11-24T08:06:43.963641+0000","last_became_active":"2023-11-24T08:06:42.124506+0000","last_became_peered":"2023-11-24T08:06:42.124506+0000","last_unstale":"2023-11-24T08:06:43.963641+0000","last_undegraded":"2023-11-24T08:06:43.963641+0000","last_fullsized":"2023-11-24T08:06:43.963641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:39.047223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092249+0000","last_change":"2023-11-24T08:06:41.643552+0000","last_active":"2023-11-24T08:06:43.092249+0000","last_peered":"2023-11-24T08:06:43.092249+0000","last_clean":"2023-11-24T08:06:43.092249+0000","last_became_active":"2023-11-24T08:06:41.641818+0000","last_became_peered":"2023-11-24T08:06:41.641818+0000","last_unstale":"2023-11-24T08:06:43.092249+0000","last_undegraded":"2023-11-24T08:06:43.092249+0000","last_fullsized":"2023-11-24T08:06:43.092249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:01.271650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966965+0000","last_change":"2023-11-24T08:06:42.132641+0000","last_active":"2023-11-24T08:06:43.966965+0000","last_peered":"2023-11-24T08:06:43.966965+0000","last_clean":"2023-11-24T08:06:43.966965+0000","last_became_active":"2023-11-24T08:06:42.132319+0000","last_became_peered":"2023-11-24T08:06:42.132319+0000","last_unstale":"2023-11-24T08:06:43.966965+0000","last_undegraded":"2023-11-24T08:06:43.966965+0000","last_fullsized":"2023-11-24T08:06:43.966965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:18.982709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.475880+0000","last_change":"2023-11-24T08:06:41.639310+0000","last_active":"2023-11-24T08:06:43.475880+0000","last_peered":"2023-11-24T08:06:43.475880+0000","last_clean":"2023-11-24T08:06:43.475880+0000","last_became_active":"2023-11-24T08:06:41.638938+0000","last_became_peered":"2023-11-24T08:06:41.638938+0000","last_unstale":"2023-11-24T08:06:43.475880+0000","last_undegraded":"2023-11-24T08:06:43.475880+0000","last_fullsized":"2023-11-24T08:06:43.475880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476046+0000","last_change":"2023-11-24T08:06:42.109812+0000","last_active":"2023-11-24T08:06:43.476046+0000","last_peered":"2023-11-24T08:06:43.476046+0000","last_clean":"2023-11-24T08:06:43.476046+0000","last_became_active":"2023-11-24T08:06:42.109207+0000","last_became_peered":"2023-11-24T08:06:42.109207+0000","last_unstale":"2023-11-24T08:06:43.476046+0000","last_undegraded":"2023-11-24T08:06:43.476046+0000","last_fullsized":"2023-11-24T08:06:43.476046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346250+0000","last_change":"2023-11-24T08:06:41.632992+0000","last_active":"2023-11-24T08:06:43.346250+0000","last_peered":"2023-11-24T08:06:43.346250+0000","last_clean":"2023-11-24T08:06:43.346250+0000","last_became_active":"2023-11-24T08:06:41.632700+0000","last_became_peered":"2023-11-24T08:06:41.632700+0000","last_unstale":"2023-11-24T08:06:43.346250+0000","last_undegraded":"2023-11-24T08:06:43.346250+0000","last_fullsized":"2023-11-24T08:06:43.346250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:12.440430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966636+0000","last_change":"2023-11-24T08:06:42.132583+0000","last_active":"2023-11-24T08:06:43.966636+0000","last_peered":"2023-11-24T08:06:43.966636+0000","last_clean":"2023-11-24T08:06:43.966636+0000","last_became_active":"2023-11-24T08:06:42.132277+0000","last_became_peered":"2023-11-24T08:06:42.132277+0000","last_unstale":"2023-11-24T08:06:43.966636+0000","last_undegraded":"2023-11-24T08:06:43.966636+0000","last_fullsized":"2023-11-24T08:06:43.966636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:26.668205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967404+0000","last_change":"2023-11-24T08:06:41.625650+0000","last_active":"2023-11-24T08:06:43.967404+0000","last_peered":"2023-11-24T08:06:43.967404+0000","last_clean":"2023-11-24T08:06:43.967404+0000","last_became_active":"2023-11-24T08:06:41.625353+0000","last_became_peered":"2023-11-24T08:06:41.625353+0000","last_unstale":"2023-11-24T08:06:43.967404+0000","last_undegraded":"2023-11-24T08:06:43.967404+0000","last_fullsized":"2023-11-24T08:06:43.967404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:18:14.524913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966991+0000","last_change":"2023-11-24T08:06:42.134924+0000","last_active":"2023-11-24T08:06:43.966991+0000","last_peered":"2023-11-24T08:06:43.966991+0000","last_clean":"2023-11-24T08:06:43.966991+0000","last_became_active":"2023-11-24T08:06:42.134575+0000","last_became_peered":"2023-11-24T08:06:42.134575+0000","last_unstale":"2023-11-24T08:06:43.966991+0000","last_undegraded":"2023-11-24T08:06:43.966991+0000","last_fullsized":"2023-11-24T08:06:43.966991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:23.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346717+0000","last_change":"2023-11-24T08:06:41.629479+0000","last_active":"2023-11-24T08:06:43.346717+0000","last_peered":"2023-11-24T08:06:43.346717+0000","last_clean":"2023-11-24T08:06:43.346717+0000","last_became_active":"2023-11-24T08:06:41.629108+0000","last_became_peered":"2023-11-24T08:06:41.629108+0000","last_unstale":"2023-11-24T08:06:43.346717+0000","last_undegraded":"2023-11-24T08:06:43.346717+0000","last_fullsized":"2023-11-24T08:06:43.346717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:23:15.631786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968280+0000","last_change":"2023-11-24T08:06:42.135144+0000","last_active":"2023-11-24T08:06:43.968280+0000","last_peered":"2023-11-24T08:06:43.968280+0000","last_clean":"2023-11-24T08:06:43.968280+0000","last_became_active":"2023-11-24T08:06:42.134822+0000","last_became_peered":"2023-11-24T08:06:42.134822+0000","last_unstale":"2023-11-24T08:06:43.968280+0000","last_undegraded":"2023-11-24T08:06:43.968280+0000","last_fullsized":"2023-11-24T08:06:43.968280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:18:07.422113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086868+0000","last_change":"2023-11-24T08:06:41.628750+0000","last_active":"2023-11-24T08:06:43.086868+0000","last_peered":"2023-11-24T08:06:43.086868+0000","last_clean":"2023-11-24T08:06:43.086868+0000","last_became_active":"2023-11-24T08:06:41.628251+0000","last_became_peered":"2023-11-24T08:06:41.628251+0000","last_unstale":"2023-11-24T08:06:43.086868+0000","last_undegraded":"2023-11-24T08:06:43.086868+0000","last_fullsized":"2023-11-24T08:06:43.086868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092304+0000","last_change":"2023-11-24T08:06:42.120468+0000","last_active":"2023-11-24T08:06:43.092304+0000","last_peered":"2023-11-24T08:06:43.092304+0000","last_clean":"2023-11-24T08:06:43.092304+0000","last_became_active":"2023-11-24T08:06:42.116425+0000","last_became_peered":"2023-11-24T08:06:42.116425+0000","last_unstale":"2023-11-24T08:06:43.092304+0000","last_undegraded":"2023-11-24T08:06:43.092304+0000","last_fullsized":"2023-11-24T08:06:43.092304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346545+0000","last_change":"2023-11-24T08:06:41.644211+0000","last_active":"2023-11-24T08:06:43.346545+0000","last_peered":"2023-11-24T08:06:43.346545+0000","last_clean":"2023-11-24T08:06:43.346545+0000","last_became_active":"2023-11-24T08:06:41.643571+0000","last_became_peered":"2023-11-24T08:06:41.643571+0000","last_unstale":"2023-11-24T08:06:43.346545+0000","last_undegraded":"2023-11-24T08:06:43.346545+0000","last_fullsized":"2023-11-24T08:06:43.346545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:18:26.632317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967813+0000","last_change":"2023-11-24T08:06:42.134167+0000","last_active":"2023-11-24T08:06:43.967813+0000","last_peered":"2023-11-24T08:06:43.967813+0000","last_clean":"2023-11-24T08:06:43.967813+0000","last_became_active":"2023-11-24T08:06:42.133214+0000","last_became_peered":"2023-11-24T08:06:42.133214+0000","last_unstale":"2023-11-24T08:06:43.967813+0000","last_undegraded":"2023-11-24T08:06:43.967813+0000","last_fullsized":"2023-11-24T08:06:43.967813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:44:01.250787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:06:42.117866+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:06:42.117866+0000","last_peered":"2023-11-24T08:06:42.117866+0000","last_clean":"2023-11-24T08:06:42.117866+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:06:42.117866+0000","last_undegraded":"2023-11-24T08:06:42.117866+0000","last_fullsized":"2023-11-24T08:06:42.117866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.090597+0000","last_change":"2023-11-24T08:06:41.643269+0000","last_active":"2023-11-24T08:06:43.090597+0000","last_peered":"2023-11-24T08:06:43.090597+0000","last_clean":"2023-11-24T08:06:43.090597+0000","last_became_active":"2023-11-24T08:06:41.642053+0000","last_became_peered":"2023-11-24T08:06:41.642053+0000","last_unstale":"2023-11-24T08:06:43.090597+0000","last_undegraded":"2023-11-24T08:06:43.090597+0000","last_fullsized":"2023-11-24T08:06:43.090597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:26.168539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965868+0000","last_change":"2023-11-24T08:06:42.127685+0000","last_active":"2023-11-24T08:06:43.965868+0000","last_peered":"2023-11-24T08:06:43.965868+0000","last_clean":"2023-11-24T08:06:43.965868+0000","last_became_active":"2023-11-24T08:06:42.127439+0000","last_became_peered":"2023-11-24T08:06:42.127439+0000","last_unstale":"2023-11-24T08:06:43.965868+0000","last_undegraded":"2023-11-24T08:06:43.965868+0000","last_fullsized":"2023-11-24T08:06:43.965868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:02.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.965579+0000","last_change":"2023-11-24T08:06:41.633662+0000","last_active":"2023-11-24T08:06:43.965579+0000","last_peered":"2023-11-24T08:06:43.965579+0000","last_clean":"2023-11-24T08:06:43.965579+0000","last_became_active":"2023-11-24T08:06:41.633379+0000","last_became_peered":"2023-11-24T08:06:41.633379+0000","last_unstale":"2023-11-24T08:06:43.965579+0000","last_undegraded":"2023-11-24T08:06:43.965579+0000","last_fullsized":"2023-11-24T08:06:43.965579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:32.676041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963412+0000","last_change":"2023-11-24T08:06:42.115320+0000","last_active":"2023-11-24T08:06:43.963412+0000","last_peered":"2023-11-24T08:06:43.963412+0000","last_clean":"2023-11-24T08:06:43.963412+0000","last_became_active":"2023-11-24T08:06:42.115112+0000","last_became_peered":"2023-11-24T08:06:42.115112+0000","last_unstale":"2023-11-24T08:06:43.963412+0000","last_undegraded":"2023-11-24T08:06:43.963412+0000","last_fullsized":"2023-11-24T08:06:43.963412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:57:01.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.346517+0000","last_change":"2023-11-24T08:06:41.626881+0000","last_active":"2023-11-24T08:06:43.346517+0000","last_peered":"2023-11-24T08:06:43.346517+0000","last_clean":"2023-11-24T08:06:43.346517+0000","last_became_active":"2023-11-24T08:06:41.626584+0000","last_became_peered":"2023-11-24T08:06:41.626584+0000","last_unstale":"2023-11-24T08:06:43.346517+0000","last_undegraded":"2023-11-24T08:06:43.346517+0000","last_fullsized":"2023-11-24T08:06:43.346517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086532+0000","last_change":"2023-11-24T08:06:42.098608+0000","last_active":"2023-11-24T08:06:43.086532+0000","last_peered":"2023-11-24T08:06:43.086532+0000","last_clean":"2023-11-24T08:06:43.086532+0000","last_became_active":"2023-11-24T08:06:42.097283+0000","last_became_peered":"2023-11-24T08:06:42.097283+0000","last_unstale":"2023-11-24T08:06:43.086532+0000","last_undegraded":"2023-11-24T08:06:43.086532+0000","last_fullsized":"2023-11-24T08:06:43.086532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092482+0000","last_change":"2023-11-24T08:06:41.642174+0000","last_active":"2023-11-24T08:06:43.092482+0000","last_peered":"2023-11-24T08:06:43.092482+0000","last_clean":"2023-11-24T08:06:43.092482+0000","last_became_active":"2023-11-24T08:06:41.639506+0000","last_became_peered":"2023-11-24T08:06:41.639506+0000","last_unstale":"2023-11-24T08:06:43.092482+0000","last_undegraded":"2023-11-24T08:06:43.092482+0000","last_fullsized":"2023-11-24T08:06:43.092482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:25.898898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966317+0000","last_change":"2023-11-24T08:06:42.113349+0000","last_active":"2023-11-24T08:06:43.966317+0000","last_peered":"2023-11-24T08:06:43.966317+0000","last_clean":"2023-11-24T08:06:43.966317+0000","last_became_active":"2023-11-24T08:06:42.112363+0000","last_became_peered":"2023-11-24T08:06:42.112363+0000","last_unstale":"2023-11-24T08:06:43.966317+0000","last_undegraded":"2023-11-24T08:06:43.966317+0000","last_fullsized":"2023-11-24T08:06:43.966317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:39.659839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086651+0000","last_change":"2023-11-24T08:06:41.628541+0000","last_active":"2023-11-24T08:06:43.086651+0000","last_peered":"2023-11-24T08:06:43.086651+0000","last_clean":"2023-11-24T08:06:43.086651+0000","last_became_active":"2023-11-24T08:06:41.627852+0000","last_became_peered":"2023-11-24T08:06:41.627852+0000","last_unstale":"2023-11-24T08:06:43.086651+0000","last_undegraded":"2023-11-24T08:06:43.086651+0000","last_fullsized":"2023-11-24T08:06:43.086651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:47.669843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091336+0000","last_change":"2023-11-24T08:06:42.123280+0000","last_active":"2023-11-24T08:06:43.091336+0000","last_peered":"2023-11-24T08:06:43.091336+0000","last_clean":"2023-11-24T08:06:43.091336+0000","last_became_active":"2023-11-24T08:06:42.122955+0000","last_became_peered":"2023-11-24T08:06:42.122955+0000","last_unstale":"2023-11-24T08:06:43.091336+0000","last_undegraded":"2023-11-24T08:06:43.091336+0000","last_fullsized":"2023-11-24T08:06:43.091336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.968092+0000","last_change":"2023-11-24T08:06:41.640956+0000","last_active":"2023-11-24T08:06:43.968092+0000","last_peered":"2023-11-24T08:06:43.968092+0000","last_clean":"2023-11-24T08:06:43.968092+0000","last_became_active":"2023-11-24T08:06:41.640647+0000","last_became_peered":"2023-11-24T08:06:41.640647+0000","last_unstale":"2023-11-24T08:06:43.968092+0000","last_undegraded":"2023-11-24T08:06:43.968092+0000","last_fullsized":"2023-11-24T08:06:43.968092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:01.459437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086672+0000","last_change":"2023-11-24T08:06:42.101030+0000","last_active":"2023-11-24T08:06:43.086672+0000","last_peered":"2023-11-24T08:06:43.086672+0000","last_clean":"2023-11-24T08:06:43.086672+0000","last_became_active":"2023-11-24T08:06:42.100750+0000","last_became_peered":"2023-11-24T08:06:42.100750+0000","last_unstale":"2023-11-24T08:06:43.086672+0000","last_undegraded":"2023-11-24T08:06:43.086672+0000","last_fullsized":"2023-11-24T08:06:43.086672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:44.312692+0000","last_change":"2023-11-24T08:06:41.639221+0000","last_active":"2023-11-24T08:06:44.312692+0000","last_peered":"2023-11-24T08:06:44.312692+0000","last_clean":"2023-11-24T08:06:44.312692+0000","last_became_active":"2023-11-24T08:06:41.638888+0000","last_became_peered":"2023-11-24T08:06:41.638888+0000","last_unstale":"2023-11-24T08:06:44.312692+0000","last_undegraded":"2023-11-24T08:06:44.312692+0000","last_fullsized":"2023-11-24T08:06:44.312692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:12:38.326101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966489+0000","last_change":"2023-11-24T08:06:42.123237+0000","last_active":"2023-11-24T08:06:43.966489+0000","last_peered":"2023-11-24T08:06:43.966489+0000","last_clean":"2023-11-24T08:06:43.966489+0000","last_became_active":"2023-11-24T08:06:42.122966+0000","last_became_peered":"2023-11-24T08:06:42.122966+0000","last_unstale":"2023-11-24T08:06:43.966489+0000","last_undegraded":"2023-11-24T08:06:43.966489+0000","last_fullsized":"2023-11-24T08:06:43.966489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476853+0000","last_change":"2023-11-24T08:06:41.635985+0000","last_active":"2023-11-24T08:06:43.476853+0000","last_peered":"2023-11-24T08:06:43.476853+0000","last_clean":"2023-11-24T08:06:43.476853+0000","last_became_active":"2023-11-24T08:06:41.634284+0000","last_became_peered":"2023-11-24T08:06:41.634284+0000","last_unstale":"2023-11-24T08:06:43.476853+0000","last_undegraded":"2023-11-24T08:06:43.476853+0000","last_fullsized":"2023-11-24T08:06:43.476853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:21.091385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963977+0000","last_change":"2023-11-24T08:06:42.104357+0000","last_active":"2023-11-24T08:06:43.963977+0000","last_peered":"2023-11-24T08:06:43.963977+0000","last_clean":"2023-11-24T08:06:43.963977+0000","last_became_active":"2023-11-24T08:06:42.103319+0000","last_became_peered":"2023-11-24T08:06:42.103319+0000","last_unstale":"2023-11-24T08:06:43.963977+0000","last_undegraded":"2023-11-24T08:06:43.963977+0000","last_fullsized":"2023-11-24T08:06:43.963977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:25.354171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966408+0000","last_change":"2023-11-24T08:06:41.635130+0000","last_active":"2023-11-24T08:06:43.966408+0000","last_peered":"2023-11-24T08:06:43.966408+0000","last_clean":"2023-11-24T08:06:43.966408+0000","last_became_active":"2023-11-24T08:06:41.634857+0000","last_became_peered":"2023-11-24T08:06:41.634857+0000","last_unstale":"2023-11-24T08:06:43.966408+0000","last_undegraded":"2023-11-24T08:06:43.966408+0000","last_fullsized":"2023-11-24T08:06:43.966408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:55:09.311511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967411+0000","last_change":"2023-11-24T08:06:42.109364+0000","last_active":"2023-11-24T08:06:43.967411+0000","last_peered":"2023-11-24T08:06:43.967411+0000","last_clean":"2023-11-24T08:06:43.967411+0000","last_became_active":"2023-11-24T08:06:42.108977+0000","last_became_peered":"2023-11-24T08:06:42.108977+0000","last_unstale":"2023-11-24T08:06:43.967411+0000","last_undegraded":"2023-11-24T08:06:43.967411+0000","last_fullsized":"2023-11-24T08:06:43.967411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086495+0000","last_change":"2023-11-24T08:06:41.630908+0000","last_active":"2023-11-24T08:06:43.086495+0000","last_peered":"2023-11-24T08:06:43.086495+0000","last_clean":"2023-11-24T08:06:43.086495+0000","last_became_active":"2023-11-24T08:06:41.630585+0000","last_became_peered":"2023-11-24T08:06:41.630585+0000","last_unstale":"2023-11-24T08:06:43.086495+0000","last_undegraded":"2023-11-24T08:06:43.086495+0000","last_fullsized":"2023-11-24T08:06:43.086495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:36:04.947400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966678+0000","last_change":"2023-11-24T08:06:42.102831+0000","last_active":"2023-11-24T08:06:43.966678+0000","last_peered":"2023-11-24T08:06:43.966678+0000","last_clean":"2023-11-24T08:06:43.966678+0000","last_became_active":"2023-11-24T08:06:42.100929+0000","last_became_peered":"2023-11-24T08:06:42.100929+0000","last_unstale":"2023-11-24T08:06:43.966678+0000","last_undegraded":"2023-11-24T08:06:43.966678+0000","last_fullsized":"2023-11-24T08:06:43.966678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:16.283580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.086955+0000","last_change":"2023-11-24T08:06:41.628964+0000","last_active":"2023-11-24T08:06:43.086955+0000","last_peered":"2023-11-24T08:06:43.086955+0000","last_clean":"2023-11-24T08:06:43.086955+0000","last_became_active":"2023-11-24T08:06:41.628682+0000","last_became_peered":"2023-11-24T08:06:41.628682+0000","last_unstale":"2023-11-24T08:06:43.086955+0000","last_undegraded":"2023-11-24T08:06:43.086955+0000","last_fullsized":"2023-11-24T08:06:43.086955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966228+0000","last_change":"2023-11-24T08:06:42.108598+0000","last_active":"2023-11-24T08:06:43.966228+0000","last_peered":"2023-11-24T08:06:43.966228+0000","last_clean":"2023-11-24T08:06:43.966228+0000","last_became_active":"2023-11-24T08:06:42.107835+0000","last_became_peered":"2023-11-24T08:06:42.107835+0000","last_unstale":"2023-11-24T08:06:43.966228+0000","last_undegraded":"2023-11-24T08:06:43.966228+0000","last_fullsized":"2023-11-24T08:06:43.966228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:27.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967014+0000","last_change":"2023-11-24T08:06:41.636550+0000","last_active":"2023-11-24T08:06:43.967014+0000","last_peered":"2023-11-24T08:06:43.967014+0000","last_clean":"2023-11-24T08:06:43.967014+0000","last_became_active":"2023-11-24T08:06:41.635883+0000","last_became_peered":"2023-11-24T08:06:41.635883+0000","last_unstale":"2023-11-24T08:06:43.967014+0000","last_undegraded":"2023-11-24T08:06:43.967014+0000","last_fullsized":"2023-11-24T08:06:43.967014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:09:46.540419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.476030+0000","last_change":"2023-11-24T08:06:42.120896+0000","last_active":"2023-11-24T08:06:43.476030+0000","last_peered":"2023-11-24T08:06:43.476030+0000","last_clean":"2023-11-24T08:06:43.476030+0000","last_became_active":"2023-11-24T08:06:42.120699+0000","last_became_peered":"2023-11-24T08:06:42.120699+0000","last_unstale":"2023-11-24T08:06:43.476030+0000","last_undegraded":"2023-11-24T08:06:43.476030+0000","last_fullsized":"2023-11-24T08:06:43.476030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:27.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.091224+0000","last_change":"2023-11-24T08:06:42.127564+0000","last_active":"2023-11-24T08:06:43.091224+0000","last_peered":"2023-11-24T08:06:43.091224+0000","last_clean":"2023-11-24T08:06:43.091224+0000","last_became_active":"2023-11-24T08:06:42.127280+0000","last_became_peered":"2023-11-24T08:06:42.127280+0000","last_unstale":"2023-11-24T08:06:43.091224+0000","last_undegraded":"2023-11-24T08:06:43.091224+0000","last_fullsized":"2023-11-24T08:06:43.091224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:50.340944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967373+0000","last_change":"2023-11-24T08:06:41.640662+0000","last_active":"2023-11-24T08:06:43.967373+0000","last_peered":"2023-11-24T08:06:43.967373+0000","last_clean":"2023-11-24T08:06:43.967373+0000","last_became_active":"2023-11-24T08:06:41.640349+0000","last_became_peered":"2023-11-24T08:06:41.640349+0000","last_unstale":"2023-11-24T08:06:43.967373+0000","last_undegraded":"2023-11-24T08:06:43.967373+0000","last_fullsized":"2023-11-24T08:06:43.967373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.092068+0000","last_change":"2023-11-24T08:06:42.122723+0000","last_active":"2023-11-24T08:06:43.092068+0000","last_peered":"2023-11-24T08:06:43.092068+0000","last_clean":"2023-11-24T08:06:43.092068+0000","last_became_active":"2023-11-24T08:06:42.122440+0000","last_became_peered":"2023-11-24T08:06:42.122440+0000","last_unstale":"2023-11-24T08:06:43.092068+0000","last_undegraded":"2023-11-24T08:06:43.092068+0000","last_fullsized":"2023-11-24T08:06:43.092068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:14.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.967777+0000","last_change":"2023-11-24T08:06:41.643783+0000","last_active":"2023-11-24T08:06:43.967777+0000","last_peered":"2023-11-24T08:06:43.967777+0000","last_clean":"2023-11-24T08:06:43.967777+0000","last_became_active":"2023-11-24T08:06:41.643547+0000","last_became_peered":"2023-11-24T08:06:41.643547+0000","last_unstale":"2023-11-24T08:06:43.967777+0000","last_undegraded":"2023-11-24T08:06:43.967777+0000","last_fullsized":"2023-11-24T08:06:43.967777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:33.563753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.963856+0000","last_change":"2023-11-24T08:06:42.132774+0000","last_active":"2023-11-24T08:06:43.963856+0000","last_peered":"2023-11-24T08:06:43.963856+0000","last_clean":"2023-11-24T08:06:43.963856+0000","last_became_active":"2023-11-24T08:06:42.132564+0000","last_became_peered":"2023-11-24T08:06:42.132564+0000","last_unstale":"2023-11-24T08:06:43.963856+0000","last_undegraded":"2023-11-24T08:06:43.963856+0000","last_fullsized":"2023-11-24T08:06:43.963856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:39:33.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966291+0000","last_change":"2023-11-24T08:06:41.626427+0000","last_active":"2023-11-24T08:06:43.966291+0000","last_peered":"2023-11-24T08:06:43.966291+0000","last_clean":"2023-11-24T08:06:43.966291+0000","last_became_active":"2023-11-24T08:06:41.625025+0000","last_became_peered":"2023-11-24T08:06:41.625025+0000","last_unstale":"2023-11-24T08:06:43.966291+0000","last_undegraded":"2023-11-24T08:06:43.966291+0000","last_fullsized":"2023-11-24T08:06:43.966291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:25.993380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.966230+0000","last_change":"2023-11-24T08:06:42.122014+0000","last_active":"2023-11-24T08:06:43.966230+0000","last_peered":"2023-11-24T08:06:43.966230+0000","last_clean":"2023-11-24T08:06:43.966230+0000","last_became_active":"2023-11-24T08:06:42.121753+0000","last_became_peered":"2023-11-24T08:06:42.121753+0000","last_unstale":"2023-11-24T08:06:43.966230+0000","last_undegraded":"2023-11-24T08:06:43.966230+0000","last_fullsized":"2023-11-24T08:06:43.966230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:41.586489+0000","last_clean_scrub_stamp":"2023-11-24T08:06:41.586489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.803665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:06:43.964226+0000","last_change":"2023-11-24T08:06:41.633665+0000","last_active":"2023-11-24T08:06:43.964226+0000","last_peered":"2023-11-24T08:06:43.964226+0000","last_clean":"2023-11-24T08:06:43.964226+0000","last_became_active":"2023-11-24T08:06:41.633430+0000","last_became_peered":"2023-11-24T08:06:41.633430+0000","last_unstale":"2023-11-24T08:06:43.964226+0000","last_undegraded":"2023-11-24T08:06:43.964226+0000","last_fullsized":"2023-11-24T08:06:43.964226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:40.252751+0000","last_clean_scrub_stamp":"2023-11-24T08:06:40.252751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:05:34.192369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":823296,"data_stored":669826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.792}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":78876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":669882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8460000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.96}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0049999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:06:54.799 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:06:54.799 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T08:06:54.799 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T08:06:54.800 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T08:06:55.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.046+0000 7fb85a59a640 1 Processor -- start 2023-11-24T08:06:55.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.046+0000 7fb85a59a640 1 -- start start 2023-11-24T08:06:55.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb85a59a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb85413cfa0 0x7fb85415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb85a59a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb85413fcb0 0x7fb8540b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb85a59a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8540cdec0 con 0x7fb8540cd530 2023-11-24T08:06:55.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb85a59a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540ce1a0 con 0x7fb85413cfa0 2023-11-24T08:06:55.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb85a59a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540ce480 con 0x7fb85413fcb0 2023-11-24T08:06:55.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859598640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb85413cfa0 0x7fb85415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859598640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb85413cfa0 0x7fb85415afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57466/0 (socket says 172.21.15.97:57466) 2023-11-24T08:06:55.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859598640 1 -- 172.21.15.97:0/622827124 learned_addr learned my addr 172.21.15.97:0/622827124 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:55.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb858d97640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb8540cd530 0x7fb85413f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43608/0 (socket says 172.21.15.97:43608) 2023-11-24T08:06:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859d99640 1 --2- 172.21.15.97:0/622827124 >> v2:172.21.15.183:3300/0 conn(0x7fb85413fcb0 0x7fb8540b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859598640 1 -- 172.21.15.97:0/622827124 >> v2:172.21.15.183:3300/0 conn(0x7fb85413fcb0 msgr2=0x7fb8540b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859598640 1 --2- 172.21.15.97:0/622827124 >> v2:172.21.15.183:3300/0 conn(0x7fb85413fcb0 0x7fb8540b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859598640 1 -- 172.21.15.97:0/622827124 >> v1:172.21.15.97:6789/0 conn(0x7fb8540cd530 legacy=0x7fb85413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859598640 1 -- 172.21.15.97:0/622827124 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540ce760 con 0x7fb85413cfa0 2023-11-24T08:06:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb859d99640 1 --2- 172.21.15.97:0/622827124 >> v2:172.21.15.183:3300/0 conn(0x7fb85413fcb0 0x7fb8540b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:55.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.048+0000 7fb853fff640 1 -- 172.21.15.97:0/622827124 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115028504 0 0) 0x7fb8540cdec0 con 0x7fb8540cd530 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.049+0000 7fb859598640 1 --2- 172.21.15.97:0/622827124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb85415afb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8540b3fd0 tx=0x7fb84402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb09627f7e21181c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb853fff640 1 -- 172.21.15.97:0/622827124 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84402ca80 con 0x7fb85413cfa0 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb853fff640 1 -- 172.21.15.97:0/622827124 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84402cbe0 con 0x7fb85413cfa0 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb853fff640 1 -- 172.21.15.97:0/622827124 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440343f0 con 0x7fb85413cfa0 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 -- 172.21.15.97:0/622827124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 msgr2=0x7fb85415afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 --2- 172.21.15.97:0/622827124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb85415afb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8540b3fd0 tx=0x7fb84402bee0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 -- 172.21.15.97:0/622827124 shutdown_connections 2023-11-24T08:06:55.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 --2- 172.21.15.97:0/622827124 >> v2:172.21.15.183:3300/0 conn(0x7fb85413fcb0 0x7fb8540b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 --2- 172.21.15.97:0/622827124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb85415afb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 -- 172.21.15.97:0/622827124 >> 172.21.15.97:0/622827124 conn(0x7fb85406a800 msgr2=0x7fb85406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:55.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 -- 172.21.15.97:0/622827124 shutdown_connections 2023-11-24T08:06:55.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.050+0000 7fb85a59a640 1 -- 172.21.15.97:0/622827124 wait complete. 2023-11-24T08:06:55.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.052+0000 7fb85a59a640 1 Processor -- start 2023-11-24T08:06:55.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.052+0000 7fb85a59a640 1 -- start start 2023-11-24T08:06:55.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb85a59a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8540cd530 0x7fb854134600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb85a59a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb8541f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb85a59a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb85413fcb0 0x7fb8541315a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb85a59a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854155390 con 0x7fb85413cfa0 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb85a59a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854134b40 con 0x7fb8540cd530 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb85a59a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541f7670 con 0x7fb85413fcb0 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb858d97640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb8541f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb858d97640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb8541f7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57478/0 (socket says 172.21.15.97:57478) 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.053+0000 7fb858d97640 1 -- 172.21.15.97:0/4131327543 learned_addr learned my addr 172.21.15.97:0/4131327543 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb859598640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8540cd530 0x7fb854134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb859d99640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb85413fcb0 0x7fb8541315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb858d97640 1 -- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb85413fcb0 msgr2=0x7fb8541315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb858d97640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb85413fcb0 0x7fb8541315a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb858d97640 1 -- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8540cd530 msgr2=0x7fb854134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb858d97640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8540cd530 0x7fb854134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb858d97640 1 -- 172.21.15.97:0/4131327543 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844009b30 con 0x7fb85413cfa0 2023-11-24T08:06:55.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb858d97640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb8541f7130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c4d0 tx=0x7fb84800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb851ffb640 1 -- 172.21.15.97:0/4131327543 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480074e0 con 0x7fb85413cfa0 2023-11-24T08:06:55.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb851ffb640 1 -- 172.21.15.97:0/4131327543 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848007660 con 0x7fb85413cfa0 2023-11-24T08:06:55.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8541f66e0 con 0x7fb85413cfa0 2023-11-24T08:06:55.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb851ffb640 1 -- 172.21.15.97:0/4131327543 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848004a20 con 0x7fb85413cfa0 2023-11-24T08:06:55.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.054+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8541f6930 con 0x7fb85413cfa0 2023-11-24T08:06:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.055+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb854067450 con 0x7fb85413cfa0 2023-11-24T08:06:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.056+0000 7fb851ffb640 1 -- 172.21.15.97:0/4131327543 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb848004b80 con 0x7fb85413cfa0 2023-11-24T08:06:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.057+0000 7fb851ffb640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb84006ae40 0x7fb84006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.057+0000 7fb851ffb640 1 -- 172.21.15.97:0/4131327543 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb848088bc0 con 0x7fb85413cfa0 2023-11-24T08:06:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.057+0000 7fb859598640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb84006ae40 0x7fb84006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.058+0000 7fb859598640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb84006ae40 0x7fb84006d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb844035000 tx=0x7fb844030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.061+0000 7fb851ffb640 1 -- 172.21.15.97:0/4131327543 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb848053bd0 con 0x7fb85413cfa0 2023-11-24T08:06:55.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.291+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb8540cbff0 con 0x7fb85413cfa0 2023-11-24T08:06:55.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.292+0000 7fb851ffb640 1 -- 172.21.15.97:0/4131327543 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb848018080 con 0x7fb85413cfa0 2023-11-24T08:06:55.294 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:55.294 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb84006ae40 msgr2=0x7fb84006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb84006ae40 0x7fb84006d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb844035000 tx=0x7fb844030000 comp rx=0 tx=0).stop 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 msgr2=0x7fb8541f7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb8541f7130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c4d0 tx=0x7fb84800c990 comp rx=0 tx=0).stop 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 shutdown_connections 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb84006ae40 0x7fb84006d300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb85413fcb0 0x7fb8541315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb85413cfa0 0x7fb8541f7130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 --2- 172.21.15.97:0/4131327543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8540cd530 0x7fb854134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 >> 172.21.15.97:0/4131327543 conn(0x7fb85406a800 msgr2=0x7fb8540719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 shutdown_connections 2023-11-24T08:06:55.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.295+0000 7fb85a59a640 1 -- 172.21.15.97:0/4131327543 wait complete. 2023-11-24T08:06:55.315 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T08:06:55.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:55.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.514+0000 7efc9d807640 1 Processor -- start 2023-11-24T08:06:55.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.514+0000 7efc9d807640 1 -- start start 2023-11-24T08:06:55.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc9d807640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc9813df80 0x7efc9815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc9d807640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc980cf9a0 0x7efc980cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc9d807640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9806c470 con 0x7efc9813e360 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc9d807640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9806c750 con 0x7efc9813df80 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc9d807640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9806ca30 con 0x7efc980cf9a0 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc96ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc9813df80 0x7efc9815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc96ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc9813df80 0x7efc9815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57482/0 (socket says 172.21.15.97:57482) 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.516+0000 7efc96ffd640 1 -- 172.21.15.97:0/2450202342 learned_addr learned my addr 172.21.15.97:0/2450202342 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.517+0000 7efc977fe640 1 --2- 172.21.15.97:0/2450202342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc980cf9a0 0x7efc980cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.517+0000 7efc96ffd640 1 -- 172.21.15.97:0/2450202342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc980cf9a0 msgr2=0x7efc980cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.517+0000 7efc96ffd640 1 --2- 172.21.15.97:0/2450202342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc980cf9a0 0x7efc980cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.517+0000 7efc96ffd640 1 -- 172.21.15.97:0/2450202342 >> v1:172.21.15.183:6789/0 conn(0x7efc9813e360 legacy=0x7efc980cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.517+0000 7efc96ffd640 1 -- 172.21.15.97:0/2450202342 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9806cd10 con 0x7efc9813df80 2023-11-24T08:06:55.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.518+0000 7efc96ffd640 1 --2- 172.21.15.97:0/2450202342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc9813df80 0x7efc9815bee0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc88009870 tx=0x7efc8802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d18ea6969317ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.519+0000 7efc967fc640 1 -- 172.21.15.97:0/2450202342 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88030840 con 0x7efc9813df80 2023-11-24T08:06:55.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.519+0000 7efc967fc640 1 -- 172.21.15.97:0/2450202342 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc880309a0 con 0x7efc9813df80 2023-11-24T08:06:55.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.519+0000 7efc967fc640 1 -- 172.21.15.97:0/2450202342 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88030d30 con 0x7efc9813df80 2023-11-24T08:06:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.519+0000 7efc9d807640 1 -- 172.21.15.97:0/2450202342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc9813df80 msgr2=0x7efc9815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.519+0000 7efc9d807640 1 --2- 172.21.15.97:0/2450202342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc9813df80 0x7efc9815bee0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc88009870 tx=0x7efc8802b980 comp rx=0 tx=0).stop 2023-11-24T08:06:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.520+0000 7efc9d807640 1 -- 172.21.15.97:0/2450202342 shutdown_connections 2023-11-24T08:06:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.520+0000 7efc9d807640 1 --2- 172.21.15.97:0/2450202342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc980cf9a0 0x7efc980cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.520+0000 7efc9d807640 1 --2- 172.21.15.97:0/2450202342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc9813df80 0x7efc9815bee0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.520+0000 7efc9d807640 1 -- 172.21.15.97:0/2450202342 >> 172.21.15.97:0/2450202342 conn(0x7efc9806a800 msgr2=0x7efc9806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.520+0000 7efc9d807640 1 -- 172.21.15.97:0/2450202342 shutdown_connections 2023-11-24T08:06:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.520+0000 7efc9d807640 1 -- 172.21.15.97:0/2450202342 wait complete. 2023-11-24T08:06:55.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.521+0000 7efc9d807640 1 Processor -- start 2023-11-24T08:06:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.522+0000 7efc9d807640 1 -- start start 2023-11-24T08:06:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.522+0000 7efc9d807640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc980cf9a0 0x7efc981e5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.522+0000 7efc9d807640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc9813df80 0x7efc980702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.522+0000 7efc9d807640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc9813e360 0x7efc98153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.522+0000 7efc9d807640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980716b0 con 0x7efc980cf9a0 2023-11-24T08:06:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.522+0000 7efc9d807640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98070800 con 0x7efc9813df80 2023-11-24T08:06:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.522+0000 7efc9d807640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc98070a30 con 0x7efc9813e360 2023-11-24T08:06:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc980cf9a0 0x7efc981e5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc980cf9a0 0x7efc981e5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57484/0 (socket says 172.21.15.97:57484) 2023-11-24T08:06:55.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 -- 172.21.15.97:0/1103552716 learned_addr learned my addr 172.21.15.97:0/1103552716 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:55.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 -- 172.21.15.97:0/1103552716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc9813e360 msgr2=0x7efc98153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc9813e360 0x7efc98153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 -- 172.21.15.97:0/1103552716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc9813df80 msgr2=0x7efc980702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc9813df80 0x7efc980702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 -- 172.21.15.97:0/1103552716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880094d0 con 0x7efc980cf9a0 2023-11-24T08:06:55.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.523+0000 7efc96ffd640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc980cf9a0 0x7efc981e5a90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc880090b0 tx=0x7efc88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.524+0000 7efc94ff9640 1 -- 172.21.15.97:0/1103552716 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88047070 con 0x7efc980cf9a0 2023-11-24T08:06:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.524+0000 7efc94ff9640 1 -- 172.21.15.97:0/1103552716 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc88039b50 con 0x7efc980cf9a0 2023-11-24T08:06:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.524+0000 7efc94ff9640 1 -- 172.21.15.97:0/1103552716 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88043400 con 0x7efc980cf9a0 2023-11-24T08:06:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.524+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc98070d10 con 0x7efc980cf9a0 2023-11-24T08:06:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.524+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc980712d0 con 0x7efc980cf9a0 2023-11-24T08:06:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.525+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc980675d0 con 0x7efc980cf9a0 2023-11-24T08:06:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.526+0000 7efc94ff9640 1 -- 172.21.15.97:0/1103552716 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc8804c410 con 0x7efc980cf9a0 2023-11-24T08:06:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.527+0000 7efc94ff9640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efc7806ae40 0x7efc7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.527+0000 7efc94ff9640 1 -- 172.21.15.97:0/1103552716 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc8803e070 con 0x7efc980cf9a0 2023-11-24T08:06:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.527+0000 7efc8ffff640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efc7806ae40 0x7efc7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.528+0000 7efc8ffff640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efc7806ae40 0x7efc7806d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc80000f60 tx=0x7efc800079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.531+0000 7efc94ff9640 1 -- 172.21.15.97:0/1103552716 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc88076dc0 con 0x7efc980cf9a0 2023-11-24T08:06:55.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.723+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc9806df00 con 0x7efc980cf9a0 2023-11-24T08:06:55.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.726+0000 7efc94ff9640 1 -- 172.21.15.97:0/1103552716 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7efc8807a3e0 con 0x7efc980cf9a0 2023-11-24T08:06:55.728 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:55.728 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efc7806ae40 msgr2=0x7efc7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efc7806ae40 0x7efc7806d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc80000f60 tx=0x7efc800079d0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc980cf9a0 msgr2=0x7efc981e5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc980cf9a0 0x7efc981e5a90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc880090b0 tx=0x7efc88004730 comp rx=0 tx=0).stop 2023-11-24T08:06:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 shutdown_connections 2023-11-24T08:06:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efc7806ae40 0x7efc7806d300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc9813e360 0x7efc98153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc9813df80 0x7efc980702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 --2- 172.21.15.97:0/1103552716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc980cf9a0 0x7efc981e5a90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 >> 172.21.15.97:0/1103552716 conn(0x7efc9806a800 msgr2=0x7efc9806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:55.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 shutdown_connections 2023-11-24T08:06:55.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.729+0000 7efc9d807640 1 -- 172.21.15.97:0/1103552716 wait complete. 2023-11-24T08:06:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:06:55.750 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:06:55.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.960+0000 7f42d81a9640 1 Processor -- start 2023-11-24T08:06:55.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.960+0000 7f42d81a9640 1 -- start start 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.961+0000 7f42d81a9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f42d013df80 0x7f42d015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.961+0000 7f42d81a9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42d013e360 0x7f42d00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.961+0000 7f42d81a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d015f9c0 0x7f42d00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.961+0000 7f42d81a9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d006c470 con 0x7f42d013e360 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.961+0000 7f42d81a9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d006c750 con 0x7f42d013df80 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.961+0000 7f42d81a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d006ca30 con 0x7f42d015f9c0 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42d013e360 0x7f42d00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42d013e360 0x7f42d00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57488/0 (socket says 172.21.15.97:57488) 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 -- 172.21.15.97:0/4141700570 learned_addr learned my addr 172.21.15.97:0/4141700570 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5f45640 1 --2- 172.21.15.97:0/4141700570 >> v2:172.21.15.183:3300/0 conn(0x7f42d013df80 0x7f42d015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d6746640 1 --2- 172.21.15.97:0/4141700570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d015f9c0 0x7f42d00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 -- 172.21.15.97:0/4141700570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d015f9c0 msgr2=0x7f42d00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:55.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 --2- 172.21.15.97:0/4141700570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d015f9c0 0x7f42d00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 -- 172.21.15.97:0/4141700570 >> v2:172.21.15.183:3300/0 conn(0x7f42d013df80 msgr2=0x7f42d015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:55.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 --2- 172.21.15.97:0/4141700570 >> v2:172.21.15.183:3300/0 conn(0x7f42d013df80 0x7f42d015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d5744640 1 -- 172.21.15.97:0/4141700570 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d006cd10 con 0x7f42d013e360 2023-11-24T08:06:55.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.962+0000 7f42d6746640 1 --2- 172.21.15.97:0/4141700570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d015f9c0 0x7f42d00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:55.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.963+0000 7f42d5744640 1 --2- 172.21.15.97:0/4141700570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d013e360 0x7f42d00cf290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f42d0072770 tx=0x7f42c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fb41d58f53aa86 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d4f43640 1 -- 172.21.15.97:0/4141700570 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0031870 con 0x7f42d013e360 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d4f43640 1 -- 172.21.15.97:0/4141700570 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c00319d0 con 0x7f42d013e360 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d4f43640 1 -- 172.21.15.97:0/4141700570 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0031d60 con 0x7f42d013e360 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d81a9640 1 -- 172.21.15.97:0/4141700570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d013e360 msgr2=0x7f42d00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d81a9640 1 --2- 172.21.15.97:0/4141700570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d013e360 0x7f42d00cf290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f42d0072770 tx=0x7f42c002b910 comp rx=0 tx=0).stop 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d81a9640 1 -- 172.21.15.97:0/4141700570 shutdown_connections 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d81a9640 1 --2- 172.21.15.97:0/4141700570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d015f9c0 0x7f42d00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d81a9640 1 --2- 172.21.15.97:0/4141700570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d013e360 0x7f42d00cf290 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d81a9640 1 --2- 172.21.15.97:0/4141700570 >> v2:172.21.15.183:3300/0 conn(0x7f42d013df80 0x7f42d015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.964+0000 7f42d81a9640 1 -- 172.21.15.97:0/4141700570 >> 172.21.15.97:0/4141700570 conn(0x7f42d006a800 msgr2=0x7f42d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:55.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.965+0000 7f42d81a9640 1 -- 172.21.15.97:0/4141700570 shutdown_connections 2023-11-24T08:06:55.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.965+0000 7f42d81a9640 1 -- 172.21.15.97:0/4141700570 wait complete. 2023-11-24T08:06:55.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.966+0000 7f42d81a9640 1 Processor -- start 2023-11-24T08:06:55.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.967+0000 7f42d81a9640 1 -- start start 2023-11-24T08:06:55.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d81a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d013df80 0x7f42d015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d81a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42d013e360 0x7f42d00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d81a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d015f9c0 0x7f42d01f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d81a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d0132be0 con 0x7f42d015f9c0 2023-11-24T08:06:55.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d81a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00b3a10 con 0x7f42d013e360 2023-11-24T08:06:55.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d81a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d0156f40 con 0x7f42d013df80 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d015f9c0 0x7f42d01f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d015f9c0 0x7f42d01f0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57498/0 (socket says 172.21.15.97:57498) 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 -- 172.21.15.97:0/2783402811 learned_addr learned my addr 172.21.15.97:0/2783402811 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d5744640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42d013e360 0x7f42d00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d5f45640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d013df80 0x7f42d015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 -- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d013df80 msgr2=0x7f42d015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d013df80 0x7f42d015a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 -- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42d013e360 msgr2=0x7f42d00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42d013e360 0x7f42d00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d6746640 1 -- 172.21.15.97:0/2783402811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00094d0 con 0x7f42d015f9c0 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.968+0000 7f42d5744640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42d013e360 0x7f42d00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:55.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.969+0000 7f42d6746640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d015f9c0 0x7f42d01f0170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42c800cea0 tx=0x7f42c800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.969+0000 7f42c67fc640 1 -- 172.21.15.97:0/2783402811 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8003b90 con 0x7f42d015f9c0 2023-11-24T08:06:55.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.969+0000 7f42c67fc640 1 -- 172.21.15.97:0/2783402811 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8003d10 con 0x7f42d015f9c0 2023-11-24T08:06:55.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.969+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d0157220 con 0x7f42d015f9c0 2023-11-24T08:06:55.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.969+0000 7f42c67fc640 1 -- 172.21.15.97:0/2783402811 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8004260 con 0x7f42d015f9c0 2023-11-24T08:06:55.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.969+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d01577e0 con 0x7f42d015f9c0 2023-11-24T08:06:55.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.970+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d00675d0 con 0x7f42d015f9c0 2023-11-24T08:06:55.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.972+0000 7f42c67fc640 1 -- 172.21.15.97:0/2783402811 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42c80043c0 con 0x7f42d015f9c0 2023-11-24T08:06:55.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.972+0000 7f42c67fc640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f42b406ae40 0x7f42b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:55.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.972+0000 7f42c67fc640 1 -- 172.21.15.97:0/2783402811 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42c8089ee0 con 0x7f42d015f9c0 2023-11-24T08:06:55.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.973+0000 7f42d5f45640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f42b406ae40 0x7f42b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:55.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.973+0000 7f42d5f45640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f42b406ae40 0x7f42b406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006fd0 tx=0x7f42cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:55.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:55.977+0000 7f42c67fc640 1 -- 172.21.15.97:0/2783402811 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42c8054f90 con 0x7f42d015f9c0 2023-11-24T08:06:56.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.167+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42d006df00 con 0x7f42d015f9c0 2023-11-24T08:06:56.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.168+0000 7f42c67fc640 1 -- 172.21.15.97:0/2783402811 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42c80585b0 con 0x7f42d015f9c0 2023-11-24T08:06:56.170 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:06:56.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f42b406ae40 msgr2=0x7f42b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f42b406ae40 0x7f42b406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006fd0 tx=0x7f42cc008040 comp rx=0 tx=0).stop 2023-11-24T08:06:56.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d015f9c0 msgr2=0x7f42d01f0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d015f9c0 0x7f42d01f0170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42c800cea0 tx=0x7f42c800cf90 comp rx=0 tx=0).stop 2023-11-24T08:06:56.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 shutdown_connections 2023-11-24T08:06:56.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f42b406ae40 0x7f42b406d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d015f9c0 0x7f42d01f0170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42d013e360 0x7f42d00b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 --2- 172.21.15.97:0/2783402811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42d013df80 0x7f42d015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 >> 172.21.15.97:0/2783402811 conn(0x7f42d006a800 msgr2=0x7f42d006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 shutdown_connections 2023-11-24T08:06:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.172+0000 7f42d81a9640 1 -- 172.21.15.97:0/2783402811 wait complete. 2023-11-24T08:06:56.191 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:06:56.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.400+0000 7f6e52f0f640 1 Processor -- start 2023-11-24T08:06:56.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.400+0000 7f6e52f0f640 1 -- start start 2023-11-24T08:06:56.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.402+0000 7f6e52f0f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 0x7f6e4c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.402+0000 7f6e52f0f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e4c09a170 0x7f6e4c0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.402+0000 7f6e52f0f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c06cea0 con 0x7f6e4c06c6b0 2023-11-24T08:06:56.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.402+0000 7f6e52f0f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c06cbc0 con 0x7f6e4c09a170 2023-11-24T08:06:56.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.402+0000 7f6e52f0f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c06f350 con 0x7f6e4c0cd240 2023-11-24T08:06:56.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.402+0000 7f6e4bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6e4c06c6b0 0x7f6e4c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51248/0 (socket says 172.21.15.97:51248) 2023-11-24T08:06:56.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.402+0000 7f6e4bfff640 1 -- 172.21.15.97:0/1873812299 learned_addr learned my addr 172.21.15.97:0/1873812299 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:56.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e514ac640 1 --2- 172.21.15.97:0/1873812299 >> v2:172.21.15.183:3300/0 conn(0x7f6e4c09a170 0x7f6e4c0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e50cab640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 0x7f6e4c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264983398 0 0) 0x7f6e4c06cea0 con 0x7f6e4c06c6b0 2023-11-24T08:06:56.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e3c003520 con 0x7f6e4c06c6b0 2023-11-24T08:06:56.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43578014 0 0) 0x7f6e3c003520 con 0x7f6e4c06c6b0 2023-11-24T08:06:56.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 msgr2=0x7f6e4c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 0x7f6e4c0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 >> v2:172.21.15.183:3300/0 conn(0x7f6e4c09a170 msgr2=0x7f6e4c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 --2- 172.21.15.97:0/1873812299 >> v2:172.21.15.183:3300/0 conn(0x7f6e4c09a170 0x7f6e4c0cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c06f630 con 0x7f6e4c06c6b0 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f6e38001670 con 0x7f6e4c06c6b0 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 >> v1:172.21.15.97:6789/0 conn(0x7f6e4c06c6b0 legacy=0x7f6e4c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 0x7f6e3c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c003f40 0x7f6e3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c004d00 0x7f6e3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c06cbc0 con 0x7f6e3c004d00 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c06f350 con 0x7f6e3c003f40 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.403+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c00b980 con 0x7f6e4c0cd240 2023-11-24T08:06:56.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e514ac640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c004d00 0x7f6e3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e4bfff640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c003f40 0x7f6e3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e514ac640 1 -- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 msgr2=0x7f6e3c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e50cab640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 0x7f6e3c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e514ac640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c0cd240 0x7f6e3c003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e514ac640 1 -- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c003f40 msgr2=0x7f6e3c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e514ac640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c003f40 0x7f6e3c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e514ac640 1 -- 172.21.15.97:0/1873812299 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c003520 con 0x7f6e3c004d00 2023-11-24T08:06:56.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.404+0000 7f6e4bfff640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c003f40 0x7f6e3c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:56.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.405+0000 7f6e514ac640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c004d00 0x7f6e3c005180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e170 tx=0x7f6e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3678965d77a269 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:56.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.405+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4402cc20 con 0x7f6e3c004d00 2023-11-24T08:06:56.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.405+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4400f040 con 0x7f6e3c004d00 2023-11-24T08:06:56.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.405+0000 7f6e4b7fe640 1 -- 172.21.15.97:0/1873812299 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44034440 con 0x7f6e3c004d00 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.406+0000 7f6e52f0f640 1 -- 172.21.15.97:0/1873812299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c004d00 msgr2=0x7f6e3c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.406+0000 7f6e52f0f640 1 --2- 172.21.15.97:0/1873812299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c004d00 0x7f6e3c005180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e170 tx=0x7f6e3c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.406+0000 7f6e514ac640 1 -- 172.21.15.97:0/1873812299 reap_dead start 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.406+0000 7f6e52f0f640 1 -- 172.21.15.97:0/1873812299 shutdown_connections 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.406+0000 7f6e52f0f640 1 -- 172.21.15.97:0/1873812299 >> 172.21.15.97:0/1873812299 conn(0x7f6e4c0b2d00 msgr2=0x7f6e4c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.406+0000 7f6e52f0f640 1 -- 172.21.15.97:0/1873812299 shutdown_connections 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.406+0000 7f6e52f0f640 1 -- 172.21.15.97:0/1873812299 wait complete. 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.408+0000 7f6e52f0f640 1 Processor -- start 2023-11-24T08:06:56.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.408+0000 7f6e52f0f640 1 -- start start 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e52f0f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c14f010 0x7f6e4c14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e52f0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e4c0cabb0 0x7f6e4c0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e52f0f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e4c1f1f10 0x7f6e4c1f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e52f0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0c8cc0 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e52f0f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0cb600 con 0x7f6e4c1f1f10 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e52f0f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0b51e0 con 0x7f6e4c14f010 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e4bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e4c0cabb0 0x7f6e4c0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e4bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e4c0cabb0 0x7f6e4c0c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47814/0 (socket says 172.21.15.97:47814) 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.409+0000 7f6e4bfff640 1 -- 172.21.15.97:0/2878565318 learned_addr learned my addr 172.21.15.97:0/2878565318 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e50cab640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c14f010 0x7f6e4c14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e514ac640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e4c1f1f10 0x7f6e4c1f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e4bfff640 1 -- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c14f010 msgr2=0x7f6e4c14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e4bfff640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c14f010 0x7f6e4c14f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e4bfff640 1 -- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e4c1f1f10 msgr2=0x7f6e4c1f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e4bfff640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e4c1f1f10 0x7f6e4c1f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e4bfff640 1 -- 172.21.15.97:0/2878565318 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0cb320 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e4bfff640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e4c0cabb0 0x7f6e4c0c8780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800db10 tx=0x7f6e38001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e497fa640 1 -- 172.21.15.97:0/2878565318 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38004cb0 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e497fa640 1 -- 172.21.15.97:0/2878565318 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38004e10 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e497fa640 1 -- 172.21.15.97:0/2878565318 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38007310 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c0b5480 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.410+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c0cb030 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.411+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c0b59a0 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.412+0000 7f6e497fa640 1 -- 172.21.15.97:0/2878565318 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e38007470 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.413+0000 7f6e497fa640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e3006ae40 0x7f6e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.413+0000 7f6e497fa640 1 -- 172.21.15.97:0/2878565318 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e38088fb0 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.413+0000 7f6e50cab640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e3006ae40 0x7f6e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.414+0000 7f6e50cab640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e3006ae40 0x7f6e3006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009910 tx=0x7f6e40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:56.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.417+0000 7f6e497fa640 1 -- 172.21.15.97:0/2878565318 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e4c0b59a0 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.593 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:56.602 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:56.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.605+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e4c0b59a0 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.606+0000 7f6e497fa640 1 -- 172.21.15.97:0/2878565318 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e38019020 con 0x7f6e4c0cabb0 2023-11-24T08:06:56.608 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:06:56.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.608+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e3006ae40 msgr2=0x7f6e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e3006ae40 0x7f6e3006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009910 tx=0x7f6e40008040 comp rx=0 tx=0).stop 2023-11-24T08:06:56.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e4c0cabb0 msgr2=0x7f6e4c0c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e4c0cabb0 0x7f6e4c0c8780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800db10 tx=0x7f6e38001de0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 shutdown_connections 2023-11-24T08:06:56.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e3006ae40 0x7f6e3006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e4c1f1f10 0x7f6e4c1f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e4c0cabb0 0x7f6e4c0c8780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 --2- 172.21.15.97:0/2878565318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e4c14f010 0x7f6e4c14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 >> 172.21.15.97:0/2878565318 conn(0x7f6e4c0b2d00 msgr2=0x7f6e4c0b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:56.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 shutdown_connections 2023-11-24T08:06:56.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.609+0000 7f6e52f0f640 1 -- 172.21.15.97:0/2878565318 wait complete. 2023-11-24T08:06:56.627 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:06:56.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.871+0000 7f646aa9f640 1 Processor -- start 2023-11-24T08:06:56.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.871+0000 7f646aa9f640 1 -- start start 2023-11-24T08:06:56.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.872+0000 7f646aa9f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64640adf20 0x7f6464070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f646aa9f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646415f4e0 con 0x7f646415bf10 2023-11-24T08:06:56.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f646aa9f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6464071130 con 0x7f64640ccb50 2023-11-24T08:06:56.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f646aa9f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646415f970 con 0x7f64640adf20 2023-11-24T08:06:56.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f6469a9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64640adf20 0x7f6464070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f646929c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f646415bf10 0x7f64640cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51262/0 (socket says 172.21.15.97:51262) 2023-11-24T08:06:56.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f646929c640 1 -- 172.21.15.97:0/2114811379 learned_addr learned my addr 172.21.15.97:0/2114811379 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:56.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f6469a9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64640adf20 0x7f6464070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47822/0 (socket says 172.21.15.97:47822) 2023-11-24T08:06:56.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.873+0000 7f6469a9d640 1 -- 172.21.15.97:0/2114811379 >> v1:172.21.15.183:6789/0 conn(0x7f64640ccb50 legacy=0x7f6464143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:56.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.874+0000 7f6469a9d640 1 -- 172.21.15.97:0/2114811379 >> v1:172.21.15.97:6789/0 conn(0x7f646415bf10 legacy=0x7f64640cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.874+0000 7f6469a9d640 1 -- 172.21.15.97:0/2114811379 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646415c390 con 0x7f64640adf20 2023-11-24T08:06:56.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.874+0000 7f6468a9b640 1 -- 172.21.15.97:0/2114811379 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777853509 0 0) 0x7f646415f4e0 con 0x7f646415bf10 2023-11-24T08:06:56.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.875+0000 7f6469a9d640 1 --2- 172.21.15.97:0/2114811379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f6464070a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f64600097a0 tx=0x7f646002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff46b2b6f80fec0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:56.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f6468a9b640 1 -- 172.21.15.97:0/2114811379 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460031830 con 0x7f64640adf20 2023-11-24T08:06:56.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f6468a9b640 1 -- 172.21.15.97:0/2114811379 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6460031990 con 0x7f64640adf20 2023-11-24T08:06:56.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f6468a9b640 1 -- 172.21.15.97:0/2114811379 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460031d20 con 0x7f64640adf20 2023-11-24T08:06:56.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f646aa9f640 1 -- 172.21.15.97:0/2114811379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 msgr2=0x7f6464070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f646aa9f640 1 --2- 172.21.15.97:0/2114811379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f6464070a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f64600097a0 tx=0x7f646002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f646aa9f640 1 -- 172.21.15.97:0/2114811379 shutdown_connections 2023-11-24T08:06:56.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f646aa9f640 1 --2- 172.21.15.97:0/2114811379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f6464070a30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f646aa9f640 1 -- 172.21.15.97:0/2114811379 >> 172.21.15.97:0/2114811379 conn(0x7f646406a7d0 msgr2=0x7f646406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:56.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f646aa9f640 1 -- 172.21.15.97:0/2114811379 shutdown_connections 2023-11-24T08:06:56.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.876+0000 7f646aa9f640 1 -- 172.21.15.97:0/2114811379 wait complete. 2023-11-24T08:06:56.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.878+0000 7f646aa9f640 1 Processor -- start 2023-11-24T08:06:56.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.878+0000 7f646aa9f640 1 -- start start 2023-11-24T08:06:56.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f646aa9f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f64641f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f646aa9f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64640ccb50 0x7f64640ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f646aa9f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f646415bf10 0x7f64640aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f646aa9f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640b01b0 con 0x7f64640adf20 2023-11-24T08:06:56.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f646aa9f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640af530 con 0x7f64640ccb50 2023-11-24T08:06:56.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f646aa9f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64640af810 con 0x7f646415bf10 2023-11-24T08:06:56.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f6469a9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f64641f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f6469a9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f64641f61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47826/0 (socket says 172.21.15.97:47826) 2023-11-24T08:06:56.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.879+0000 7f6469a9d640 1 -- 172.21.15.97:0/261521142 learned_addr learned my addr 172.21.15.97:0/261521142 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:56.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f646929c640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64640ccb50 0x7f64640ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f646a29e640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f646415bf10 0x7f64640aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f6469a9d640 1 -- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f646415bf10 msgr2=0x7f64640aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f6469a9d640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f646415bf10 0x7f64640aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f6469a9d640 1 -- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64640ccb50 msgr2=0x7f64640ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f6469a9d640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64640ccb50 0x7f64640ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f6469a9d640 1 -- 172.21.15.97:0/261521142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460009400 con 0x7f64640adf20 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f6469a9d640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f64641f61b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6460034040 tx=0x7f64600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f645a7fc640 1 -- 172.21.15.97:0/261521142 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646003aa60 con 0x7f64640adf20 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f645a7fc640 1 -- 172.21.15.97:0/261521142 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646003abe0 con 0x7f64640adf20 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64640afaf0 con 0x7f64640adf20 2023-11-24T08:06:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.880+0000 7f645a7fc640 1 -- 172.21.15.97:0/261521142 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460044400 con 0x7f64640adf20 2023-11-24T08:06:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.881+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64641f6d80 con 0x7f64640adf20 2023-11-24T08:06:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.882+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6464067450 con 0x7f64640adf20 2023-11-24T08:06:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.883+0000 7f645a7fc640 1 -- 172.21.15.97:0/261521142 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f646004d440 con 0x7f64640adf20 2023-11-24T08:06:56.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.884+0000 7f645a7fc640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f644806ae40 0x7f644806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:56.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.884+0000 7f645a7fc640 1 -- 172.21.15.97:0/261521142 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64600ab8b0 con 0x7f64640adf20 2023-11-24T08:06:56.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.884+0000 7f646929c640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f644806ae40 0x7f644806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:56.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.885+0000 7f646929c640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f644806ae40 0x7f644806d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f64640b2970 tx=0x7f6454009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:56.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:56.888+0000 7f645a7fc640 1 -- 172.21.15.97:0/261521142 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f64600768c0 con 0x7f64640adf20 2023-11-24T08:06:57.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.079+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f646415e370 con 0x7f64640adf20 2023-11-24T08:06:57.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.080+0000 7f645a7fc640 1 -- 172.21.15.97:0/261521142 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f64600350a0 con 0x7f64640adf20 2023-11-24T08:06:57.081 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:06:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f644806ae40 msgr2=0x7f644806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f644806ae40 0x7f644806d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f64640b2970 tx=0x7f6454009040 comp rx=0 tx=0).stop 2023-11-24T08:06:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 msgr2=0x7f64641f61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f64641f61b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6460034040 tx=0x7f64600046c0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 shutdown_connections 2023-11-24T08:06:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f644806ae40 0x7f644806d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f646415bf10 0x7f64640aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64640ccb50 0x7f64640ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 --2- 172.21.15.97:0/261521142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64640adf20 0x7f64641f61b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 >> 172.21.15.97:0/261521142 conn(0x7f646406a7d0 msgr2=0x7f646415b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:57.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 shutdown_connections 2023-11-24T08:06:57.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.083+0000 7f646aa9f640 1 -- 172.21.15.97:0/261521142 wait complete. 2023-11-24T08:06:57.104 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:57.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.305+0000 7fe5fe46b640 1 Processor -- start 2023-11-24T08:06:57.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.305+0000 7fe5fe46b640 1 -- start start 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5fe46b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe5f814b2c0 0x7fe5f80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5fe46b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f80cf7d0 0x7fe5f8070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5fe46b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80cfbf0 con 0x7fe5f8070ea0 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5fe46b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f814b6a0 con 0x7fe5f814b2c0 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5fe46b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8071690 con 0x7fe5f80cf7d0 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5f7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe5f814b2c0 0x7fe5f80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5f7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe5f814b2c0 0x7fe5f80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47842/0 (socket says 172.21.15.97:47842) 2023-11-24T08:06:57.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.307+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2009104628 learned_addr learned my addr 172.21.15.97:0/2009104628 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:57.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.308+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2009104628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f80cf7d0 msgr2=0x7fe5f8070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:57.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.308+0000 7fe5f77fe640 1 --2- 172.21.15.97:0/2009104628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f80cf7d0 0x7fe5f8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.308+0000 7fe5f7fff640 1 --2- 172.21.15.97:0/2009104628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f80cf7d0 0x7fe5f8070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.308+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2009104628 >> v1:172.21.15.97:6789/0 conn(0x7fe5f8070ea0 legacy=0x7fe5f80b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.308+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2009104628 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8071970 con 0x7fe5f814b2c0 2023-11-24T08:06:57.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.309+0000 7fe5f7fff640 1 --2- 172.21.15.97:0/2009104628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f814b2c0 0x7fe5f80cf290 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009870 tx=0x7fe5e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c89cd4363e7842 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:57.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.309+0000 7fe5f6ffd640 1 -- 172.21.15.97:0/2009104628 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0030840 con 0x7fe5f814b2c0 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.309+0000 7fe5f6ffd640 1 -- 172.21.15.97:0/2009104628 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e00309a0 con 0x7fe5f814b2c0 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.309+0000 7fe5f6ffd640 1 -- 172.21.15.97:0/2009104628 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0030d30 con 0x7fe5f814b2c0 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.309+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2009104628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f814b2c0 msgr2=0x7fe5f80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.309+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2009104628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f814b2c0 0x7fe5f80cf290 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009870 tx=0x7fe5e002b980 comp rx=0 tx=0).stop 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.310+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2009104628 shutdown_connections 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.310+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2009104628 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f80cf7d0 0x7fe5f8070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.310+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2009104628 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f814b2c0 0x7fe5f80cf290 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.310+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2009104628 >> 172.21.15.97:0/2009104628 conn(0x7fe5f806a800 msgr2=0x7fe5f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.310+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2009104628 shutdown_connections 2023-11-24T08:06:57.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.310+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2009104628 wait complete. 2023-11-24T08:06:57.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.311+0000 7fe5fe46b640 1 Processor -- start 2023-11-24T08:06:57.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.312+0000 7fe5fe46b640 1 -- start start 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.312+0000 7fe5fe46b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f8070ea0 0x7fe5f815dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.312+0000 7fe5fe46b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80cf7d0 0x7fe5f8147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5fe46b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814b2c0 0x7fe5f8163ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5fe46b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8163900 con 0x7fe5f8070ea0 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5fe46b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f81476c0 con 0x7fe5f80cf7d0 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5fe46b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8146430 con 0x7fe5f814b2c0 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f8070ea0 0x7fe5f815dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f8070ea0 0x7fe5f815dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47856/0 (socket says 172.21.15.97:47856) 2023-11-24T08:06:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2877746991 learned_addr learned my addr 172.21.15.97:0/2877746991 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:57.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2877746991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814b2c0 msgr2=0x7fe5f8163ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814b2c0 0x7fe5f8163ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2877746991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80cf7d0 msgr2=0x7fe5f8147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80cf7d0 0x7fe5f8147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 -- 172.21.15.97:0/2877746991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e00094d0 con 0x7fe5f8070ea0 2023-11-24T08:06:57.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.313+0000 7fe5f7fff640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f8070ea0 0x7fe5f815dda0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0000c00 tx=0x7fe5e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.314+0000 7fe5f4ff9640 1 -- 172.21.15.97:0/2877746991 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0030810 con 0x7fe5f8070ea0 2023-11-24T08:06:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.314+0000 7fe5f4ff9640 1 -- 172.21.15.97:0/2877746991 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0039d90 con 0x7fe5f8070ea0 2023-11-24T08:06:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.314+0000 7fe5f4ff9640 1 -- 172.21.15.97:0/2877746991 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0043670 con 0x7fe5f8070ea0 2023-11-24T08:06:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.314+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f81466a0 con 0x7fe5f8070ea0 2023-11-24T08:06:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.314+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f8146c60 con 0x7fe5f8070ea0 2023-11-24T08:06:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.315+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f80675d0 con 0x7fe5f8070ea0 2023-11-24T08:06:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.316+0000 7fe5f4ff9640 1 -- 172.21.15.97:0/2877746991 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5e002f390 con 0x7fe5f8070ea0 2023-11-24T08:06:57.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.317+0000 7fe5f4ff9640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe5d806ae40 0x7fe5d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.317+0000 7fe5f4ff9640 1 -- 172.21.15.97:0/2877746991 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5e00aba10 con 0x7fe5f8070ea0 2023-11-24T08:06:57.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.317+0000 7fe5f77fe640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe5d806ae40 0x7fe5d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.318+0000 7fe5f77fe640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe5d806ae40 0x7fe5d806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8161580 tx=0x7fe5e8007390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:57.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.321+0000 7fe5f4ff9640 1 -- 172.21.15.97:0/2877746991 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5e0076a20 con 0x7fe5f8070ea0 2023-11-24T08:06:57.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.547+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5f814aac0 con 0x7fe5f8070ea0 2023-11-24T08:06:57.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.548+0000 7fe5f4ff9640 1 -- 172.21.15.97:0/2877746991 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fe5e0034090 con 0x7fe5f8070ea0 2023-11-24T08:06:57.550 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:57.550 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:06:57.551 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:06:57.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe5d806ae40 msgr2=0x7fe5d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe5d806ae40 0x7fe5d806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8161580 tx=0x7fe5e8007390 comp rx=0 tx=0).stop 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f8070ea0 msgr2=0x7fe5f815dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f8070ea0 0x7fe5f815dda0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0000c00 tx=0x7fe5e0004730 comp rx=0 tx=0).stop 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 shutdown_connections 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe5d806ae40 0x7fe5d806d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f814b2c0 0x7fe5f8163ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f80cf7d0 0x7fe5f8147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 --2- 172.21.15.97:0/2877746991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5f8070ea0 0x7fe5f815dda0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.551+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 >> 172.21.15.97:0/2877746991 conn(0x7fe5f806a800 msgr2=0x7fe5f80b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.552+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 shutdown_connections 2023-11-24T08:06:57.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.552+0000 7fe5fe46b640 1 -- 172.21.15.97:0/2877746991 wait complete. 2023-11-24T08:06:57.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:06:57.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.778+0000 7fa00f0e0640 1 Processor -- start 2023-11-24T08:06:57.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.778+0000 7fa00f0e0640 1 -- start start 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.779+0000 7fa00f0e0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa00813df80 0x7fa00815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.779+0000 7fa00f0e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813e360 0x7fa0080cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.779+0000 7fa00f0e0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00806c470 con 0x7fa00815f9c0 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.779+0000 7fa00f0e0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00806c750 con 0x7fa00813df80 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.779+0000 7fa00f0e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00806ca30 con 0x7fa00813e360 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00ce7c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa00813df80 0x7fa00815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00ce7c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa00813df80 0x7fa00815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47860/0 (socket says 172.21.15.97:47860) 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00d67d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa00815f9c0 0x7fa0081408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51286/0 (socket says 172.21.15.97:51286) 2023-11-24T08:06:57.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00ce7c640 1 -- 172.21.15.97:0/2957696040 learned_addr learned my addr 172.21.15.97:0/2957696040 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:57.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa007fff640 1 --2- 172.21.15.97:0/2957696040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813e360 0x7fa0080cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00ce7c640 1 -- 172.21.15.97:0/2957696040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813e360 msgr2=0x7fa0080cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:57.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00ce7c640 1 --2- 172.21.15.97:0/2957696040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813e360 0x7fa0080cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00ce7c640 1 -- 172.21.15.97:0/2957696040 >> v1:172.21.15.97:6789/0 conn(0x7fa00815f9c0 legacy=0x7fa0081408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa00ce7c640 1 -- 172.21.15.97:0/2957696040 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00806cd10 con 0x7fa00813df80 2023-11-24T08:06:57.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.780+0000 7fa0077fe640 1 -- 172.21.15.97:0/2957696040 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279470602 0 0) 0x7fa00806c470 con 0x7fa00815f9c0 2023-11-24T08:06:57.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.781+0000 7fa00ce7c640 1 --2- 172.21.15.97:0/2957696040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813df80 0x7fa00815bee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009870 tx=0x7f9ffc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d5889b1ca326bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:57.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.781+0000 7fa0077fe640 1 -- 172.21.15.97:0/2957696040 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc030840 con 0x7fa00813df80 2023-11-24T08:06:57.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.781+0000 7fa0077fe640 1 -- 172.21.15.97:0/2957696040 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc0309a0 con 0x7fa00813df80 2023-11-24T08:06:57.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.781+0000 7fa0077fe640 1 -- 172.21.15.97:0/2957696040 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc030d30 con 0x7fa00813df80 2023-11-24T08:06:57.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 -- 172.21.15.97:0/2957696040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813df80 msgr2=0x7fa00815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/2957696040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813df80 0x7fa00815bee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009870 tx=0x7f9ffc02b980 comp rx=0 tx=0).stop 2023-11-24T08:06:57.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 -- 172.21.15.97:0/2957696040 shutdown_connections 2023-11-24T08:06:57.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/2957696040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813e360 0x7fa0080cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/2957696040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813df80 0x7fa00815bee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 -- 172.21.15.97:0/2957696040 >> 172.21.15.97:0/2957696040 conn(0x7fa00806a800 msgr2=0x7fa00806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:57.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 -- 172.21.15.97:0/2957696040 shutdown_connections 2023-11-24T08:06:57.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.782+0000 7fa00f0e0640 1 -- 172.21.15.97:0/2957696040 wait complete. 2023-11-24T08:06:57.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.784+0000 7fa00f0e0640 1 Processor -- start 2023-11-24T08:06:57.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.784+0000 7fa00f0e0640 1 -- start start 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa00f0e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813df80 0x7fa0080ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa00f0e0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813e360 0x7fa0081536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa00f0e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa00815f9c0 0x7fa0080a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa00f0e0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081350d0 con 0x7fa00813e360 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa00f0e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080a90b0 con 0x7fa00815f9c0 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa00f0e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080adb60 con 0x7fa00813df80 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa007fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813e360 0x7fa0081536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa007fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813e360 0x7fa0081536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47868/0 (socket says 172.21.15.97:47868) 2023-11-24T08:06:57.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa007fff640 1 -- 172.21.15.97:0/3657423785 learned_addr learned my addr 172.21.15.97:0/3657423785 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.785+0000 7fa00ce7c640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813df80 0x7fa0080ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa00d67d640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa00815f9c0 0x7fa0080a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa007fff640 1 -- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813df80 msgr2=0x7fa0080ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa007fff640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813df80 0x7fa0080ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa007fff640 1 -- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa00815f9c0 msgr2=0x7fa0080a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa007fff640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa00815f9c0 0x7fa0080a8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa007fff640 1 -- 172.21.15.97:0/3657423785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc0094d0 con 0x7fa00813e360 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa00ce7c640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813df80 0x7fa0080ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:57.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa007fff640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813e360 0x7fa0081536c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c7f0 tx=0x7f9ff400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:57.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa0057fa640 1 -- 172.21.15.97:0/3657423785 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4004220 con 0x7fa00813e360 2023-11-24T08:06:57.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa0057fa640 1 -- 172.21.15.97:0/3657423785 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff40043a0 con 0x7fa00813e360 2023-11-24T08:06:57.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa0057fa640 1 -- 172.21.15.97:0/3657423785 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4007860 con 0x7fa00813e360 2023-11-24T08:06:57.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0080ade40 con 0x7fa00813e360 2023-11-24T08:06:57.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.786+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa008131460 con 0x7fa00813e360 2023-11-24T08:06:57.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.788+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0080ae360 con 0x7fa00813e360 2023-11-24T08:06:57.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.788+0000 7fa0057fa640 1 -- 172.21.15.97:0/3657423785 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ff4007bd0 con 0x7fa00813e360 2023-11-24T08:06:57.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.789+0000 7fa0057fa640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9fec06ae40 0x7f9fec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:57.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.789+0000 7fa0057fa640 1 -- 172.21.15.97:0/3657423785 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ff40895f0 con 0x7fa00813e360 2023-11-24T08:06:57.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.790+0000 7fa00ce7c640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9fec06ae40 0x7f9fec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:57.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.790+0000 7fa00ce7c640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9fec06ae40 0x7f9fec06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc036000 tx=0x7f9ffc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:57.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.793+0000 7fa0057fa640 1 -- 172.21.15.97:0/3657423785 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ff40546a0 con 0x7fa00813e360 2023-11-24T08:06:57.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.987+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa008131680 con 0x7fa00813e360 2023-11-24T08:06:57.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.989+0000 7fa0057fa640 1 -- 172.21.15.97:0/3657423785 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f9ff4057cc0 con 0x7fa00813e360 2023-11-24T08:06:57.991 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:57.991 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:06:57.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9fec06ae40 msgr2=0x7f9fec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9fec06ae40 0x7f9fec06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc036000 tx=0x7f9ffc03b040 comp rx=0 tx=0).stop 2023-11-24T08:06:57.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813e360 msgr2=0x7fa0081536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813e360 0x7fa0081536c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c7f0 tx=0x7f9ff400ccb0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 shutdown_connections 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9fec06ae40 0x7f9fec06d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa00815f9c0 0x7fa0080a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa00813e360 0x7fa0081536c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 --2- 172.21.15.97:0/3657423785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa00813df80 0x7fa0080ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.992+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 >> 172.21.15.97:0/3657423785 conn(0x7fa00806a800 msgr2=0x7fa0080b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.993+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 shutdown_connections 2023-11-24T08:06:57.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:57.993+0000 7fa00f0e0640 1 -- 172.21.15.97:0/3657423785 wait complete. 2023-11-24T08:06:58.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:06:58.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:06:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.237+0000 7f5f1a4ca640 1 Processor -- start 2023-11-24T08:06:58.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.238+0000 7f5f1a4ca640 1 -- start start 2023-11-24T08:06:58.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.239+0000 7f5f1a4ca640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f140cf9a0 0x7f5f140cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.239+0000 7f5f1a4ca640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f140d0320 con 0x7f5f1415d4b0 2023-11-24T08:06:58.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.239+0000 7f5f1a4ca640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f140d1c60 con 0x7f5f140b31d0 2023-11-24T08:06:58.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.239+0000 7f5f1a4ca640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140b2730 con 0x7f5f140cf9a0 2023-11-24T08:06:58.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.239+0000 7f5f194c8640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5f1415d4b0 0x7f5f140d1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51288/0 (socket says 172.21.15.97:51288) 2023-11-24T08:06:58.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f194c8640 1 -- 172.21.15.97:0/1493486169 learned_addr learned my addr 172.21.15.97:0/1493486169 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:58.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f18cc7640 1 --2- 172.21.15.97:0/1493486169 >> v2:172.21.15.183:3300/0 conn(0x7f5f140cf9a0 0x7f5f140cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588189859 0 0) 0x7f5f140d0320 con 0x7f5f1415d4b0 2023-11-24T08:06:58.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5efc003520 con 0x7f5f1415d4b0 2023-11-24T08:06:58.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883241576 0 0) 0x7f5efc003520 con 0x7f5f1415d4b0 2023-11-24T08:06:58.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 >> v2:172.21.15.183:3300/0 conn(0x7f5f140cf9a0 msgr2=0x7f5f140cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 --2- 172.21.15.97:0/1493486169 >> v2:172.21.15.183:3300/0 conn(0x7f5f140cf9a0 0x7f5f140cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 >> v1:172.21.15.183:6789/0 conn(0x7f5f140b31d0 legacy=0x7f5f140b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140d1ec0 con 0x7f5f1415d4b0 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f5f04001670 con 0x7f5f1415d4b0 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 >> v1:172.21.15.97:6789/0 conn(0x7f5f1415d4b0 legacy=0x7f5f140d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5efc003970 0x7f5efc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.240+0000 7f5f13fff640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5efc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f13fff640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5efc005180 0x7f5efc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140b2730 con 0x7f5efc0047c0 2023-11-24T08:06:58.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc00c020 con 0x7f5efc003970 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc00c1e0 con 0x7f5efc005180 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f18cc7640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5efc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f194c8640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5efc003970 0x7f5efc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f19cc9640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5efc005180 0x7f5efc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f18cc7640 1 -- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5efc005180 msgr2=0x7f5efc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f18cc7640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5efc005180 0x7f5efc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f18cc7640 1 -- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5efc003970 msgr2=0x7f5efc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f18cc7640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5efc003970 0x7f5efc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f19cc9640 1 -- 172.21.15.97:0/1493486169 reap_dead start 2023-11-24T08:06:58.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.241+0000 7f5f18cc7640 1 -- 172.21.15.97:0/1493486169 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc003520 con 0x7f5efc0047c0 2023-11-24T08:06:58.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.243+0000 7f5f18cc7640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5efc004c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009ac0 tx=0x7f5efc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2417f3273059e698 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.243+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0802c6b0 con 0x7f5efc0047c0 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.243+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0802c810 con 0x7f5efc0047c0 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.243+0000 7f5f13fff640 1 -- 172.21.15.97:0/1493486169 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0802cba0 con 0x7f5efc0047c0 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.244+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/1493486169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 msgr2=0x7f5efc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.244+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5efc004c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009ac0 tx=0x7f5efc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.244+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/1493486169 shutdown_connections 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.244+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/1493486169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5efc004c40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.244+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/1493486169 >> 172.21.15.97:0/1493486169 conn(0x7f5f140d3000 msgr2=0x7f5f140d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:58.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.244+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/1493486169 shutdown_connections 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.244+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/1493486169 wait complete. 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.246+0000 7f5f1a4ca640 1 Processor -- start 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.246+0000 7f5f1a4ca640 1 -- start start 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f1a4ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5f140ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f1a4ca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f140cb750 0x7f5f141f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f1a4ca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f1415fd50 0x7f5f141f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f1a4ca640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f141f3fc0 con 0x7f5efc0047c0 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f1a4ca640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140ca6d0 con 0x7f5f1415fd50 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f1a4ca640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140ca9b0 con 0x7f5f140cb750 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5f140ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5f140ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47884/0 (socket says 172.21.15.97:47884) 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 -- 172.21.15.97:0/3552485307 learned_addr learned my addr 172.21.15.97:0/3552485307 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f19cc9640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f1415fd50 0x7f5f141f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 -- 172.21.15.97:0/3552485307 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f140cb750 msgr2=0x7f5f141f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f140cb750 0x7f5f141f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 -- 172.21.15.97:0/3552485307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f1415fd50 msgr2=0x7f5f141f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f1415fd50 0x7f5f141f0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.247+0000 7f5f194c8640 1 -- 172.21.15.97:0/3552485307 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140cac90 con 0x7f5efc0047c0 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.248+0000 7f5f194c8640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5f140ca0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400e820 tx=0x7f5f0400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.248+0000 7f5f11ffb640 1 -- 172.21.15.97:0/3552485307 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400c870 con 0x7f5efc0047c0 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.248+0000 7f5f11ffb640 1 -- 172.21.15.97:0/3552485307 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400c9f0 con 0x7f5efc0047c0 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.248+0000 7f5f11ffb640 1 -- 172.21.15.97:0/3552485307 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400cda0 con 0x7f5efc0047c0 2023-11-24T08:06:58.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.248+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f140caf70 con 0x7f5efc0047c0 2023-11-24T08:06:58.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.248+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f141601e0 con 0x7f5efc0047c0 2023-11-24T08:06:58.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.249+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f14160400 con 0x7f5efc0047c0 2023-11-24T08:06:58.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.250+0000 7f5f11ffb640 1 -- 172.21.15.97:0/3552485307 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f0401d460 con 0x7f5efc0047c0 2023-11-24T08:06:58.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.251+0000 7f5f11ffb640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f0006ae40 0x7f5f0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.251+0000 7f5f11ffb640 1 -- 172.21.15.97:0/3552485307 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f04089640 con 0x7f5efc0047c0 2023-11-24T08:06:58.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.251+0000 7f5f18cc7640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f0006ae40 0x7f5f0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.252+0000 7f5f18cc7640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f0006ae40 0x7f5f0006d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f08036000 tx=0x7f5f0802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.255+0000 7f5f11ffb640 1 -- 172.21.15.97:0/3552485307 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f040546e0 con 0x7f5efc0047c0 2023-11-24T08:06:58.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.446+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f14067450 con 0x7f5efc0047c0 2023-11-24T08:06:58.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.447+0000 7f5f11ffb640 1 -- 172.21.15.97:0/3552485307 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f04057d00 con 0x7f5efc0047c0 2023-11-24T08:06:58.449 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:06:58.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.449+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f0006ae40 msgr2=0x7f5f0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.449+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f0006ae40 0x7f5f0006d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f08036000 tx=0x7f5f0802e000 comp rx=0 tx=0).stop 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.449+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 msgr2=0x7f5f140ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.449+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5f140ca0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400e820 tx=0x7f5f0400ece0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 shutdown_connections 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f0006ae40 0x7f5f0006d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f1415fd50 0x7f5f141f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f140cb750 0x7f5f141f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 --2- 172.21.15.97:0/3552485307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5efc0047c0 0x7f5f140ca0d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 >> 172.21.15.97:0/3552485307 conn(0x7f5f140d3000 msgr2=0x7f5f1406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 shutdown_connections 2023-11-24T08:06:58.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.450+0000 7f5f1a4ca640 1 -- 172.21.15.97:0/3552485307 wait complete. 2023-11-24T08:06:58.469 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:06:58.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.683+0000 7f5f4a294640 1 Processor -- start 2023-11-24T08:06:58.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.683+0000 7f5f4a294640 1 -- start start 2023-11-24T08:06:58.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f4a294640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 0x7f5f440cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f4a294640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f440cf7d0 0x7f5f4415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f4a294640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f440cfc30 con 0x7f5f4415e1e0 2023-11-24T08:06:58.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f4a294640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440b1ee0 con 0x7f5f440cf7d0 2023-11-24T08:06:58.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f4a294640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b2780 con 0x7f5f44143ae0 2023-11-24T08:06:58.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f48831640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5f4415e1e0 0x7f5f4415a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51290/0 (socket says 172.21.15.97:51290) 2023-11-24T08:06:58.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f48831640 1 -- 172.21.15.97:0/2684455720 learned_addr learned my addr 172.21.15.97:0/2684455720 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:58.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f43fff640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 0x7f5f440cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f3bfff640 1 --2- 172.21.15.97:0/2684455720 >> v2:172.21.15.183:3300/0 conn(0x7f5f440cf7d0 0x7f5f4415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.685+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683325773 0 0) 0x7f5f440cfc30 con 0x7f5f4415e1e0 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f30003520 con 0x7f5f4415e1e0 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770202688 0 0) 0x7f5f30003520 con 0x7f5f4415e1e0 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 msgr2=0x7f5f440cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 0x7f5f440cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 >> v2:172.21.15.183:3300/0 conn(0x7f5f440cf7d0 msgr2=0x7f5f4415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 --2- 172.21.15.97:0/2684455720 >> v2:172.21.15.183:3300/0 conn(0x7f5f440cf7d0 0x7f5f4415dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4415e990 con 0x7f5f4415e1e0 2023-11-24T08:06:58.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f5f3c0019f0 con 0x7f5f4415e1e0 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 >> v1:172.21.15.97:6789/0 conn(0x7f5f4415e1e0 legacy=0x7f5f4415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 0x7f5f30003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30003ef0 0x7f5f300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f30004d00 0x7f5f30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b1ee0 con 0x7f5f30004d00 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b2780 con 0x7f5f30003ef0 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3000b9d0 con 0x7f5f44143ae0 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.686+0000 7f5f48831640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f30004d00 0x7f5f30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.687+0000 7f5f43fff640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 0x7f5f30003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.687+0000 7f5f3bfff640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30003ef0 0x7f5f300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.687+0000 7f5f48831640 1 -- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 msgr2=0x7f5f30003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:58.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.687+0000 7f5f48831640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f44143ae0 0x7f5f30003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.687+0000 7f5f48831640 1 -- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30003ef0 msgr2=0x7f5f300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:58.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.687+0000 7f5f48831640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30003ef0 0x7f5f300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.687+0000 7f5f48831640 1 -- 172.21.15.97:0/2684455720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30003520 con 0x7f5f30004d00 2023-11-24T08:06:58.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.688+0000 7f5f48831640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f30004d00 0x7f5f30005180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a830 tx=0x7f5f300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae97e28030fbc7a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.688+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c034630 con 0x7f5f30004d00 2023-11-24T08:06:58.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.688+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c02f070 con 0x7f5f30004d00 2023-11-24T08:06:58.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.688+0000 7f5f437fe640 1 -- 172.21.15.97:0/2684455720 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c034a30 con 0x7f5f30004d00 2023-11-24T08:06:58.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.689+0000 7f5f4a294640 1 -- 172.21.15.97:0/2684455720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f30004d00 msgr2=0x7f5f30005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.689+0000 7f5f4a294640 1 --2- 172.21.15.97:0/2684455720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f30004d00 0x7f5f30005180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a830 tx=0x7f5f300057f0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.689+0000 7f5f48831640 1 -- 172.21.15.97:0/2684455720 reap_dead start 2023-11-24T08:06:58.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.689+0000 7f5f4a294640 1 -- 172.21.15.97:0/2684455720 shutdown_connections 2023-11-24T08:06:58.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.689+0000 7f5f4a294640 1 -- 172.21.15.97:0/2684455720 >> 172.21.15.97:0/2684455720 conn(0x7f5f4406a800 msgr2=0x7f5f4406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:58.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.689+0000 7f5f4a294640 1 -- 172.21.15.97:0/2684455720 shutdown_connections 2023-11-24T08:06:58.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.689+0000 7f5f4a294640 1 -- 172.21.15.97:0/2684455720 wait complete. 2023-11-24T08:06:58.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.692+0000 7f5f4a294640 1 Processor -- start 2023-11-24T08:06:58.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.692+0000 7f5f4a294640 1 -- start start 2023-11-24T08:06:58.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.693+0000 7f5f4a294640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30004d00 0x7f5f44149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.693+0000 7f5f4a294640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f440afae0 0x7f5f4415c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.693+0000 7f5f4a294640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4415ca80 0x7f5f4415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.693+0000 7f5f4a294640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4415cf40 con 0x7f5f4415ca80 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.693+0000 7f5f4a294640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4415d220 con 0x7f5f30004d00 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.693+0000 7f5f4a294640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441391e0 con 0x7f5f440afae0 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.693+0000 7f5f48831640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4415ca80 0x7f5f4415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4415ca80 0x7f5f4415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47906/0 (socket says 172.21.15.97:47906) 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 -- 172.21.15.97:0/2066059530 learned_addr learned my addr 172.21.15.97:0/2066059530 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f43fff640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30004d00 0x7f5f44149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f3bfff640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f440afae0 0x7f5f4415c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 -- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f440afae0 msgr2=0x7f5f4415c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f440afae0 0x7f5f4415c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 -- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30004d00 msgr2=0x7f5f44149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30004d00 0x7f5f44149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 -- 172.21.15.97:0/2066059530 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f441394c0 con 0x7f5f4415ca80 2023-11-24T08:06:58.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f48831640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4415ca80 0x7f5f4415a4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a830 tx=0x7f5f440b26f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.694+0000 7f5f417fa640 1 -- 172.21.15.97:0/2066059530 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c034840 con 0x7f5f4415ca80 2023-11-24T08:06:58.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.695+0000 7f5f417fa640 1 -- 172.21.15.97:0/2066059530 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0349a0 con 0x7f5f4415ca80 2023-11-24T08:06:58.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.695+0000 7f5f417fa640 1 -- 172.21.15.97:0/2066059530 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c034d10 con 0x7f5f4415ca80 2023-11-24T08:06:58.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.695+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f441397a0 con 0x7f5f4415ca80 2023-11-24T08:06:58.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.695+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4415aa20 con 0x7f5f4415ca80 2023-11-24T08:06:58.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.696+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f44139990 con 0x7f5f4415ca80 2023-11-24T08:06:58.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.697+0000 7f5f417fa640 1 -- 172.21.15.97:0/2066059530 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f3c031030 con 0x7f5f4415ca80 2023-11-24T08:06:58.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.698+0000 7f5f417fa640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f2406ae40 0x7f5f2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.698+0000 7f5f417fa640 1 -- 172.21.15.97:0/2066059530 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f3c0aabc0 con 0x7f5f4415ca80 2023-11-24T08:06:58.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.698+0000 7f5f43fff640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f2406ae40 0x7f5f2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.699+0000 7f5f43fff640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f2406ae40 0x7f5f2406d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f34006fd0 tx=0x7f5f34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.702+0000 7f5f417fa640 1 -- 172.21.15.97:0/2066059530 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f3c075c60 con 0x7f5f4415ca80 2023-11-24T08:06:58.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.892+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f440675d0 con 0x7f5f4415ca80 2023-11-24T08:06:58.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.893+0000 7f5f417fa640 1 -- 172.21.15.97:0/2066059530 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f3c0450a0 con 0x7f5f4415ca80 2023-11-24T08:06:58.895 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f2406ae40 msgr2=0x7f5f2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f2406ae40 0x7f5f2406d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f34006fd0 tx=0x7f5f34008040 comp rx=0 tx=0).stop 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4415ca80 msgr2=0x7f5f4415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4415ca80 0x7f5f4415a4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a830 tx=0x7f5f440b26f0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 shutdown_connections 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f2406ae40 0x7f5f2406d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4415ca80 0x7f5f4415a4e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f440afae0 0x7f5f4415c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 --2- 172.21.15.97:0/2066059530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f30004d00 0x7f5f44149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 >> 172.21.15.97:0/2066059530 conn(0x7f5f4406a800 msgr2=0x7f5f440b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:58.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 shutdown_connections 2023-11-24T08:06:58.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:58.896+0000 7f5f4a294640 1 -- 172.21.15.97:0/2066059530 wait complete. 2023-11-24T08:06:58.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:06:59.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.131+0000 7fc26c6cf640 1 Processor -- start 2023-11-24T08:06:59.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.132+0000 7fc26c6cf640 1 -- start start 2023-11-24T08:06:59.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.133+0000 7fc26c6cf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 0x7fc264072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.133+0000 7fc26c6cf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc264071190 con 0x7fc26415d300 2023-11-24T08:06:59.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.133+0000 7fc26c6cf640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc264071470 con 0x7fc2640b32e0 2023-11-24T08:06:59.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.133+0000 7fc26c6cf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b3770 con 0x7fc264150760 2023-11-24T08:06:59.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.133+0000 7fc269c6a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc26415d300 0x7fc2640b2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51294/0 (socket says 172.21.15.97:51294) 2023-11-24T08:06:59.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.133+0000 7fc269c6a640 1 -- 172.21.15.97:0/599899242 learned_addr learned my addr 172.21.15.97:0/599899242 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc26a46b640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 0x7fc264072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215712443 0 0) 0x7fc264071190 con 0x7fc26415d300 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc250005730 con 0x7fc26415d300 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1629296518 0 0) 0x7fc250005730 con 0x7fc26415d300 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 msgr2=0x7fc264072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 0x7fc264072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 >> v1:172.21.15.183:6789/0 conn(0x7fc2640b32e0 legacy=0x7fc2640ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264071750 con 0x7fc26415d300 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fc254001670 con 0x7fc26415d300 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 >> v1:172.21.15.97:6789/0 conn(0x7fc26415d300 legacy=0x7fc2640b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc250005bb0 0x7fc250005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2500069d0 0x7fc250006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 0x7fc250007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b3770 con 0x7fc250005bb0 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25000dc40 con 0x7fc2500069d0 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.134+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25000de00 con 0x7fc264150760 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26a46b640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc250005bb0 0x7fc250005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc269c6a640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2500069d0 0x7fc250006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26ac6c640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 0x7fc250007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26a46b640 1 -- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 msgr2=0x7fc250007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:59.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26a46b640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 0x7fc250007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26a46b640 1 -- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2500069d0 msgr2=0x7fc250006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:59.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26a46b640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2500069d0 0x7fc250006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26a46b640 1 -- 172.21.15.97:0/599899242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250005730 con 0x7fc250005bb0 2023-11-24T08:06:59.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.135+0000 7fc26ac6c640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc264150760 0x7fc250007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:59.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.136+0000 7fc26a46b640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc250005bb0 0x7fc250005fd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc260009a90 tx=0x7fc250007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55820bb643bddd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:59.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.136+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26002c680 con 0x7fc250005bb0 2023-11-24T08:06:59.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.136+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26002c7e0 con 0x7fc250005bb0 2023-11-24T08:06:59.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.136+0000 7fc269469640 1 -- 172.21.15.97:0/599899242 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26002cb70 con 0x7fc250005bb0 2023-11-24T08:06:59.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.137+0000 7fc26c6cf640 1 -- 172.21.15.97:0/599899242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc250005bb0 msgr2=0x7fc250005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.137+0000 7fc26c6cf640 1 --2- 172.21.15.97:0/599899242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc250005bb0 0x7fc250005fd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc260009a90 tx=0x7fc250007a00 comp rx=0 tx=0).stop 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.137+0000 7fc26ac6c640 1 -- 172.21.15.97:0/599899242 reap_dead start 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.137+0000 7fc26c6cf640 1 -- 172.21.15.97:0/599899242 shutdown_connections 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.137+0000 7fc26c6cf640 1 -- 172.21.15.97:0/599899242 >> 172.21.15.97:0/599899242 conn(0x7fc26406a800 msgr2=0x7fc26406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.137+0000 7fc26c6cf640 1 -- 172.21.15.97:0/599899242 shutdown_connections 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.137+0000 7fc26c6cf640 1 -- 172.21.15.97:0/599899242 wait complete. 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.139+0000 7fc26c6cf640 1 Processor -- start 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.139+0000 7fc26c6cf640 1 -- start start 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26c6cf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc250005bb0 0x7fc2640cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26c6cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26413d2a0 0x7fc26413d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26c6cf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2640b0a80 0x7fc2640b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26c6cf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b1ad0 con 0x7fc26413d2a0 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26c6cf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640cc870 con 0x7fc2640b0a80 2023-11-24T08:06:59.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26c6cf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640cecd0 con 0x7fc250005bb0 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26413d2a0 0x7fc26413d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26413d2a0 0x7fc26413d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47934/0 (socket says 172.21.15.97:47934) 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 -- 172.21.15.97:0/1761924183 learned_addr learned my addr 172.21.15.97:0/1761924183 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26a46b640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc250005bb0 0x7fc2640cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc26ac6c640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2640b0a80 0x7fc2640b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 -- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc250005bb0 msgr2=0x7fc2640cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc250005bb0 0x7fc2640cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 -- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2640b0a80 msgr2=0x7fc2640b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2640b0a80 0x7fc2640b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.140+0000 7fc269c6a640 1 -- 172.21.15.97:0/1761924183 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26413dc40 con 0x7fc26413d2a0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.141+0000 7fc269c6a640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26413d2a0 0x7fc26413d700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc25400e7a0 tx=0x7fc25400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.141+0000 7fc25affd640 1 -- 172.21.15.97:0/1761924183 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400c870 con 0x7fc26413d2a0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.141+0000 7fc25affd640 1 -- 172.21.15.97:0/1761924183 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25400c9f0 con 0x7fc26413d2a0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.141+0000 7fc25affd640 1 -- 172.21.15.97:0/1761924183 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400cda0 con 0x7fc26413d2a0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.141+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2640aecd0 con 0x7fc26413d2a0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.141+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2640af290 con 0x7fc26413d2a0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.142+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2640675d0 con 0x7fc26413d2a0 2023-11-24T08:06:59.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.143+0000 7fc25affd640 1 -- 172.21.15.97:0/1761924183 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc25401d460 con 0x7fc26413d2a0 2023-11-24T08:06:59.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.144+0000 7fc25affd640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc24806ae40 0x7fc24806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.144+0000 7fc25affd640 1 -- 172.21.15.97:0/1761924183 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc254089610 con 0x7fc26413d2a0 2023-11-24T08:06:59.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.144+0000 7fc26a46b640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc24806ae40 0x7fc24806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.145+0000 7fc26a46b640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc24806ae40 0x7fc24806d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc260036000 tx=0x7fc260030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:59.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.148+0000 7fc25affd640 1 -- 172.21.15.97:0/1761924183 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc254054620 con 0x7fc26413d2a0 2023-11-24T08:06:59.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.338+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2640cf510 con 0x7fc26413d2a0 2023-11-24T08:06:59.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.339+0000 7fc25affd640 1 -- 172.21.15.97:0/1761924183 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc25405e030 con 0x7fc26413d2a0 2023-11-24T08:06:59.341 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:06:59.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc24806ae40 msgr2=0x7fc24806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc24806ae40 0x7fc24806d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc260036000 tx=0x7fc260030000 comp rx=0 tx=0).stop 2023-11-24T08:06:59.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26413d2a0 msgr2=0x7fc26413d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26413d2a0 0x7fc26413d700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc25400e7a0 tx=0x7fc25400ec60 comp rx=0 tx=0).stop 2023-11-24T08:06:59.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 shutdown_connections 2023-11-24T08:06:59.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc24806ae40 0x7fc24806d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2640b0a80 0x7fc2640b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc26413d2a0 0x7fc26413d700 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 --2- 172.21.15.97:0/1761924183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc250005bb0 0x7fc2640cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 >> 172.21.15.97:0/1761924183 conn(0x7fc26406a800 msgr2=0x7fc2640ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:59.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 shutdown_connections 2023-11-24T08:06:59.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.342+0000 7fc26c6cf640 1 -- 172.21.15.97:0/1761924183 wait complete. 2023-11-24T08:06:59.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.578+0000 7f6b18048640 1 Processor -- start 2023-11-24T08:06:59.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.578+0000 7f6b18048640 1 -- start start 2023-11-24T08:06:59.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b18048640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b1013e360 0x7f6b100cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b18048640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1015c5f0 con 0x7f6b1015f9c0 2023-11-24T08:06:59.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b18048640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1006c470 con 0x7f6b1013df80 2023-11-24T08:06:59.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b18048640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1006c750 con 0x7f6b1013e360 2023-11-24T08:06:59.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b155e3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b1013e360 0x7f6b100cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b155e3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6b1013e360 0x7f6b100cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47948/0 (socket says 172.21.15.97:47948) 2023-11-24T08:06:59.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b165e5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6b1015f9c0 0x7f6b100cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51302/0 (socket says 172.21.15.97:51302) 2023-11-24T08:06:59.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b155e3640 1 -- 172.21.15.97:0/548893307 learned_addr learned my addr 172.21.15.97:0/548893307 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:59.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b155e3640 1 -- 172.21.15.97:0/548893307 >> v1:172.21.15.183:6789/0 conn(0x7f6b1013df80 legacy=0x7f6b1015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:59.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b155e3640 1 -- 172.21.15.97:0/548893307 >> v1:172.21.15.97:6789/0 conn(0x7f6b1015f9c0 legacy=0x7f6b100cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.580+0000 7f6b155e3640 1 -- 172.21.15.97:0/548893307 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1006ca30 con 0x7f6b1013e360 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.581+0000 7f6b155e3640 1 --2- 172.21.15.97:0/548893307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b100cf290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009870 tx=0x7f6b0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbaabda49e94a6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b14de2640 1 -- 172.21.15.97:0/548893307 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00030860 con 0x7f6b1013e360 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b14de2640 1 -- 172.21.15.97:0/548893307 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000309c0 con 0x7f6b1013e360 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b14de2640 1 -- 172.21.15.97:0/548893307 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00030d50 con 0x7f6b1013e360 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b18048640 1 -- 172.21.15.97:0/548893307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 msgr2=0x7f6b100cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b18048640 1 --2- 172.21.15.97:0/548893307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b100cf290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009870 tx=0x7f6b0002b9a0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b18048640 1 -- 172.21.15.97:0/548893307 shutdown_connections 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b18048640 1 --2- 172.21.15.97:0/548893307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b100cf290 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b18048640 1 -- 172.21.15.97:0/548893307 >> 172.21.15.97:0/548893307 conn(0x7f6b1006a800 msgr2=0x7f6b1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:59.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.582+0000 7f6b18048640 1 -- 172.21.15.97:0/548893307 shutdown_connections 2023-11-24T08:06:59.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.583+0000 7f6b18048640 1 -- 172.21.15.97:0/548893307 wait complete. 2023-11-24T08:06:59.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.584+0000 7f6b18048640 1 Processor -- start 2023-11-24T08:06:59.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.584+0000 7f6b18048640 1 -- start start 2023-11-24T08:06:59.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.585+0000 7f6b18048640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b1013df80 0x7f6b1014b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.585+0000 7f6b18048640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b1015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.585+0000 7f6b18048640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b1015f9c0 0x7f6b100af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.585+0000 7f6b18048640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1014b540 con 0x7f6b1013e360 2023-11-24T08:06:59.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.585+0000 7f6b18048640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100aff20 con 0x7f6b1013df80 2023-11-24T08:06:59.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.585+0000 7f6b18048640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1014aba0 con 0x7f6b1015f9c0 2023-11-24T08:06:59.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.585+0000 7f6b155e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b1015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b1015ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47964/0 (socket says 172.21.15.97:47964) 2023-11-24T08:06:59.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 -- 172.21.15.97:0/1090831029 learned_addr learned my addr 172.21.15.97:0/1090831029 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:06:59.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b165e5640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b1015f9c0 0x7f6b100af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b15de4640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b1013df80 0x7f6b1014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 -- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b1015f9c0 msgr2=0x7f6b100af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b1015f9c0 0x7f6b100af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 -- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b1013df80 msgr2=0x7f6b1014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b1013df80 0x7f6b1014b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 -- 172.21.15.97:0/1090831029 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b000094d0 con 0x7f6b1013e360 2023-11-24T08:06:59.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b165e5640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b1015f9c0 0x7f6b100af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:59.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.586+0000 7f6b155e3640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b1015ad50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009870 tx=0x7f6b00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:59.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.587+0000 7f6b067fc640 1 -- 172.21.15.97:0/1090831029 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00030810 con 0x7f6b1013e360 2023-11-24T08:06:59.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.587+0000 7f6b067fc640 1 -- 172.21.15.97:0/1090831029 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b00043400 con 0x7f6b1013e360 2023-11-24T08:06:59.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.587+0000 7f6b067fc640 1 -- 172.21.15.97:0/1090831029 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b000437b0 con 0x7f6b1013e360 2023-11-24T08:06:59.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.587+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1014ae80 con 0x7f6b1013e360 2023-11-24T08:06:59.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.587+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b100b01a0 con 0x7f6b1013e360 2023-11-24T08:06:59.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.588+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b100675d0 con 0x7f6b1013e360 2023-11-24T08:06:59.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.589+0000 7f6b067fc640 1 -- 172.21.15.97:0/1090831029 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b00043910 con 0x7f6b1013e360 2023-11-24T08:06:59.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.590+0000 7f6b067fc640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6af406ae40 0x7f6af406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:59.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.590+0000 7f6b067fc640 1 -- 172.21.15.97:0/1090831029 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b0003e070 con 0x7f6b1013e360 2023-11-24T08:06:59.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.590+0000 7f6b15de4640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6af406ae40 0x7f6af406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:59.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.590+0000 7f6b15de4640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6af406ae40 0x7f6af406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c006fd0 tx=0x7f6b0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:59.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.594+0000 7f6b067fc640 1 -- 172.21.15.97:0/1090831029 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b00077b20 con 0x7f6b1013e360 2023-11-24T08:06:59.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.820+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b1006df00 con 0x7f6b1013e360 2023-11-24T08:06:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.821+0000 7f6b067fc640 1 -- 172.21.15.97:0/1090831029 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f6b0007b140 con 0x7f6b1013e360 2023-11-24T08:06:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:06:59.823 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:06:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6af406ae40 msgr2=0x7f6af406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6af406ae40 0x7f6af406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c006fd0 tx=0x7f6b0c008040 comp rx=0 tx=0).stop 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 msgr2=0x7f6b1015ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b1015ad50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009870 tx=0x7f6b00004730 comp rx=0 tx=0).stop 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 shutdown_connections 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6af406ae40 0x7f6af406d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b1015f9c0 0x7f6b100af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b1013e360 0x7f6b1015ad50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 --2- 172.21.15.97:0/1090831029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b1013df80 0x7f6b1014b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 >> 172.21.15.97:0/1090831029 conn(0x7f6b1006a800 msgr2=0x7f6b1015d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:59.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 shutdown_connections 2023-11-24T08:06:59.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:06:59.824+0000 7f6b18048640 1 -- 172.21.15.97:0/1090831029 wait complete. 2023-11-24T08:06:59.845 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:00.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.057+0000 7f878c844640 1 Processor -- start 2023-11-24T08:07:00.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.057+0000 7f878c844640 1 -- start start 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.058+0000 7f878c844640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8788143ae0 0x7f87880cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f878c844640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87880cf7d0 0x7f878815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f878c844640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880cfc30 con 0x7f878815e1e0 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f878c844640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87880b1ee0 con 0x7f87880cf7d0 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f878c844640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87880b2780 con 0x7f8788143ae0 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f877ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87880cf7d0 0x7f878815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f8786d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f878815e1e0 0x7f878815a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51316/0 (socket says 172.21.15.97:51316) 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f877ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87880cf7d0 0x7f878815dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47978/0 (socket says 172.21.15.97:47978) 2023-11-24T08:07:00.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f8786d9d640 1 -- 172.21.15.97:0/642153884 learned_addr learned my addr 172.21.15.97:0/642153884 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:00.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f878659c640 1 --2- 172.21.15.97:0/642153884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8788143ae0 0x7f87880cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f877ffff640 1 -- 172.21.15.97:0/642153884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8788143ae0 msgr2=0x7f87880cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:00.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f877ffff640 1 --2- 172.21.15.97:0/642153884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8788143ae0 0x7f87880cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f877ffff640 1 -- 172.21.15.97:0/642153884 >> v1:172.21.15.97:6789/0 conn(0x7f878815e1e0 legacy=0x7f878815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.059+0000 7f877ffff640 1 -- 172.21.15.97:0/642153884 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878815e990 con 0x7f87880cf7d0 2023-11-24T08:07:00.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.060+0000 7f877ffff640 1 --2- 172.21.15.97:0/642153884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87880cf7d0 0x7f878815dca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f877002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49637cd71fcffeb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.061+0000 7f8785d9b640 1 -- 172.21.15.97:0/642153884 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877002d040 con 0x7f87880cf7d0 2023-11-24T08:07:00.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.061+0000 7f8785d9b640 1 -- 172.21.15.97:0/642153884 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770031810 con 0x7f87880cf7d0 2023-11-24T08:07:00.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.061+0000 7f8785d9b640 1 -- 172.21.15.97:0/642153884 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770031ba0 con 0x7f87880cf7d0 2023-11-24T08:07:00.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.061+0000 7f878c844640 1 -- 172.21.15.97:0/642153884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87880cf7d0 msgr2=0x7f878815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.061+0000 7f878c844640 1 --2- 172.21.15.97:0/642153884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87880cf7d0 0x7f878815dca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87700097a0 tx=0x7f877002b8b0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.061+0000 7f878c844640 1 -- 172.21.15.97:0/642153884 shutdown_connections 2023-11-24T08:07:00.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.062+0000 7f878c844640 1 --2- 172.21.15.97:0/642153884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87880cf7d0 0x7f878815dca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.062+0000 7f878c844640 1 --2- 172.21.15.97:0/642153884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8788143ae0 0x7f87880cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.062+0000 7f878c844640 1 -- 172.21.15.97:0/642153884 >> 172.21.15.97:0/642153884 conn(0x7f878806a800 msgr2=0x7f878806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:00.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.062+0000 7f878c844640 1 -- 172.21.15.97:0/642153884 shutdown_connections 2023-11-24T08:07:00.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.062+0000 7f878c844640 1 -- 172.21.15.97:0/642153884 wait complete. 2023-11-24T08:07:00.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.063+0000 7f878c844640 1 Processor -- start 2023-11-24T08:07:00.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.063+0000 7f878c844640 1 -- start start 2023-11-24T08:07:00.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.064+0000 7f878c844640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87880cf7d0 0x7f8788159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.064+0000 7f878c844640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8788143ae0 0x7f878813b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.064+0000 7f878c844640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878815e1e0 0x7f87880afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.064+0000 7f878c844640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8788159fd0 con 0x7f878815e1e0 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.064+0000 7f878c844640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878813cee0 con 0x7f8788143ae0 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.064+0000 7f878c844640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878813c290 con 0x7f87880cf7d0 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878815e1e0 0x7f87880afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878815e1e0 0x7f87880afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47990/0 (socket says 172.21.15.97:47990) 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 -- 172.21.15.97:0/1804181509 learned_addr learned my addr 172.21.15.97:0/1804181509 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f878659c640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87880cf7d0 0x7f8788159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 -- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87880cf7d0 msgr2=0x7f8788159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87880cf7d0 0x7f8788159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f877ffff640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8788143ae0 0x7f878813b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 -- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8788143ae0 msgr2=0x7f878813b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8788143ae0 0x7f878813b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 -- 172.21.15.97:0/1804181509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770009400 con 0x7f878815e1e0 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f8786d9d640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878815e1e0 0x7f87880afeb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f878000ca80 tx=0x7f878000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f877effd640 1 -- 172.21.15.97:0/1804181509 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000ac30 con 0x7f878815e1e0 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f877effd640 1 -- 172.21.15.97:0/1804181509 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878000ad90 con 0x7f878815e1e0 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f877effd640 1 -- 172.21.15.97:0/1804181509 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780012600 con 0x7f878815e1e0 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.065+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878813c570 con 0x7f878815e1e0 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.066+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878813cb30 con 0x7f878815e1e0 2023-11-24T08:07:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.067+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878813d050 con 0x7f878815e1e0 2023-11-24T08:07:00.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.068+0000 7f877effd640 1 -- 172.21.15.97:0/1804181509 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8780007070 con 0x7f878815e1e0 2023-11-24T08:07:00.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.069+0000 7f877effd640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f876806ae40 0x7f876806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.069+0000 7f877effd640 1 -- 172.21.15.97:0/1804181509 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8780089480 con 0x7f878815e1e0 2023-11-24T08:07:00.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.069+0000 7f878659c640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f876806ae40 0x7f876806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.069+0000 7f878659c640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f876806ae40 0x7f876806d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8778006fd0 tx=0x7f8778008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.073+0000 7f877effd640 1 -- 172.21.15.97:0/1804181509 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f878813d050 con 0x7f878815e1e0 2023-11-24T08:07:00.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.268+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f878813d050 con 0x7f878815e1e0 2023-11-24T08:07:00.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.270+0000 7f877effd640 1 -- 172.21.15.97:0/1804181509 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f878813d050 con 0x7f878815e1e0 2023-11-24T08:07:00.272 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:00.272 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.273+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f876806ae40 msgr2=0x7f876806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.273+0000 7f878c844640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f876806ae40 0x7f876806d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8778006fd0 tx=0x7f8778008040 comp rx=0 tx=0).stop 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.273+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878815e1e0 msgr2=0x7f87880afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.273+0000 7f878c844640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878815e1e0 0x7f87880afeb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f878000ca80 tx=0x7f878000cf40 comp rx=0 tx=0).stop 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 shutdown_connections 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f876806ae40 0x7f876806d300 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8778006fd0 tx=0x7f8778008040 comp rx=0 tx=0).stop 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878815e1e0 0x7f87880afeb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8788143ae0 0x7f878813b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 --2- 172.21.15.97:0/1804181509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87880cf7d0 0x7f8788159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 >> 172.21.15.97:0/1804181509 conn(0x7f878806a800 msgr2=0x7f878815b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:00.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 shutdown_connections 2023-11-24T08:07:00.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.274+0000 7f878c844640 1 -- 172.21.15.97:0/1804181509 wait complete. 2023-11-24T08:07:00.296 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:00.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.508+0000 7f4b71e59640 1 Processor -- start 2023-11-24T08:07:00.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.508+0000 7f4b71e59640 1 -- start start 2023-11-24T08:07:00.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.509+0000 7f4b71e59640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b6c143c40 0x7f4b6c071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.509+0000 7f4b71e59640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c070e50 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.509+0000 7f4b71e59640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c144020 con 0x7f4b6c0717d0 2023-11-24T08:07:00.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.509+0000 7f4b71e59640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0723c0 con 0x7f4b6c143c40 2023-11-24T08:07:00.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.510+0000 7f4b70e57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b6c143c40 0x7f4b6c071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.510+0000 7f4b70e57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b6c143c40 0x7f4b6c071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47992/0 (socket says 172.21.15.97:47992) 2023-11-24T08:07:00.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.510+0000 7f4b70e57640 1 -- 172.21.15.97:0/2206566234 learned_addr learned my addr 172.21.15.97:0/2206566234 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:00.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.510+0000 7f4b70e57640 1 -- 172.21.15.97:0/2206566234 >> v1:172.21.15.183:6789/0 conn(0x7f4b6c0717d0 legacy=0x7f4b6c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:00.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.510+0000 7f4b70e57640 1 -- 172.21.15.97:0/2206566234 >> v1:172.21.15.97:6789/0 conn(0x7f4b6c0ccc10 legacy=0x7f4b6c06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.510+0000 7f4b70e57640 1 -- 172.21.15.97:0/2206566234 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c071e00 con 0x7f4b6c143c40 2023-11-24T08:07:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.511+0000 7f4b70e57640 1 --2- 172.21.15.97:0/2206566234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c143c40 0x7f4b6c071290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009870 tx=0x7f4b5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a31af781f28d5dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.511+0000 7f4b6b7fe640 1 -- 172.21.15.97:0/2206566234 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c031870 con 0x7f4b6c143c40 2023-11-24T08:07:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b6b7fe640 1 -- 172.21.15.97:0/2206566234 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c0319d0 con 0x7f4b6c143c40 2023-11-24T08:07:00.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b6b7fe640 1 -- 172.21.15.97:0/2206566234 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c031d60 con 0x7f4b6c143c40 2023-11-24T08:07:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b71e59640 1 -- 172.21.15.97:0/2206566234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c143c40 msgr2=0x7f4b6c071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b71e59640 1 --2- 172.21.15.97:0/2206566234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c143c40 0x7f4b6c071290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009870 tx=0x7f4b5c02b910 comp rx=0 tx=0).stop 2023-11-24T08:07:00.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b71e59640 1 -- 172.21.15.97:0/2206566234 shutdown_connections 2023-11-24T08:07:00.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b71e59640 1 --2- 172.21.15.97:0/2206566234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c143c40 0x7f4b6c071290 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b71e59640 1 -- 172.21.15.97:0/2206566234 >> 172.21.15.97:0/2206566234 conn(0x7f4b6c06a800 msgr2=0x7f4b6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:00.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b71e59640 1 -- 172.21.15.97:0/2206566234 shutdown_connections 2023-11-24T08:07:00.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.512+0000 7f4b71e59640 1 -- 172.21.15.97:0/2206566234 wait complete. 2023-11-24T08:07:00.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.514+0000 7f4b71e59640 1 Processor -- start 2023-11-24T08:07:00.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.514+0000 7f4b71e59640 1 -- start start 2023-11-24T08:07:00.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b71e59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b6c0717d0 0x7f4b6c1f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b71e59640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c0ccc10 0x7f4b6c0c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b71e59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b6c143c40 0x7f4b6c0c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b71e59640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0aad00 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b71e59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0aafe0 con 0x7f4b6c143c40 2023-11-24T08:07:00.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b71e59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c12d2b0 con 0x7f4b6c0717d0 2023-11-24T08:07:00.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c0ccc10 0x7f4b6c0c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c0ccc10 0x7f4b6c0c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47994/0 (socket says 172.21.15.97:47994) 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.515+0000 7f4b6bfff640 1 -- 172.21.15.97:0/3452673896 learned_addr learned my addr 172.21.15.97:0/3452673896 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b70e57640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b6c0717d0 0x7f4b6c1f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b71658640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b6c143c40 0x7f4b6c0c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b6bfff640 1 -- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b6c0717d0 msgr2=0x7f4b6c1f00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b6bfff640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b6c0717d0 0x7f4b6c1f00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b6bfff640 1 -- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b6c143c40 msgr2=0x7f4b6c0c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b6bfff640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b6c143c40 0x7f4b6c0c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b6bfff640 1 -- 172.21.15.97:0/3452673896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0094d0 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b6bfff640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c0ccc10 0x7f4b6c0c3d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ba50 tx=0x7f4b5400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b697fa640 1 -- 172.21.15.97:0/3452673896 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400cc10 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b697fa640 1 -- 172.21.15.97:0/3452673896 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400cd70 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b697fa640 1 -- 172.21.15.97:0/3452673896 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54014680 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.516+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c12d590 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.517+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c1f0620 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.518+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c12dab0 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.518+0000 7f4b697fa640 1 -- 172.21.15.97:0/3452673896 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b5401d3b0 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.519+0000 7f4b697fa640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4b4c06ae40 0x7f4b4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:00.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.519+0000 7f4b697fa640 1 -- 172.21.15.97:0/3452673896 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b540896a0 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.520+0000 7f4b70e57640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4b4c06ae40 0x7f4b4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:00.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.520+0000 7f4b70e57640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4b4c06ae40 0x7f4b4c06d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c036000 tx=0x7f4b5c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:00.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.524+0000 7f4b697fa640 1 -- 172.21.15.97:0/3452673896 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b6c12dab0 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.750+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b6c12dab0 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.751+0000 7f4b697fa640 1 -- 172.21.15.97:0/3452673896 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f4b6c12dab0 con 0x7f4b6c0ccc10 2023-11-24T08:07:00.752 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:00.753 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:07:00.753 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:07:00.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.753+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4b4c06ae40 msgr2=0x7f4b4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.753+0000 7f4b71e59640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4b4c06ae40 0x7f4b4c06d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c036000 tx=0x7f4b5c03c040 comp rx=0 tx=0).stop 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.753+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c0ccc10 msgr2=0x7f4b6c0c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.753+0000 7f4b71e59640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c0ccc10 0x7f4b6c0c3d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ba50 tx=0x7f4b5400bf10 comp rx=0 tx=0).stop 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 shutdown_connections 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4b4c06ae40 0x7f4b4c06d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b6c143c40 0x7f4b6c0c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c0ccc10 0x7f4b6c0c3d70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 --2- 172.21.15.97:0/3452673896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b6c0717d0 0x7f4b6c1f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 >> 172.21.15.97:0/3452673896 conn(0x7f4b6c06a800 msgr2=0x7f4b6c0afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 shutdown_connections 2023-11-24T08:07:00.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:00.754+0000 7f4b71e59640 1 -- 172.21.15.97:0/3452673896 wait complete. 2023-11-24T08:07:01.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:06:42.070911+0000', 'modified': '2023-11-24T08:06:45.090102+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6833/738142400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 738142400}, {'type': 'v1', 'addr': '172.21.15.183:6833', 'nonce': 738142400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:07:01.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:07:01.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T08:07:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.398+0000 7f771afcb640 1 Processor -- start 2023-11-24T08:07:01.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.399+0000 7f771afcb640 1 -- start start 2023-11-24T08:07:01.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f771afcb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7714160920 0x7f77140b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f771afcb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f77140cf9f0 0x7f77140cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f771afcb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77140d0a10 con 0x7f7714161010 2023-11-24T08:07:01.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f771afcb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140d03e0 con 0x7f7714160920 2023-11-24T08:07:01.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f771afcb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140d1f50 con 0x7f77140cf9f0 2023-11-24T08:07:01.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f7719fc9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7714160920 0x7f77140b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f771a7ca640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7714161010 0x7f7714161480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51348/0 (socket says 172.21.15.97:51348) 2023-11-24T08:07:01.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.400+0000 7f771a7ca640 1 -- 172.21.15.97:0/1547607276 learned_addr learned my addr 172.21.15.97:0/1547607276 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:01.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.401+0000 7f77197c8640 1 --2- 172.21.15.97:0/1547607276 >> v2:172.21.15.183:3300/0 conn(0x7f77140cf9f0 0x7f77140cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.401+0000 7f7719fc9640 1 -- 172.21.15.97:0/1547607276 >> v2:172.21.15.183:3300/0 conn(0x7f77140cf9f0 msgr2=0x7f77140cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.401+0000 7f7719fc9640 1 --2- 172.21.15.97:0/1547607276 >> v2:172.21.15.183:3300/0 conn(0x7f77140cf9f0 0x7f77140cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.401+0000 7f7719fc9640 1 -- 172.21.15.97:0/1547607276 >> v1:172.21.15.97:6789/0 conn(0x7f7714161010 legacy=0x7f7714161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.401+0000 7f7719fc9640 1 -- 172.21.15.97:0/1547607276 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77140cf080 con 0x7f7714160920 2023-11-24T08:07:01.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.401+0000 7f7718fc7640 1 -- 172.21.15.97:0/1547607276 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468462332 0 0) 0x7f77140d0a10 con 0x7f7714161010 2023-11-24T08:07:01.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.402+0000 7f7719fc9640 1 --2- 172.21.15.97:0/1547607276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77140b3f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f771408c1f0 tx=0x7f771002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12339399a7708b31 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f7718fc7640 1 -- 172.21.15.97:0/1547607276 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710031830 con 0x7f7714160920 2023-11-24T08:07:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f7718fc7640 1 -- 172.21.15.97:0/1547607276 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710031990 con 0x7f7714160920 2023-11-24T08:07:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f7718fc7640 1 -- 172.21.15.97:0/1547607276 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710031d20 con 0x7f7714160920 2023-11-24T08:07:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 -- 172.21.15.97:0/1547607276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 msgr2=0x7f77140b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 --2- 172.21.15.97:0/1547607276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77140b3f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f771408c1f0 tx=0x7f771002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 -- 172.21.15.97:0/1547607276 shutdown_connections 2023-11-24T08:07:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 --2- 172.21.15.97:0/1547607276 >> v2:172.21.15.183:3300/0 conn(0x7f77140cf9f0 0x7f77140cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 --2- 172.21.15.97:0/1547607276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77140b3f30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 -- 172.21.15.97:0/1547607276 >> 172.21.15.97:0/1547607276 conn(0x7f77140d3090 msgr2=0x7f77140d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 -- 172.21.15.97:0/1547607276 shutdown_connections 2023-11-24T08:07:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.403+0000 7f771afcb640 1 -- 172.21.15.97:0/1547607276 wait complete. 2023-11-24T08:07:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.405+0000 7f771afcb640 1 Processor -- start 2023-11-24T08:07:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.405+0000 7f771afcb640 1 -- start start 2023-11-24T08:07:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f771afcb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77140cf9f0 0x7f77140cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f771afcb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77141574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f771afcb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7714161010 0x7f77140c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f771afcb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141f3dd0 con 0x7f7714160920 2023-11-24T08:07:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f771afcb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77140c99f0 con 0x7f77140cf9f0 2023-11-24T08:07:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f771afcb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77140cb1c0 con 0x7f7714161010 2023-11-24T08:07:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f77197c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77141574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f77197c8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77141574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48012/0 (socket says 172.21.15.97:48012) 2023-11-24T08:07:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.406+0000 7f77197c8640 1 -- 172.21.15.97:0/2365880960 learned_addr learned my addr 172.21.15.97:0/2365880960 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77140cf9f0 0x7f77140cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7714161010 0x7f77140c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f77197c8640 1 -- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7714161010 msgr2=0x7f77140c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f77197c8640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7714161010 0x7f77140c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f77197c8640 1 -- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77140cf9f0 msgr2=0x7f77140cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f77197c8640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77140cf9f0 0x7f77140cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f77197c8640 1 -- 172.21.15.97:0/2365880960 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710009400 con 0x7f7714160920 2023-11-24T08:07:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7714161010 0x7f77140c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f77197c8640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77141574e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f770400d5f0 tx=0x7f770400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f770a7fc640 1 -- 172.21.15.97:0/2365880960 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77040125f0 con 0x7f7714160920 2023-11-24T08:07:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f770a7fc640 1 -- 172.21.15.97:0/2365880960 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7704012750 con 0x7f7714160920 2023-11-24T08:07:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f770a7fc640 1 -- 172.21.15.97:0/2365880960 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704012b00 con 0x7f7714160920 2023-11-24T08:07:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.407+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77141f3010 con 0x7f7714160920 2023-11-24T08:07:01.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.408+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77141f35d0 con 0x7f7714160920 2023-11-24T08:07:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.411+0000 7f770a7fc640 1 -- 172.21.15.97:0/2365880960 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7704012c60 con 0x7f7714160920 2023-11-24T08:07:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.411+0000 7f770a7fc640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f76f806ae40 0x7f76f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.412+0000 7f770a7fc640 1 -- 172.21.15.97:0/2365880960 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7704089ab0 con 0x7f7714160920 2023-11-24T08:07:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.412+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f76f806ae40 0x7f76f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.412+0000 7f771edc3740 1 Processor -- start 2023-11-24T08:07:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.412+0000 7f771edc3740 1 -- start start 2023-11-24T08:07:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.412+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f76f806ae40 0x7f76f806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7710036000 tx=0x7f771003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.413+0000 7f771edc3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea69ee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.413+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 0x55cea69ed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.413+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 0x55cea6a31730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.413+0000 7f771edc3740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea694c880 con 0x55cea69ee070 2023-11-24T08:07:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.413+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea695bae0 con 0x55cea69ed7b0 2023-11-24T08:07:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.413+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea69591d0 con 0x55cea69e8d70 2023-11-24T08:07:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.413+0000 7f7719fc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea69ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea69ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48026/0 (socket says 172.21.15.97:48026) 2023-11-24T08:07:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 -- 172.21.15.97:0/2349596466 learned_addr learned my addr 172.21.15.97:0/2349596466 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 -- 172.21.15.97:0/2349596466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 msgr2=0x55cea69ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 0x55cea69ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 -- 172.21.15.97:0/2349596466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 msgr2=0x55cea6a31730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 0x55cea6a31730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 0x55cea6a31730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 -- 172.21.15.97:0/2349596466 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea691c860 con 0x55cea69ee070 2023-11-24T08:07:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea69ee450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7710045510 tx=0x7f7710030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7594b61d962f7de1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f76f77fe640 1 -- 172.21.15.97:0/2349596466 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771004a070 con 0x55cea69ee070 2023-11-24T08:07:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f76f77fe640 1 -- 172.21.15.97:0/2349596466 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771003a4e0 con 0x55cea69ee070 2023-11-24T08:07:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.414+0000 7f76f77fe640 1 -- 172.21.15.97:0/2349596466 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771003f040 con 0x55cea69ee070 2023-11-24T08:07:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 -- 172.21.15.97:0/2349596466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 msgr2=0x55cea69ee450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea69ee450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7710045510 tx=0x7f7710030000 comp rx=0 tx=0).stop 2023-11-24T08:07:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 -- 172.21.15.97:0/2349596466 shutdown_connections 2023-11-24T08:07:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 0x55cea6a31730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 0x55cea69ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 --2- 172.21.15.97:0/2349596466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea69ee450 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 -- 172.21.15.97:0/2349596466 >> 172.21.15.97:0/2349596466 conn(0x55cea69afc70 msgr2=0x55cea6a33b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 -- 172.21.15.97:0/2349596466 shutdown_connections 2023-11-24T08:07:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.415+0000 7f771edc3740 1 -- 172.21.15.97:0/2349596466 wait complete. 2023-11-24T08:07:01.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.416+0000 7f771edc3740 1 -- start start 2023-11-24T08:07:01.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.416+0000 7f771edc3740 1 Processor -- start 2023-11-24T08:07:01.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a2ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a12050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771edc3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a3b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771edc3740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea6954ac0 con 0x55cea69ee070 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea68f12f0 con 0x55cea69e8d70 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea690ec70 con 0x55cea69ed7b0 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771edc3740 10 client.0 _ll_register_callbacks cb 0x55cea69133b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.417+0000 7f771a7ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a3b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48032/0 (socket says 172.21.15.97:48032) 2023-11-24T08:07:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 -- 172.21.15.97:0/2596373850 learned_addr learned my addr 172.21.15.97:0/2596373850 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:01.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f77197c8640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a12050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a2ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 -- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 msgr2=0x55cea6a12050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a12050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 -- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 msgr2=0x55cea6a2ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a2ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 -- 172.21.15.97:0/2596373850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77140cf080 con 0x55cea69ee070 2023-11-24T08:07:01.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a2ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a3b260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f770c00e4f0 tx=0x7f770c00e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffab91d03339b029 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f76f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f76f4ff9640 1 -- 172.21.15.97:0/2596373850 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0070d0 con 0x55cea69ee070 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f76f4ff9640 1 -- 172.21.15.97:0/2596373850 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f770c014af0 con 0x55cea69ee070 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.418+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cea694daa0 con 0x55cea69ee070 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f76f4ff9640 1 -- 172.21.15.97:0/2596373850 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770c014cb0 con 0x55cea69ee070 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 10 client.4701 fetch_fsmap learned FSMap version 8 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55cea6953140 con 0x55cea69ee070 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f76f4ff9640 1 -- 172.21.15.97:0/2596373850 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cea694daa0 con 0x55cea69ee070 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f76f4ff9640 1 -- 172.21.15.97:0/2596373850 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f770c007230 con 0x55cea69ee070 2023-11-24T08:07:01.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 10 client.4701 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 20 client.4701 populate_metadata read hostname 'smithi097' 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a45bf0 0x55cea6a50f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 4 client.4701 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.419+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 --> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cea694d7c0 con 0x55cea6a45bf0 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.420+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a45bf0 0x55cea6a50f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.421+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a45bf0 0x55cea6a50f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df2423157e699a17 server_cookie=f93fb444a5ad3cc0 in_seq=0 out_seq=0 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.421+0000 7f76f4ff9640 10 client.4701 ms_handle_connect on v2:172.21.15.183:6832/738142400 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f76f4ff9640 1 -- 172.21.15.97:0/2596373850 <== mds.0 v2:172.21.15.183:6832/738142400 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cea694d7c0 con 0x55cea6a45bf0 2023-11-24T08:07:01.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f76f4ff9640 10 client.4701 handle_command_reply: tid=0 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 client.4701 shutdown 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 msgr2=0x55cea6a3b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a3b260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f770c00e4f0 tx=0x7f770c00e9b0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 shutdown_connections 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a45bf0 0x55cea6a50f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a3b260 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a12050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f76f4ff9640 0 client.4701 ms_handle_reset on v2:172.21.15.183:6832/738142400 2023-11-24T08:07:01.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 --2- 172.21.15.97:0/2596373850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a2ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 >> 172.21.15.97:0/2596373850 conn(0x55cea69afc70 msgr2=0x55cea69e7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 shutdown_connections 2023-11-24T08:07:01.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 1 -- 172.21.15.97:0/2596373850 wait complete. 2023-11-24T08:07:01.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.423+0000 7f771edc3740 20 client.4701 trim_cache size 0 max 16384 2023-11-24T08:07:01.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.440+0000 7f771edc3740 1 Processor -- start 2023-11-24T08:07:01.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.441+0000 7f771edc3740 1 -- start start 2023-11-24T08:07:01.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.441+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a36150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.441+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a2a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.441+0000 7f771edc3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a2aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.441+0000 7f771edc3740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea66b7f20 con 0x55cea69ee070 2023-11-24T08:07:01.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.441+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea6a2bcb0 con 0x55cea69e8d70 2023-11-24T08:07:01.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.441+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea69e9560 con 0x55cea69ed7b0 2023-11-24T08:07:01.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a2aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a2aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48044/0 (socket says 172.21.15.97:48044) 2023-11-24T08:07:01.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 -- 172.21.15.97:0/2054708552 learned_addr learned my addr 172.21.15.97:0/2054708552 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f77197c8640 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a2a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a36150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 -- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 msgr2=0x55cea6a2a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a2a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 -- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 msgr2=0x55cea6a36150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a36150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f771a7ca640 1 -- 172.21.15.97:0/2054708552 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea68f0b80 con 0x55cea69ee070 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f7719fc9640 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a36150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.442+0000 7f77197c8640 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a2a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771a7ca640 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a2aa40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f770c007ab0 tx=0x7f770c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a59fb35e991055b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f76f7fff640 1 -- 172.21.15.97:0/2054708552 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00eeb0 con 0x55cea69ee070 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f76f7fff640 1 -- 172.21.15.97:0/2054708552 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c00d040 con 0x55cea69ee070 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f76f7fff640 1 -- 172.21.15.97:0/2054708552 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0070e0 con 0x55cea69ee070 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771edc3740 1 -- 172.21.15.97:0/2054708552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 msgr2=0x55cea6a2aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771edc3740 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a2aa40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f770c007ab0 tx=0x7f770c011000 comp rx=0 tx=0).stop 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771edc3740 1 -- 172.21.15.97:0/2054708552 shutdown_connections 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771edc3740 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a2aa40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771edc3740 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69ed7b0 0x55cea6a2a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771edc3740 1 --2- 172.21.15.97:0/2054708552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69e8d70 0x55cea6a36150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.443+0000 7f771edc3740 1 -- 172.21.15.97:0/2054708552 >> 172.21.15.97:0/2054708552 conn(0x55cea69afc70 msgr2=0x55cea6a37260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.444+0000 7f771edc3740 1 -- 172.21.15.97:0/2054708552 shutdown_connections 2023-11-24T08:07:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.444+0000 7f771edc3740 1 -- 172.21.15.97:0/2054708552 wait complete. 2023-11-24T08:07:01.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.444+0000 7f771edc3740 1 -- start start 2023-11-24T08:07:01.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.444+0000 7f771edc3740 1 Processor -- start 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.445+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 0x55cea6a42260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.445+0000 7f771edc3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 0x55cea6a427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.445+0000 7f771edc3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a14860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.445+0000 7f771edc3740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea6a145c0 con 0x55cea69ee070 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.445+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea6a43240 con 0x55cea69ed7b0 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.445+0000 7f771edc3740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea6a45220 con 0x55cea69e8d70 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.445+0000 7f771edc3740 10 client.0 _ll_register_callbacks cb 0x7f770c007eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a14860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a14860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48056/0 (socket says 172.21.15.97:48056) 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 -- 172.21.15.97:0/444159299 learned_addr learned my addr 172.21.15.97:0/444159299 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f7719fc9640 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 0x55cea6a42260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 -- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 msgr2=0x55cea6a42260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 0x55cea6a42260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 -- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 msgr2=0x55cea6a427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 0x55cea6a427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.446+0000 7f771a7ca640 1 -- 172.21.15.97:0/444159299 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cea6953140 con 0x55cea69ee070 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f771a7ca640 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a14860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f770c00e9f0 tx=0x7f770c001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62579d6dc2e43745 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f76f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f76f4ff9640 1 -- 172.21.15.97:0/444159299 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00eeb0 con 0x55cea69ee070 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f76f4ff9640 1 -- 172.21.15.97:0/444159299 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f770c00e220 con 0x55cea69ee070 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f771003a4e0 con 0x55cea69ee070 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f76f4ff9640 1 -- 172.21.15.97:0/444159299 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770c031650 con 0x55cea69ee070 2023-11-24T08:07:01.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f771edc3740 10 client.4707 fetch_fsmap learned FSMap version 8 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55cea6916170 con 0x55cea69ee070 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f76f4ff9640 1 -- 172.21.15.97:0/444159299 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771003a4e0 con 0x55cea69ee070 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.447+0000 7f76f4ff9640 1 -- 172.21.15.97:0/444159299 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f770c026070 con 0x55cea69ee070 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.448+0000 7f771edc3740 10 client.4707 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.448+0000 7f771edc3740 10 client.4707 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.448+0000 7f771edc3740 20 client.4707 populate_metadata read hostname 'smithi097' 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.448+0000 7f771edc3740 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a14df0 0x55cea6a151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.448+0000 7f771edc3740 4 client.4707 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.448+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 --> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cea66556c0 con 0x55cea6a14df0 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.448+0000 7f7719fc9640 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a14df0 0x55cea6a151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.449+0000 7f7719fc9640 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a14df0 0x55cea6a151d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dc45cc3963d8a08 server_cookie=61b8d204d2e6af48 in_seq=0 out_seq=0 2023-11-24T08:07:01.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.449+0000 7f76f4ff9640 10 client.4707 ms_handle_connect on v2:172.21.15.183:6832/738142400 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.449+0000 7f76f4ff9640 1 -- 172.21.15.97:0/444159299 <== mds.0 v2:172.21.15.183:6832/738142400 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55cea66556c0 con 0x55cea6a14df0 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.449+0000 7f76f4ff9640 10 client.4707 handle_command_reply: tid=0 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.449+0000 7f771edc3740 1 client.4707 shutdown 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 msgr2=0x55cea6a14860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a14860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f770c00e9f0 tx=0x7f770c001400 comp rx=0 tx=0).stop 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 shutdown_connections 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:6832/738142400,v1:172.21.15.183:6833/738142400] conn(0x55cea6a14df0 0x55cea6a151d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cea69ee070 0x55cea6a14860 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f76f4ff9640 0 client.4707 ms_handle_reset on v2:172.21.15.183:6832/738142400 2023-11-24T08:07:01.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cea69ed7b0 0x55cea6a427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 --2- 172.21.15.97:0/444159299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55cea69e8d70 0x55cea6a42260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 >> 172.21.15.97:0/444159299 conn(0x55cea69afc70 msgr2=0x55cea6a37260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 shutdown_connections 2023-11-24T08:07:01.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 1 -- 172.21.15.97:0/444159299 wait complete. 2023-11-24T08:07:01.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.450+0000 7f771edc3740 20 client.4707 trim_cache size 0 max 16384 2023-11-24T08:07:01.456 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:07:01.457 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "bcc30232-58ca-4ca3-86d0-71be2a8a6471", 2023-11-24T08:07:01.457 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2023-11-24T08:07:01.457 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4264, 2023-11-24T08:07:01.457 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2023-11-24T08:07:01.457 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2023-11-24T08:07:01.457 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2023-11-24T08:07:01.458 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 18.834314840000001, 2023-11-24T08:07:01.458 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 8, 2023-11-24T08:07:01.458 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 22, 2023-11-24T08:07:01.458 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 22, 2023-11-24T08:07:01.458 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 26.765057273 2023-11-24T08:07:01.458 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:07:01.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f76f806ae40 msgr2=0x7f76f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f76f806ae40 0x7f76f806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7710036000 tx=0x7f771003c040 comp rx=0 tx=0).stop 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 msgr2=0x7f77141574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77141574e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f770400d5f0 tx=0x7f770400dab0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 shutdown_connections 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f76f806ae40 0x7f76f806d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7714161010 0x7f77140c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7714160920 0x7f77141574e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 --2- 172.21.15.97:0/2365880960 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77140cf9f0 0x7f77140cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:01.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 >> 172.21.15.97:0/2365880960 conn(0x7f77140d3090 msgr2=0x7f7714161460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:01.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 shutdown_connections 2023-11-24T08:07:01.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:01.451+0000 7f771afcb640 1 -- 172.21.15.97:0/2365880960 wait complete. 2023-11-24T08:07:01.469 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-24T08:07:01.493 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-24T08:07:01.493 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T08:07:01.494 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-24T08:07:01.494 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:07:01.494 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:01.494 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-24T08:07:01.494 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:07:01.494 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:01.494 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-24T08:07:01.495 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:07:01.495 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:01.495 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-24T08:07:01.495 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:07:01.495 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:01.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:01.495 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-24T08:07:01.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:01.556 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-11-24T08:07:01.654 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2023-11-24T08:07:01.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:07:01.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:01.658 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-11-24T08:07:01.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:01.718 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2023-11-24T08:07:01.818 INFO:teuthology.orchestra.run.smithi097.stderr:Cannot find device "ceph-brx" 2023-11-24T08:07:01.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:07:01.823 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-24T08:07:01.823 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:02.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.037+0000 7f2f109ff640 1 Processor -- start 2023-11-24T08:07:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.037+0000 7f2f109ff640 1 -- start start 2023-11-24T08:07:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.038+0000 7f2f109ff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2f0c143c40 0x7f2f0c071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f109ff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0ccc10 0x7f2f0c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f109ff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c070e50 con 0x7f2f0c0717d0 2023-11-24T08:07:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f109ff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0723c0 con 0x7f2f0c143c40 2023-11-24T08:07:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f109ff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c144020 con 0x7f2f0c0ccc10 2023-11-24T08:07:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f0b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0ccc10 0x7f2f0c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f0ad9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2f0c143c40 0x7f2f0c071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f0b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0ccc10 0x7f2f0c06d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:37026/0 (socket says 172.21.15.97:37026) 2023-11-24T08:07:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.039+0000 7f2f0a59c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f2f0c0717d0 0x7f2f0c0cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:46316/0 (socket says 172.21.15.97:46316) 2023-11-24T08:07:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.040+0000 7f2f0b59e640 1 -- 172.21.15.97:0/2788735048 learned_addr learned my addr 172.21.15.97:0/2788735048 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.040+0000 7f2f0ad9d640 1 -- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0ccc10 msgr2=0x7f2f0c06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.040+0000 7f2f0ad9d640 1 --2- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0ccc10 0x7f2f0c06d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.040+0000 7f2f0ad9d640 1 -- 172.21.15.97:0/2788735048 >> v1:172.21.15.183:6789/0 conn(0x7f2f0c0717d0 legacy=0x7f2f0c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.040+0000 7f2f0ad9d640 1 -- 172.21.15.97:0/2788735048 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c071e00 con 0x7f2f0c143c40 2023-11-24T08:07:02.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.040+0000 7f2f0b59e640 1 --2- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0ccc10 0x7f2f0c06d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:02.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.042+0000 7f2f0ad9d640 1 --2- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c143c40 0x7f2f0c071290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009d90 tx=0x7f2efc02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a68cb90da7621e6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.042+0000 7f2f09d9b640 1 -- 172.21.15.97:0/2788735048 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc02cbc0 con 0x7f2f0c143c40 2023-11-24T08:07:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.042+0000 7f2f09d9b640 1 -- 172.21.15.97:0/2788735048 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc02cd20 con 0x7f2f0c143c40 2023-11-24T08:07:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.042+0000 7f2f09d9b640 1 -- 172.21.15.97:0/2788735048 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc034660 con 0x7f2f0c143c40 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 -- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c143c40 msgr2=0x7f2f0c071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 --2- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c143c40 0x7f2f0c071290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009d90 tx=0x7f2efc02be10 comp rx=0 tx=0).stop 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 -- 172.21.15.97:0/2788735048 shutdown_connections 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 --2- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0ccc10 0x7f2f0c06d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 --2- 172.21.15.97:0/2788735048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c143c40 0x7f2f0c071290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 -- 172.21.15.97:0/2788735048 >> 172.21.15.97:0/2788735048 conn(0x7f2f0c06a800 msgr2=0x7f2f0c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 -- 172.21.15.97:0/2788735048 shutdown_connections 2023-11-24T08:07:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.043+0000 7f2f109ff640 1 -- 172.21.15.97:0/2788735048 wait complete. 2023-11-24T08:07:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.045+0000 7f2f109ff640 1 Processor -- start 2023-11-24T08:07:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.045+0000 7f2f109ff640 1 -- start start 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f109ff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0717d0 0x7f2f0c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f109ff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0ccc10 0x7f2f0c0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f109ff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f0c143c40 0x7f2f0c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f109ff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c15a970 con 0x7f2f0c143c40 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f109ff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b1f00 con 0x7f2f0c0ccc10 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f109ff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0ace20 con 0x7f2f0c0717d0 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f0c143c40 0x7f2f0c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f0c143c40 0x7f2f0c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48068/0 (socket says 172.21.15.97:48068) 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 -- 172.21.15.97:0/271746059 learned_addr learned my addr 172.21.15.97:0/271746059 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0a59c640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0ccc10 0x7f2f0c0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0ad9d640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0717d0 0x7f2f0c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 -- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0717d0 msgr2=0x7f2f0c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0717d0 0x7f2f0c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 -- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0ccc10 msgr2=0x7f2f0c0add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0ccc10 0x7f2f0c0add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.046+0000 7f2f0b59e640 1 -- 172.21.15.97:0/271746059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040094d0 con 0x7f2f0c143c40 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.047+0000 7f2f0b59e640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f0c143c40 0x7f2f0c06d570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e930 tx=0x7f2f0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.047+0000 7f2f037fe640 1 -- 172.21.15.97:0/271746059 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04009720 con 0x7f2f0c143c40 2023-11-24T08:07:02.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.047+0000 7f2f037fe640 1 -- 172.21.15.97:0/271746059 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0400ca00 con 0x7f2f0c143c40 2023-11-24T08:07:02.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.047+0000 7f2f037fe640 1 -- 172.21.15.97:0/271746059 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400cd90 con 0x7f2f0c143c40 2023-11-24T08:07:02.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.047+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc009a70 con 0x7f2f0c143c40 2023-11-24T08:07:02.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.047+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c0ad3e0 con 0x7f2f0c143c40 2023-11-24T08:07:02.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.048+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0b2070 con 0x7f2f0c143c40 2023-11-24T08:07:02.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.049+0000 7f2f037fe640 1 -- 172.21.15.97:0/271746059 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f04013470 con 0x7f2f0c143c40 2023-11-24T08:07:02.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.051+0000 7f2f037fe640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2eec06ae70 0x7f2eec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:02.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.051+0000 7f2f037fe640 1 -- 172.21.15.97:0/271746059 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f04089250 con 0x7f2f0c143c40 2023-11-24T08:07:02.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.051+0000 7f2f0ad9d640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2eec06ae70 0x7f2eec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:02.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.052+0000 7f2f0ad9d640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2eec06ae70 0x7f2eec06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2efc036000 tx=0x7f2efc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:02.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.055+0000 7f2f037fe640 1 -- 172.21.15.97:0/271746059 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f04054260 con 0x7f2f0c143c40 2023-11-24T08:07:02.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.283+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f0c067450 con 0x7f2f0c143c40 2023-11-24T08:07:02.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.283+0000 7f2f037fe640 1 -- 172.21.15.97:0/271746059 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f04057880 con 0x7f2f0c143c40 2023-11-24T08:07:02.285 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:02.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2eec06ae70 msgr2=0x7f2eec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2eec06ae70 0x7f2eec06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2efc036000 tx=0x7f2efc030000 comp rx=0 tx=0).stop 2023-11-24T08:07:02.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f0c143c40 msgr2=0x7f2f0c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:02.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f0c143c40 0x7f2f0c06d570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e930 tx=0x7f2f0400edf0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 shutdown_connections 2023-11-24T08:07:02.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2eec06ae70 0x7f2eec06d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f0c143c40 0x7f2f0c06d570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0ccc10 0x7f2f0c0add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 --2- 172.21.15.97:0/271746059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c0717d0 0x7f2f0c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:02.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 >> 172.21.15.97:0/271746059 conn(0x7f2f0c06a800 msgr2=0x7f2f0c0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:02.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 shutdown_connections 2023-11-24T08:07:02.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:02.286+0000 7f2f109ff640 1 -- 172.21.15.97:0/271746059 wait complete. 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:02.307 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:02.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:02.308 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-11-24T08:07:02.364 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:02.365 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:02.365 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:02.365 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:02.366 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:02.366 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:02.366 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:02.366 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:02.367 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-11-24T08:07:02.367 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:02.367 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:02.368 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-11-24T08:07:02.368 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:02.368 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:02.368 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:02.369 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:02.369 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:07:02.369 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42355sec preferred_lft 42355sec 2023-11-24T08:07:02.370 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-11-24T08:07:02.370 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:02.371 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:07:02.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:02.371 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:02.371 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:02.371 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:07:02.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr flush dev ceph-brx 2023-11-24T08:07:02.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set ceph-brx up 2023-11-24T08:07:02.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:07:02.372 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:02.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:02.829 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:02.914 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-11-24T08:07:02.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:02.917 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-11-24T08:07:02.972 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-11-24T08:07:02.972 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:02.972 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:07:02.972 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:07:02.972 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:02.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:02.973 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:02.973 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:02.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:07:02.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:07:02.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:07:02.974 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:03.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:03.745 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-11-24T08:07:03.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:03.830 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2023-11-24T08:07:03.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:03.969 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:03.969 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:03.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:03.970 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T08:07:03.970 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:04.121 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T08:07:04.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:04.121 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:04.121 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:04.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T08:07:04.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:07:04.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T08:07:04.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T08:07:04.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T08:07:04.122 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:04.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:04.406 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:04.407 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:04.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-11-24T08:07:04.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:07:04.407 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:04.567 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T08:07:04.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:04.567 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:04.618 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:04.618 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:04.618 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:04.669 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-11-24T08:07:04.759 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:04.813 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/selinux 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:04.814 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:07:04.815 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:07:04.816 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:07:04.816 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:07:04.816 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2023-11-24T08:07:04.816 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:04.816 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:04.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:04.817 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-11-24T08:07:04.864 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:07:04.865 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T08:07:04.869 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-11-24T08:07:04.942 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2023-11-24T08:07:04.984 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/selinux 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:04.985 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:04.986 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:04.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:04.987 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-11-24T08:07:05.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:2023-11-24T08:07:05.104+0000 7faf70c4a480 -1 init, newargv = 0x559d12a28530 newargc=15 2023-11-24T08:07:05.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[96622]: starting ceph client 2023-11-24T08:07:05.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[96622]: starting fuse 2023-11-24T08:07:06.175 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-11-24T08:07:06.278 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:06.336 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2023-11-24T08:07:06.336 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2023-11-24T08:07:06.336 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/selinux 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2023-11-24T08:07:06.337 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:07:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:07:06.339 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2023-11-24T08:07:06.339 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:06.339 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:06.339 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:06.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:06.340 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-11-24T08:07:06.391 INFO:teuthology.orchestra.run.smithi097.stdout:40 2023-11-24T08:07:06.391 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2023-11-24T08:07:06.391 DEBUG:teuthology.orchestra.run.smithi097:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> import glob 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> import re 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> import os 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> import subprocess 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> def _find_admin_socket(client_name): 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> files = glob.glob(asok_path) 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> # Given a non-glob path, it better be there 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> if "*" not in asok_path: 2023-11-24T08:07:06.392 DEBUG:teuthology.orchestra.run.smithi097:> assert(len(files) == 1) 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> return files[0] 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> for f in files: 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> contents = proc_f.read() 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> if mountpoint in contents: 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> return f 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> print(_find_admin_socket("client.0")) 2023-11-24T08:07:06.393 DEBUG:teuthology.orchestra.run.smithi097:> ' 2023-11-24T08:07:06.569 INFO:teuthology.orchestra.run.smithi097.stdout:/var/run/ceph/ceph-client.0.96622.asok 2023-11-24T08:07:06.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:07:06.586 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.96622.asok 2023-11-24T08:07:06.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:06.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.96622.asok status 2023-11-24T08:07:06.822 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:07:06.822 INFO:teuthology.orchestra.run.smithi097.stdout: "metadata": { 2023-11-24T08:07:06.822 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:07:06.822 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:07:06.822 INFO:teuthology.orchestra.run.smithi097.stdout: "entity_id": "0", 2023-11-24T08:07:06.822 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": "smithi097", 2023-11-24T08:07:06.822 INFO:teuthology.orchestra.run.smithi097.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "pid": "96622", 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "root": "/" 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_count": 0, 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_pinned_count": 0, 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4716, 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "inst": { 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "name": { 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "client", 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "num": 4716 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:06.823 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4013338571 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:07:06.824 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4013338571 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "inst_str": "client.4716 192.168.0.1:0/4013338571", 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "addr_str": "192.168.0.1:0/4013338571", 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "inode_count": 1, 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_epoch": 8, 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch": 22, 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklisted": false, 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs" 2023-11-24T08:07:06.825 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:07:06.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:07.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.045+0000 7f6e16687640 1 Processor -- start 2023-11-24T08:07:07.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.045+0000 7f6e16687640 1 -- start start 2023-11-24T08:07:07.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e16687640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e1013df80 0x7f6e1015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e16687640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e100cf9a0 0x7f6e100cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e16687640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1006c470 con 0x7f6e1013e360 2023-11-24T08:07:07.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e16687640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1006c750 con 0x7f6e1013df80 2023-11-24T08:07:07.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e16687640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1006ca30 con 0x7f6e100cf9a0 2023-11-24T08:07:07.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e0ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e1013df80 0x7f6e1015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e0ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e1013df80 0x7f6e1015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:54822/0 (socket says 172.21.15.97:54822) 2023-11-24T08:07:07.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.047+0000 7f6e0ffff640 1 -- 172.21.15.97:0/3418799091 learned_addr learned my addr 172.21.15.97:0/3418799091 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:07.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.048+0000 7f6e14c24640 1 --2- 172.21.15.97:0/3418799091 >> v2:172.21.15.183:3300/0 conn(0x7f6e100cf9a0 0x7f6e100cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.048+0000 7f6e0ffff640 1 -- 172.21.15.97:0/3418799091 >> v2:172.21.15.183:3300/0 conn(0x7f6e100cf9a0 msgr2=0x7f6e100cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:07.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.048+0000 7f6e0ffff640 1 --2- 172.21.15.97:0/3418799091 >> v2:172.21.15.183:3300/0 conn(0x7f6e100cf9a0 0x7f6e100cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.048+0000 7f6e0ffff640 1 -- 172.21.15.97:0/3418799091 >> v1:172.21.15.183:6789/0 conn(0x7f6e1013e360 legacy=0x7f6e100cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:07.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.048+0000 7f6e0ffff640 1 -- 172.21.15.97:0/3418799091 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1006cd10 con 0x7f6e1013df80 2023-11-24T08:07:07.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.049+0000 7f6e0ffff640 1 --2- 172.21.15.97:0/3418799091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e1015bee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e100ccb10 tx=0x7f6e0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363828f569323261 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.049+0000 7f6e0effd640 1 -- 172.21.15.97:0/3418799091 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00031870 con 0x7f6e1013df80 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.049+0000 7f6e0effd640 1 -- 172.21.15.97:0/3418799091 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e000319d0 con 0x7f6e1013df80 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.049+0000 7f6e0effd640 1 -- 172.21.15.97:0/3418799091 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00031d60 con 0x7f6e1013df80 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 -- 172.21.15.97:0/3418799091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 msgr2=0x7f6e1015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 --2- 172.21.15.97:0/3418799091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e1015bee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e100ccb10 tx=0x7f6e0002b910 comp rx=0 tx=0).stop 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 -- 172.21.15.97:0/3418799091 shutdown_connections 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 --2- 172.21.15.97:0/3418799091 >> v2:172.21.15.183:3300/0 conn(0x7f6e100cf9a0 0x7f6e100cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 --2- 172.21.15.97:0/3418799091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e1015bee0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 -- 172.21.15.97:0/3418799091 >> 172.21.15.97:0/3418799091 conn(0x7f6e1006a800 msgr2=0x7f6e1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:07.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 -- 172.21.15.97:0/3418799091 shutdown_connections 2023-11-24T08:07:07.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.050+0000 7f6e16687640 1 -- 172.21.15.97:0/3418799091 wait complete. 2023-11-24T08:07:07.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.052+0000 7f6e16687640 1 Processor -- start 2023-11-24T08:07:07.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.053+0000 7f6e16687640 1 -- start start 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e16687640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e100cf9a0 0x7f6e100a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e16687640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e10159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e16687640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e1013e360 0x7f6e101f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e16687640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015ad80 con 0x7f6e1013df80 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e16687640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10157fb0 con 0x7f6e1013e360 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e16687640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015a4e0 con 0x7f6e100cf9a0 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e0f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e10159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e0f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e10159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:54836/0 (socket says 172.21.15.97:54836) 2023-11-24T08:07:07.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/1821573744 learned_addr learned my addr 172.21.15.97:0/1821573744 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.054+0000 7f6e14c24640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e1013e360 0x7f6e101f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0ffff640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e100cf9a0 0x7f6e100a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e100cf9a0 msgr2=0x7f6e100a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0f7fe640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e100cf9a0 0x7f6e100a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e1013e360 msgr2=0x7f6e101f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0f7fe640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e1013e360 0x7f6e101f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/1821573744 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000094d0 con 0x7f6e1013df80 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0ffff640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e100cf9a0 0x7f6e100a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0f7fe640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e10159a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c400 tx=0x7f6e0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0cff9640 1 -- 172.21.15.97:0/1821573744 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04011790 con 0x7f6e1013df80 2023-11-24T08:07:07.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0cff9640 1 -- 172.21.15.97:0/1821573744 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04011930 con 0x7f6e1013df80 2023-11-24T08:07:07.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1015a7c0 con 0x7f6e1013df80 2023-11-24T08:07:07.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e0cff9640 1 -- 172.21.15.97:0/1821573744 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04011ce0 con 0x7f6e1013df80 2023-11-24T08:07:07.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.055+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e100aa1e0 con 0x7f6e1013df80 2023-11-24T08:07:07.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.056+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10157d80 con 0x7f6e1013df80 2023-11-24T08:07:07.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.057+0000 7f6e0cff9640 1 -- 172.21.15.97:0/1821573744 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e0401c460 con 0x7f6e1013df80 2023-11-24T08:07:07.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.058+0000 7f6e0cff9640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:07.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.058+0000 7f6e0cff9640 1 -- 172.21.15.97:0/1821573744 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e04089600 con 0x7f6e1013df80 2023-11-24T08:07:07.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.058+0000 7f6e0ffff640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:07.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.059+0000 7f6e0ffff640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6dfc06ae70 0x7f6dfc06d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e00036000 tx=0x7f6e0003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:07.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.063+0000 7f6e0cff9640 1 -- 172.21.15.97:0/1821573744 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e10157d80 con 0x7f6e1013df80 2023-11-24T08:07:07.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.301+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6e10157d80 con 0x7f6e1013df80 2023-11-24T08:07:07.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.302+0000 7f6e0cff9640 1 -- 172.21.15.97:0/1821573744 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6e10157d80 con 0x7f6e1013df80 2023-11-24T08:07:07.304 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:07.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6dfc06ae70 msgr2=0x7f6dfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6dfc06ae70 0x7f6dfc06d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e00036000 tx=0x7f6e0003c040 comp rx=0 tx=0).stop 2023-11-24T08:07:07.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 msgr2=0x7f6e10159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:07.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e10159a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c400 tx=0x7f6e0400c8c0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 shutdown_connections 2023-11-24T08:07:07.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6dfc06ae70 0x7f6dfc06d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e1013e360 0x7f6e101f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1013df80 0x7f6e10159a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 --2- 172.21.15.97:0/1821573744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e100cf9a0 0x7f6e100a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 >> 172.21.15.97:0/1821573744 conn(0x7f6e1006a800 msgr2=0x7f6e1006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 shutdown_connections 2023-11-24T08:07:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:07.305+0000 7f6e16687640 1 -- 172.21.15.97:0/1821573744 wait complete. 2023-11-24T08:07:07.326 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:07:07.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:07.327 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-11-24T08:07:07.327 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T08:07:07.327 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:07.327 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:07:07.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:07:07.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:07.327 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:07:07.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.327 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-11-24T08:07:07.375 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-11-24T08:07:07.376 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42350sec preferred_lft 42350sec 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 46:c4:d1:8a:f2:3a brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:07.377 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::10b7:35ff:fe1c:2d7f/64 scope link 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run.smithi097.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 46:c4:d1:8a:f2:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::44c4:d1ff:fe8a:f23a/64 scope link 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:07.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.378 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:07.463 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-11-24T08:07:07.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.467 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-11-24T08:07:07.516 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-11-24T08:07:07.516 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:07.517 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:07:07.517 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:07:07.517 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:07.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.517 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:07.517 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:07.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:07:07.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:07:07.518 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:07:07.518 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:07.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.734 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-11-24T08:07:07.776 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:07:07.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.776 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2023-11-24T08:07:07.863 INFO:teuthology.orchestra.run.smithi097.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T08:07:07.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.865 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:07.865 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:07.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:07.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T08:07:07.865 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:07.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:07.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:07:08.075 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether be:63:dd:ea:50:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::bc63:ddff:feea:504b/64 scope link 2023-11-24T08:07:08.076 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:08.079 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:07:08.157 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:08.157 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:08.157 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:08.157 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether be:63:dd:ea:50:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::bc63:ddff:feea:504b/64 scope link 2023-11-24T08:07:08.158 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:08.161 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T08:07:08.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:08.161 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:08.161 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:08.161 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T08:07:08.161 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:07:08.161 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T08:07:08.162 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T08:07:08.162 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T08:07:08.162 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:08.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:08.402 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:07:08.402 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:07:08.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.1 up 2023-11-24T08:07:08.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:07:08.403 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:07:08.554 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-24T08:07:08.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:08.555 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:08.598 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:07:08.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:08.598 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:08.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-11-24T08:07:08.820 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:08.874 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2023-11-24T08:07:08.874 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/selinux 2023-11-24T08:07:08.875 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2023-11-24T08:07:08.876 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:08.877 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:08.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:08.879 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-11-24T08:07:08.927 INFO:teuthology.orchestra.run.smithi097.stdout:40 2023-11-24T08:07:08.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2023-11-24T08:07:08.927 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-24T08:07:08.946 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-11-24T08:07:09.036 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:09.083 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2023-11-24T08:07:09.084 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2023-11-24T08:07:09.084 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2023-11-24T08:07:09.084 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2023-11-24T08:07:09.084 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2023-11-24T08:07:09.084 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2023-11-24T08:07:09.084 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/selinux 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2023-11-24T08:07:09.085 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2023-11-24T08:07:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2023-11-24T08:07:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2023-11-24T08:07:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:09.087 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2023-11-24T08:07:09.087 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2023-11-24T08:07:09.087 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:07:09.087 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:07:09.087 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:07:09.087 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:07:09.088 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2023-11-24T08:07:09.088 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:09.088 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:09.088 INFO:teuthology.orchestra.run.smithi097.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:09.088 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:09.088 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:09.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:09.089 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-11-24T08:07:09.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi097.stderr:2023-11-24T08:07:09.131+0000 7fc8a3141480 -1 init, newargv = 0x555f0b6d78e0 newargc=15 2023-11-24T08:07:09.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi097.stderr:ceph-fuse[97182]: starting ceph client 2023-11-24T08:07:09.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi097.stderr:ceph-fuse[97182]: starting fuse 2023-11-24T08:07:09.172 INFO:teuthology.orchestra.run.smithi097.stdout:40 2023-11-24T08:07:09.173 INFO:teuthology.orchestra.run.smithi097.stdout:42 2023-11-24T08:07:09.173 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 42] 2023-11-24T08:07:09.173 DEBUG:teuthology.orchestra.run.smithi097:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:07:09.173 DEBUG:teuthology.orchestra.run.smithi097:> import glob 2023-11-24T08:07:09.173 DEBUG:teuthology.orchestra.run.smithi097:> import re 2023-11-24T08:07:09.173 DEBUG:teuthology.orchestra.run.smithi097:> import os 2023-11-24T08:07:09.174 DEBUG:teuthology.orchestra.run.smithi097:> import subprocess 2023-11-24T08:07:09.174 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:09.174 DEBUG:teuthology.orchestra.run.smithi097:> def _find_admin_socket(client_name): 2023-11-24T08:07:09.174 DEBUG:teuthology.orchestra.run.smithi097:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-24T08:07:09.174 DEBUG:teuthology.orchestra.run.smithi097:> files = glob.glob(asok_path) 2023-11-24T08:07:09.174 DEBUG:teuthology.orchestra.run.smithi097:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-24T08:07:09.175 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:09.175 DEBUG:teuthology.orchestra.run.smithi097:> # Given a non-glob path, it better be there 2023-11-24T08:07:09.176 DEBUG:teuthology.orchestra.run.smithi097:> if "*" not in asok_path: 2023-11-24T08:07:09.176 DEBUG:teuthology.orchestra.run.smithi097:> assert(len(files) == 1) 2023-11-24T08:07:09.176 DEBUG:teuthology.orchestra.run.smithi097:> return files[0] 2023-11-24T08:07:09.176 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:09.176 DEBUG:teuthology.orchestra.run.smithi097:> for f in files: 2023-11-24T08:07:09.177 DEBUG:teuthology.orchestra.run.smithi097:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:07:09.177 DEBUG:teuthology.orchestra.run.smithi097:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:07:09.177 DEBUG:teuthology.orchestra.run.smithi097:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:07:09.177 DEBUG:teuthology.orchestra.run.smithi097:> contents = proc_f.read() 2023-11-24T08:07:09.177 DEBUG:teuthology.orchestra.run.smithi097:> if mountpoint in contents: 2023-11-24T08:07:09.177 DEBUG:teuthology.orchestra.run.smithi097:> return f 2023-11-24T08:07:09.178 DEBUG:teuthology.orchestra.run.smithi097:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:07:09.178 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:07:09.178 DEBUG:teuthology.orchestra.run.smithi097:> print(_find_admin_socket("client.2")) 2023-11-24T08:07:09.178 DEBUG:teuthology.orchestra.run.smithi097:> ' 2023-11-24T08:07:09.374 INFO:teuthology.orchestra.run.smithi097.stdout:/var/run/ceph/ceph-client.2.97182.asok 2023-11-24T08:07:09.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:07:09.389 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.97182.asok 2023-11-24T08:07:09.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:09.390 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.97182.asok status 2023-11-24T08:07:09.623 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "metadata": { 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "entity_id": "2", 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": "smithi097", 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "pid": "97182", 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "root": "/" 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:09.624 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_count": 0, 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_pinned_count": 0, 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4731, 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "inst": { 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "name": { 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "client", 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "num": 4731 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1282321221 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:09.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1282321221 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "inst_str": "client.4731 192.168.0.2:0/1282321221", 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "addr_str": "192.168.0.2:0/1282321221", 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "inode_count": 1, 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_epoch": 8, 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch": 22, 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:07:09.626 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklisted": false, 2023-11-24T08:07:09.627 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs" 2023-11-24T08:07:09.627 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:07:09.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:09.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.847+0000 7f1753f08640 1 Processor -- start 2023-11-24T08:07:09.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.847+0000 7f1753f08640 1 -- start start 2023-11-24T08:07:09.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f1753f08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f174c13df80 0x7f174c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f1753f08640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f174c0cf9a0 0x7f174c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f1753f08640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c06c470 con 0x7f174c13e360 2023-11-24T08:07:09.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f1753f08640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c06c750 con 0x7f174c13df80 2023-11-24T08:07:09.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f1753f08640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c06ca30 con 0x7f174c0cf9a0 2023-11-24T08:07:09.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f1751ca4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f174c13df80 0x7f174c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f17514a3640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f174c13e360 0x7f174c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49446/0 (socket says 172.21.15.97:49446) 2023-11-24T08:07:09.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f17514a3640 1 -- 172.21.15.97:0/2603810477 learned_addr learned my addr 172.21.15.97:0/2603810477 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.849+0000 7f1751ca4640 1 -- 172.21.15.97:0/2603810477 >> v2:172.21.15.183:3300/0 conn(0x7f174c0cf9a0 msgr2=0x7f174c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.850+0000 7f17524a5640 1 --2- 172.21.15.97:0/2603810477 >> v2:172.21.15.183:3300/0 conn(0x7f174c0cf9a0 0x7f174c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.850+0000 7f1750ca2640 1 -- 172.21.15.97:0/2603810477 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498627009 0 0) 0x7f174c06c470 con 0x7f174c13e360 2023-11-24T08:07:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.850+0000 7f1751ca4640 1 --2- 172.21.15.97:0/2603810477 >> v2:172.21.15.183:3300/0 conn(0x7f174c0cf9a0 0x7f174c0cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.850+0000 7f1751ca4640 1 -- 172.21.15.97:0/2603810477 >> v1:172.21.15.97:6789/0 conn(0x7f174c13e360 legacy=0x7f174c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.850+0000 7f1751ca4640 1 -- 172.21.15.97:0/2603810477 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c06cd10 con 0x7f174c13df80 2023-11-24T08:07:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.850+0000 7f17524a5640 1 --2- 172.21.15.97:0/2603810477 >> v2:172.21.15.183:3300/0 conn(0x7f174c0cf9a0 0x7f174c0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.851+0000 7f1751ca4640 1 --2- 172.21.15.97:0/2603810477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13df80 0x7f174c15bee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ccb10 tx=0x7f174802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1d63eb8aa3c66f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.851+0000 7f1750ca2640 1 -- 172.21.15.97:0/2603810477 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748031830 con 0x7f174c13df80 2023-11-24T08:07:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.851+0000 7f1750ca2640 1 -- 172.21.15.97:0/2603810477 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748031990 con 0x7f174c13df80 2023-11-24T08:07:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.851+0000 7f1750ca2640 1 -- 172.21.15.97:0/2603810477 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748031d20 con 0x7f174c13df80 2023-11-24T08:07:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.851+0000 7f1753f08640 1 -- 172.21.15.97:0/2603810477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13df80 msgr2=0x7f174c15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.851+0000 7f1753f08640 1 --2- 172.21.15.97:0/2603810477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13df80 0x7f174c15bee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ccb10 tx=0x7f174802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.852+0000 7f1753f08640 1 -- 172.21.15.97:0/2603810477 shutdown_connections 2023-11-24T08:07:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.852+0000 7f1753f08640 1 --2- 172.21.15.97:0/2603810477 >> v2:172.21.15.183:3300/0 conn(0x7f174c0cf9a0 0x7f174c0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.852+0000 7f1753f08640 1 --2- 172.21.15.97:0/2603810477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13df80 0x7f174c15bee0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.852+0000 7f1753f08640 1 -- 172.21.15.97:0/2603810477 >> 172.21.15.97:0/2603810477 conn(0x7f174c06a800 msgr2=0x7f174c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:09.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.852+0000 7f1753f08640 1 -- 172.21.15.97:0/2603810477 shutdown_connections 2023-11-24T08:07:09.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.852+0000 7f1753f08640 1 -- 172.21.15.97:0/2603810477 wait complete. 2023-11-24T08:07:09.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.853+0000 7f1753f08640 1 Processor -- start 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.853+0000 7f1753f08640 1 -- start start 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.854+0000 7f1753f08640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f174c0cf9a0 0x7f174c1f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.854+0000 7f1753f08640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f174c13df80 0x7f174c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.854+0000 7f1753f08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13e360 0x7f174c152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.854+0000 7f1753f08640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c151340 con 0x7f174c13e360 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.854+0000 7f1753f08640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0b2f00 con 0x7f174c13df80 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.854+0000 7f1753f08640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0b31e0 con 0x7f174c0cf9a0 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13e360 0x7f174c152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13e360 0x7f174c152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:54840/0 (socket says 172.21.15.97:54840) 2023-11-24T08:07:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 -- 172.21.15.97:0/255874613 learned_addr learned my addr 172.21.15.97:0/255874613 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f1751ca4640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f174c0cf9a0 0x7f174c1f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 -- 172.21.15.97:0/255874613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f174c0cf9a0 msgr2=0x7f174c1f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f174c0cf9a0 0x7f174c1f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 -- 172.21.15.97:0/255874613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f174c13df80 msgr2=0x7f174c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f174c13df80 0x7f174c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.855+0000 7f17524a5640 1 -- 172.21.15.97:0/255874613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748009400 con 0x7f174c13e360 2023-11-24T08:07:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.856+0000 7f17524a5640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13e360 0x7f174c152570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f174400cd80 tx=0x7f174400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.856+0000 7f17427fc640 1 -- 172.21.15.97:0/255874613 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400f680 con 0x7f174c13e360 2023-11-24T08:07:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.856+0000 7f17427fc640 1 -- 172.21.15.97:0/255874613 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400f800 con 0x7f174c13e360 2023-11-24T08:07:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.856+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c0b34c0 con 0x7f174c13e360 2023-11-24T08:07:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.856+0000 7f17427fc640 1 -- 172.21.15.97:0/255874613 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400fbb0 con 0x7f174c13e360 2023-11-24T08:07:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.856+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c0b3a80 con 0x7f174c13e360 2023-11-24T08:07:09.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.857+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c15d140 con 0x7f174c13e360 2023-11-24T08:07:09.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.858+0000 7f17427fc640 1 -- 172.21.15.97:0/255874613 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f174400b040 con 0x7f174c13e360 2023-11-24T08:07:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.859+0000 7f17427fc640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173006ae40 0x7f173006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.859+0000 7f17427fc640 1 -- 172.21.15.97:0/255874613 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f174408a060 con 0x7f174c13e360 2023-11-24T08:07:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.859+0000 7f1751ca4640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173006ae40 0x7f173006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.860+0000 7f1751ca4640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173006ae40 0x7f173006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1748036000 tx=0x7f1748008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:09.864+0000 7f17427fc640 1 -- 172.21.15.97:0/255874613 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17440bce90 con 0x7f174c13e360 2023-11-24T08:07:10.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.091+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f174c0675d0 con 0x7f174c13e360 2023-11-24T08:07:10.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.092+0000 7f17427fc640 1 -- 172.21.15.97:0/255874613 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1744055100 con 0x7f174c13e360 2023-11-24T08:07:10.094 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:10.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.094+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173006ae40 msgr2=0x7f173006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.094+0000 7f1753f08640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173006ae40 0x7f173006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1748036000 tx=0x7f1748008030 comp rx=0 tx=0).stop 2023-11-24T08:07:10.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.094+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13e360 msgr2=0x7f174c152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.094+0000 7f1753f08640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13e360 0x7f174c152570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f174400cd80 tx=0x7f174400a650 comp rx=0 tx=0).stop 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.094+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 shutdown_connections 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.094+0000 7f1753f08640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f173006ae40 0x7f173006d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.095+0000 7f1753f08640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f174c13e360 0x7f174c152570 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.095+0000 7f1753f08640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f174c13df80 0x7f174c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.095+0000 7f1753f08640 1 --2- 172.21.15.97:0/255874613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f174c0cf9a0 0x7f174c1f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.095+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 >> 172.21.15.97:0/255874613 conn(0x7f174c06a800 msgr2=0x7f174c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.095+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 shutdown_connections 2023-11-24T08:07:10.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:10.095+0000 7f1753f08640 1 -- 172.21.15.97:0/255874613 wait complete. 2023-11-24T08:07:10.115 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:07:10.115 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:10.115 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-24T08:07:10.116 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:07:10.116 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:10.116 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:07:10.116 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:07:10.116 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:10.116 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:10.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:10.116 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-24T08:07:10.176 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:10.176 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:10.176 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:10.176 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:10.176 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:10.176 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:10.176 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:07:10.177 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42330sec preferred_lft 42330sec 2023-11-24T08:07:10.178 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-24T08:07:10.178 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:10.179 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:07:10.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:10.179 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:10.179 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:10.179 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:07:10.179 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr flush dev ceph-brx 2023-11-24T08:07:10.179 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set ceph-brx up 2023-11-24T08:07:10.180 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:07:10.180 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:10.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:10.647 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:10.736 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-24T08:07:10.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:10.739 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-24T08:07:10.795 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-24T08:07:10.795 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:10.795 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:07:10.795 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:07:10.795 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:10.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:10.796 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:10.796 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:10.796 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:07:10.796 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:07:10.796 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:07:10.796 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:11.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:11.499 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-24T08:07:11.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:11.557 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2023-11-24T08:07:11.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:11.612 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:11.612 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:11.612 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:11.612 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T08:07:11.612 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:11.755 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T08:07:11.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T08:07:11.756 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:12.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:12.038 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:12.038 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:12.038 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-24T08:07:12.038 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:07:12.038 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:12.200 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T08:07:12.200 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:12.200 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:12.250 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:12.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:12.251 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:12.347 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2023-11-24T08:07:12.448 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:12.506 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2023-11-24T08:07:12.506 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:12.507 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2023-11-24T08:07:12.508 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2023-11-24T08:07:12.509 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:07:12.509 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:07:12.509 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:07:12.509 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:07:12.509 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2023-11-24T08:07:12.509 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:12.509 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:12.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:12.510 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2023-11-24T08:07:12.557 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:07:12.557 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T08:07:12.562 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2023-11-24T08:07:12.637 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:12.677 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2023-11-24T08:07:12.678 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:07:12.679 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:07:12.680 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:07:12.680 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2023-11-24T08:07:12.680 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:12.680 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:12.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:12.681 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2023-11-24T08:07:12.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2023-11-24T08:07:12.751+0000 7fddc083e480 -1 init, newargv = 0x55562ed478f0 newargc=15 2023-11-24T08:07:12.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[94054]: starting ceph client 2023-11-24T08:07:12.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[94054]: starting fuse 2023-11-24T08:07:12.767 INFO:teuthology.orchestra.run.smithi183.stdout:41 2023-11-24T08:07:12.768 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T08:07:12.768 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:07:12.768 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2023-11-24T08:07:12.768 DEBUG:teuthology.orchestra.run.smithi183:> import re 2023-11-24T08:07:12.768 DEBUG:teuthology.orchestra.run.smithi183:> import os 2023-11-24T08:07:12.769 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2023-11-24T08:07:12.769 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:12.769 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2023-11-24T08:07:12.769 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T08:07:12.769 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2023-11-24T08:07:12.770 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T08:07:12.770 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:12.770 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2023-11-24T08:07:12.771 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2023-11-24T08:07:12.771 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2023-11-24T08:07:12.771 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2023-11-24T08:07:12.771 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:12.771 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2023-11-24T08:07:12.772 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:07:12.772 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:07:12.772 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:07:12.772 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2023-11-24T08:07:12.772 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2023-11-24T08:07:12.773 DEBUG:teuthology.orchestra.run.smithi183:> return f 2023-11-24T08:07:12.773 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:07:12.773 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:12.773 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2023-11-24T08:07:12.773 DEBUG:teuthology.orchestra.run.smithi183:> ' 2023-11-24T08:07:12.962 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.94054.asok 2023-11-24T08:07:12.966 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:07:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:07:12.979 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.94054.asok 2023-11-24T08:07:12.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:12.979 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.94054.asok status 2023-11-24T08:07:13.218 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-11-24T08:07:13.219 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2023-11-24T08:07:13.219 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:07:13.219 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:07:13.219 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "1", 2023-11-24T08:07:13.220 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2023-11-24T08:07:13.220 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T08:07:13.220 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "94054", 2023-11-24T08:07:13.220 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2023-11-24T08:07:13.221 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:13.221 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2023-11-24T08:07:13.221 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2023-11-24T08:07:13.221 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4430, 2023-11-24T08:07:13.222 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2023-11-24T08:07:13.222 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2023-11-24T08:07:13.222 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2023-11-24T08:07:13.222 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4430 2023-11-24T08:07:13.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:13.223 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2023-11-24T08:07:13.223 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2023-11-24T08:07:13.223 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:07:13.224 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 3555109219 2023-11-24T08:07:13.224 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-11-24T08:07:13.224 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:13.224 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2023-11-24T08:07:13.224 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2023-11-24T08:07:13.225 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:07:13.225 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 3555109219 2023-11-24T08:07:13.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:13.225 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4430 192.168.0.1:0/3555109219", 2023-11-24T08:07:13.226 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.1:0/3555109219", 2023-11-24T08:07:13.226 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2023-11-24T08:07:13.226 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 8, 2023-11-24T08:07:13.226 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 22, 2023-11-24T08:07:13.226 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:07:13.226 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2023-11-24T08:07:13.226 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2023-11-24T08:07:13.227 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-11-24T08:07:13.233 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:13.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.456+0000 7f17ed2b4640 1 Processor -- start 2023-11-24T08:07:13.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.456+0000 7f17ed2b4640 1 -- start start 2023-11-24T08:07:13.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.458+0000 7f17ed2b4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17e80b3ae0 0x7f17e815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.458+0000 7f17ed2b4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f17e80cf290 0x7f17e80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.458+0000 7f17ed2b4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e8070c40 con 0x7f17e80ae5a0 2023-11-24T08:07:13.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.458+0000 7f17ed2b4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e8071450 con 0x7f17e80b3ae0 2023-11-24T08:07:13.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.458+0000 7f17ed2b4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e80cfc60 con 0x7f17e80cf290 2023-11-24T08:07:13.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17e6ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f17e80ae5a0 0x7f17e806cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49460/0 (socket says 172.21.15.97:49460) 2023-11-24T08:07:13.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17e6ffd640 1 -- 172.21.15.97:0/3623765087 learned_addr learned my addr 172.21.15.97:0/3623765087 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:13.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17de7fc640 1 --2- 172.21.15.97:0/3623765087 >> v2:172.21.15.97:3300/0 conn(0x7f17e80b3ae0 0x7f17e815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17e77fe640 1 --2- 172.21.15.97:0/3623765087 >> v2:172.21.15.183:3300/0 conn(0x7f17e80cf290 0x7f17e80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17e67fc640 1 -- 172.21.15.97:0/3623765087 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725472486 0 0) 0x7f17e8070c40 con 0x7f17e80ae5a0 2023-11-24T08:07:13.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17e67fc640 1 -- 172.21.15.97:0/3623765087 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d4003520 con 0x7f17e80ae5a0 2023-11-24T08:07:13.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17de7fc640 1 -- 172.21.15.97:0/3623765087 >> v2:172.21.15.183:3300/0 conn(0x7f17e80cf290 msgr2=0x7f17e80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:13.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17de7fc640 1 --2- 172.21.15.97:0/3623765087 >> v2:172.21.15.183:3300/0 conn(0x7f17e80cf290 0x7f17e80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17de7fc640 1 -- 172.21.15.97:0/3623765087 >> v1:172.21.15.97:6789/0 conn(0x7f17e80ae5a0 legacy=0x7f17e806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.459+0000 7f17de7fc640 1 -- 172.21.15.97:0/3623765087 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e806c470 con 0x7f17e80b3ae0 2023-11-24T08:07:13.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.461+0000 7f17de7fc640 1 --2- 172.21.15.97:0/3623765087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80b3ae0 0x7f17e815e430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f17e80b3f70 tx=0x7f17d002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcac67e9c3069cf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.461+0000 7f17e67fc640 1 -- 172.21.15.97:0/3623765087 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0030610 con 0x7f17e80b3ae0 2023-11-24T08:07:13.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.461+0000 7f17e67fc640 1 -- 172.21.15.97:0/3623765087 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d0030770 con 0x7f17e80b3ae0 2023-11-24T08:07:13.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.461+0000 7f17e67fc640 1 -- 172.21.15.97:0/3623765087 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0030b00 con 0x7f17e80b3ae0 2023-11-24T08:07:13.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.461+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3623765087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80b3ae0 msgr2=0x7f17e815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.461+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3623765087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80b3ae0 0x7f17e815e430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f17e80b3f70 tx=0x7f17d002b960 comp rx=0 tx=0).stop 2023-11-24T08:07:13.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.462+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3623765087 shutdown_connections 2023-11-24T08:07:13.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.462+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3623765087 >> v2:172.21.15.183:3300/0 conn(0x7f17e80cf290 0x7f17e80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.462+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3623765087 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80b3ae0 0x7f17e815e430 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.462+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3623765087 >> 172.21.15.97:0/3623765087 conn(0x7f17e806a800 msgr2=0x7f17e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.462+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3623765087 shutdown_connections 2023-11-24T08:07:13.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.462+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3623765087 wait complete. 2023-11-24T08:07:13.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.463+0000 7f17ed2b4640 1 Processor -- start 2023-11-24T08:07:13.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.464+0000 7f17ed2b4640 1 -- start start 2023-11-24T08:07:13.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.464+0000 7f17ed2b4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80ae5a0 0x7f17e8148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.464+0000 7f17ed2b4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e80b3ae0 0x7f17e814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.464+0000 7f17ed2b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17e80cf290 0x7f17e8147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.464+0000 7f17ed2b4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e814b5e0 con 0x7f17e80ae5a0 2023-11-24T08:07:13.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.464+0000 7f17ed2b4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8148be0 con 0x7f17e80b3ae0 2023-11-24T08:07:13.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.464+0000 7f17ed2b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8148ec0 con 0x7f17e80cf290 2023-11-24T08:07:13.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80ae5a0 0x7f17e8148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80ae5a0 0x7f17e8148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:54852/0 (socket says 172.21.15.97:54852) 2023-11-24T08:07:13.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 -- 172.21.15.97:0/3838987336 learned_addr learned my addr 172.21.15.97:0/3838987336 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:13.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 -- 172.21.15.97:0/3838987336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17e80cf290 msgr2=0x7f17e8147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17e80cf290 0x7f17e8147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 -- 172.21.15.97:0/3838987336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e80b3ae0 msgr2=0x7f17e814b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17de7fc640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e80b3ae0 0x7f17e814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e80b3ae0 0x7f17e814b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.465+0000 7f17e6ffd640 1 -- 172.21.15.97:0/3838987336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0009400 con 0x7f17e80ae5a0 2023-11-24T08:07:13.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.466+0000 7f17e6ffd640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80ae5a0 0x7f17e8148600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c500 tx=0x7f17d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.466+0000 7f17dffff640 1 -- 172.21.15.97:0/3838987336 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8005ce0 con 0x7f17e80ae5a0 2023-11-24T08:07:13.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.466+0000 7f17dffff640 1 -- 172.21.15.97:0/3838987336 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8005e40 con 0x7f17e80ae5a0 2023-11-24T08:07:13.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.466+0000 7f17dffff640 1 -- 172.21.15.97:0/3838987336 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8007330 con 0x7f17e80ae5a0 2023-11-24T08:07:13.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.466+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e81491a0 con 0x7f17e80ae5a0 2023-11-24T08:07:13.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.466+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e8149760 con 0x7f17e80ae5a0 2023-11-24T08:07:13.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.467+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e80675d0 con 0x7f17e80ae5a0 2023-11-24T08:07:13.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.468+0000 7f17dffff640 1 -- 172.21.15.97:0/3838987336 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17d8007550 con 0x7f17e80ae5a0 2023-11-24T08:07:13.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.469+0000 7f17dffff640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f17c806ae40 0x7f17c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.469+0000 7f17dffff640 1 -- 172.21.15.97:0/3838987336 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17d8088cc0 con 0x7f17e80ae5a0 2023-11-24T08:07:13.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.469+0000 7f17de7fc640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f17c806ae40 0x7f17c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.470+0000 7f17de7fc640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f17c806ae40 0x7f17c806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f17d0036000 tx=0x7f17d003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.473+0000 7f17dffff640 1 -- 172.21.15.97:0/3838987336 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17d808f080 con 0x7f17e80ae5a0 2023-11-24T08:07:13.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.704+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f17e80cb620 con 0x7f17e80ae5a0 2023-11-24T08:07:13.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.705+0000 7f17dffff640 1 -- 172.21.15.97:0/3838987336 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f17d8017020 con 0x7f17e80ae5a0 2023-11-24T08:07:13.707 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:13.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f17c806ae40 msgr2=0x7f17c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f17c806ae40 0x7f17c806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f17d0036000 tx=0x7f17d003b040 comp rx=0 tx=0).stop 2023-11-24T08:07:13.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80ae5a0 msgr2=0x7f17e8148600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80ae5a0 0x7f17e8148600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c500 tx=0x7f17d800c9c0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 shutdown_connections 2023-11-24T08:07:13.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f17c806ae40 0x7f17c806d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17e80cf290 0x7f17e8147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e80b3ae0 0x7f17e814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 --2- 172.21.15.97:0/3838987336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17e80ae5a0 0x7f17e8148600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.707+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 >> 172.21.15.97:0/3838987336 conn(0x7f17e806a800 msgr2=0x7f17e80b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.708+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 shutdown_connections 2023-11-24T08:07:13.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:13.708+0000 7f17ed2b4640 1 -- 172.21.15.97:0/3838987336 wait complete. 2023-11-24T08:07:13.726 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:07:13.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:13.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-24T08:07:13.727 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T08:07:13.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:13.727 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:07:13.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:07:13.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:13.727 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:07:13.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:13.729 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-24T08:07:13.786 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:13.787 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:13.787 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:13.787 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:13.787 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:13.787 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:13.787 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-11-24T08:07:13.788 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:3c:1c:3e:13:f8 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::3808:39ff:fe81:add4/64 scope link 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:3c:1c:3e:13:f8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::3c:1cff:fe3e:13f8/64 scope link 2023-11-24T08:07:13.789 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:13.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:13.790 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:13.874 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-24T08:07:13.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:13.878 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-24T08:07:13.934 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-24T08:07:13.934 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:13.934 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:07:13.934 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:07:13.934 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:13.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:13.935 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:13.935 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:13.935 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:07:13.935 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:07:13.935 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:07:13.935 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:14.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:14.117 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-24T08:07:14.167 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:07:14.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:14.168 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2023-11-24T08:07:14.216 INFO:teuthology.orchestra.run.smithi183.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T08:07:14.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:14.217 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:14.217 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:14.217 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:14.218 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T08:07:14.218 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:14.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:14.359 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:d6:32:9d:b8:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:07:14.445 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.446 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::d6:32ff:fe9d:b828/64 scope link 2023-11-24T08:07:14.446 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:14.449 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:07:14.542 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:14.542 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:14.542 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:14.542 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.542 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:14.542 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.542 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:14.543 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:d6:32:9d:b8:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:07:14.543 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:07:14.543 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.543 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::d6:32ff:fe9d:b828/64 scope link 2023-11-24T08:07:14.543 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:14.546 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T08:07:14.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:14.546 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:14.546 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:14.547 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T08:07:14.547 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:07:14.547 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T08:07:14.547 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T08:07:14.547 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T08:07:14.547 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:14.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:14.831 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:07:14.831 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:07:14.831 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.1 up 2023-11-24T08:07:14.831 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:07:14.831 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:07:14.985 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-24T08:07:14.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:14.986 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:15.032 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:07:15.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:15.032 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:15.127 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2023-11-24T08:07:15.222 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2023-11-24T08:07:15.279 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2023-11-24T08:07:15.280 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:15.281 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:15.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:15.282 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2023-11-24T08:07:15.330 INFO:teuthology.orchestra.run.smithi183.stdout:41 2023-11-24T08:07:15.331 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-24T08:07:15.331 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-24T08:07:15.336 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2023-11-24T08:07:15.413 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:07:15.455 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2023-11-24T08:07:15.456 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:07:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:15.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:15.460 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2023-11-24T08:07:15.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi183.stderr:2023-11-24T08:07:15.515+0000 7f2a27a50480 -1 init, newargv = 0x55aef5315a70 newargc=15 2023-11-24T08:07:15.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi183.stderr:ceph-fuse[94508]: starting ceph client 2023-11-24T08:07:15.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi183.stderr:ceph-fuse[94508]: starting fuse 2023-11-24T08:07:15.546 INFO:teuthology.orchestra.run.smithi183.stdout:41 2023-11-24T08:07:15.547 INFO:teuthology.orchestra.run.smithi183.stdout:42 2023-11-24T08:07:15.547 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 42] 2023-11-24T08:07:15.547 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:07:15.547 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2023-11-24T08:07:15.547 DEBUG:teuthology.orchestra.run.smithi183:> import re 2023-11-24T08:07:15.547 DEBUG:teuthology.orchestra.run.smithi183:> import os 2023-11-24T08:07:15.547 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2023-11-24T08:07:15.547 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:07:15.548 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> return f 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.3")) 2023-11-24T08:07:15.549 DEBUG:teuthology.orchestra.run.smithi183:> ' 2023-11-24T08:07:15.747 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.3.94508.asok 2023-11-24T08:07:15.751 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:07:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:07:15.764 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94508.asok 2023-11-24T08:07:15.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:15.764 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.94508.asok status 2023-11-24T08:07:16.003 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-11-24T08:07:16.003 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2023-11-24T08:07:16.003 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:07:16.003 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "3", 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "94508", 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4588, 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2023-11-24T08:07:16.004 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4588 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 3635643332 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2023-11-24T08:07:16.005 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 3635643332 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4588 192.168.0.2:0/3635643332", 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.2:0/3635643332", 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 8, 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 22, 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2023-11-24T08:07:16.006 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-11-24T08:07:16.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.018 DEBUG:teuthology.orchestra.run.smithi097:> stat --file-system '--printf=%T 2023-11-24T08:07:16.018 DEBUG:teuthology.orchestra.run.smithi097:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:16.080 INFO:teuthology.orchestra.run.smithi097.stdout:fuseblk 2023-11-24T08:07:16.081 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:16.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.081 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:16.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.178 DEBUG:teuthology.orchestra.run.smithi097:> stat --file-system '--printf=%T 2023-11-24T08:07:16.178 DEBUG:teuthology.orchestra.run.smithi097:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:16.231 INFO:teuthology.orchestra.run.smithi097.stdout:fuseblk 2023-11-24T08:07:16.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:16.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:16.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.384 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2023-11-24T08:07:16.384 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:16.442 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2023-11-24T08:07:16.443 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:16.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.443 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:16.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.537 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2023-11-24T08:07:16.537 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:16.591 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2023-11-24T08:07:16.591 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:16.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:16.591 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:16.689 INFO:teuthology.run_tasks:Running task check-counter... 2023-11-24T08:07:16.701 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T08:07:16.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:16.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.946+0000 7f01a7494640 1 Processor -- start 2023-11-24T08:07:16.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.946+0000 7f01a7494640 1 -- start start 2023-11-24T08:07:16.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.948+0000 7f01a7494640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f01a00ae5a0 0x7f01a015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.948+0000 7f01a7494640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a0070c40 con 0x7f01a00b3ae0 2023-11-24T08:07:16.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.948+0000 7f01a7494640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a006c470 con 0x7f01a00cf290 2023-11-24T08:07:16.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.948+0000 7f01a7494640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a0071450 con 0x7f01a00ae5a0 2023-11-24T08:07:16.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.948+0000 7f01a4a2f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f01a00b3ae0 0x7f01a006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54032/0 (socket says 172.21.15.97:54032) 2023-11-24T08:07:16.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.948+0000 7f01a4a2f640 1 -- 172.21.15.97:0/1531799844 learned_addr learned my addr 172.21.15.97:0/1531799844 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:16.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f01a5230640 1 --2- 172.21.15.97:0/1531799844 >> v2:172.21.15.183:3300/0 conn(0x7f01a00ae5a0 0x7f01a015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112797600 0 0) 0x7f01a0070c40 con 0x7f01a00b3ae0 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f018c003520 con 0x7f01a00b3ae0 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627072924 0 0) 0x7f018c003520 con 0x7f01a00b3ae0 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 >> v2:172.21.15.183:3300/0 conn(0x7f01a00ae5a0 msgr2=0x7f01a015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 --2- 172.21.15.97:0/1531799844 >> v2:172.21.15.183:3300/0 conn(0x7f01a00ae5a0 0x7f01a015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 >> v1:172.21.15.183:6789/0 conn(0x7f01a00cf290 legacy=0x7f01a00b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a006c750 con 0x7f01a00b3ae0 2023-11-24T08:07:16.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f0190001670 con 0x7f01a00b3ae0 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 >> v1:172.21.15.97:6789/0 conn(0x7f01a00b3ae0 legacy=0x7f01a006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f018c003970 0x7f018c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f018c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018c005180 0x7f018c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a0071450 con 0x7f018c0047c0 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c00c030 con 0x7f018c005180 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.949+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c00c1f0 con 0x7f018c003970 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a4a2f640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f018c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a5a31640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018c005180 0x7f018c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a4a2f640 1 -- 172.21.15.97:0/1531799844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f018c003970 msgr2=0x7f018c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:16.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a4a2f640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f018c003970 0x7f018c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a4a2f640 1 -- 172.21.15.97:0/1531799844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018c005180 msgr2=0x7f018c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:16.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a4a2f640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f018c005180 0x7f018c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a4a2f640 1 -- 172.21.15.97:0/1531799844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c003520 con 0x7f018c0047c0 2023-11-24T08:07:16.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.950+0000 7f01a5a31640 1 -- 172.21.15.97:0/1531799844 reap_dead start 2023-11-24T08:07:16.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.951+0000 7f01a4a2f640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f018c004c40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f019000c210 tx=0x7f018c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe33a8e96a9eed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.951+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190005ad0 con 0x7f018c0047c0 2023-11-24T08:07:16.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.951+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0190005c30 con 0x7f018c0047c0 2023-11-24T08:07:16.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.951+0000 7f0197fff640 1 -- 172.21.15.97:0/1531799844 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019002cad0 con 0x7f018c0047c0 2023-11-24T08:07:16.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.952+0000 7f01a7494640 1 -- 172.21.15.97:0/1531799844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 msgr2=0x7f018c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.952+0000 7f01a7494640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f018c004c40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f019000c210 tx=0x7f018c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.952+0000 7f01a7494640 1 -- 172.21.15.97:0/1531799844 shutdown_connections 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.952+0000 7f01a7494640 1 --2- 172.21.15.97:0/1531799844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f018c004c40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.952+0000 7f01a7494640 1 -- 172.21.15.97:0/1531799844 >> 172.21.15.97:0/1531799844 conn(0x7f01a006a800 msgr2=0x7f01a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.952+0000 7f01a7494640 1 -- 172.21.15.97:0/1531799844 shutdown_connections 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.952+0000 7f01a7494640 1 -- 172.21.15.97:0/1531799844 wait complete. 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.954+0000 7f01a7494640 1 Processor -- start 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.954+0000 7f01a7494640 1 -- start start 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a7494640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f01a00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a7494640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a0160330 0x7f01a015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a7494640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a014f530 0x7f01a00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a7494640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a015f060 con 0x7f018c0047c0 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a7494640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a014ff60 con 0x7f01a014f530 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a7494640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a015fea0 con 0x7f01a0160330 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a5230640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f01a00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a5230640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f01a00ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35972/0 (socket says 172.21.15.97:35972) 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.955+0000 7f01a5230640 1 -- 172.21.15.97:0/804628592 learned_addr learned my addr 172.21.15.97:0/804628592 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a5230640 1 -- 172.21.15.97:0/804628592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a0160330 msgr2=0x7f01a015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a5230640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a0160330 0x7f01a015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a5a31640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a014f530 0x7f01a00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a5230640 1 -- 172.21.15.97:0/804628592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a014f530 msgr2=0x7f01a00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a5230640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a014f530 0x7f01a00cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a5230640 1 -- 172.21.15.97:0/804628592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a015f290 con 0x7f018c0047c0 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a5230640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f01a00ce620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f019c00ef70 tx=0x7f019c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f0195ffb640 1 -- 172.21.15.97:0/804628592 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c00ced0 con 0x7f018c0047c0 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f0195ffb640 1 -- 172.21.15.97:0/804628592 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c00f040 con 0x7f018c0047c0 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f0195ffb640 1 -- 172.21.15.97:0/804628592 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c0146c0 con 0x7f018c0047c0 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a015f570 con 0x7f018c0047c0 2023-11-24T08:07:16.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.956+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a015fb30 con 0x7f018c0047c0 2023-11-24T08:07:16.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.957+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a00675d0 con 0x7f018c0047c0 2023-11-24T08:07:16.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.958+0000 7f0195ffb640 1 -- 172.21.15.97:0/804628592 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f019c014820 con 0x7f018c0047c0 2023-11-24T08:07:16.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.959+0000 7f0195ffb640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f018406ae40 0x7f018406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.959+0000 7f0195ffb640 1 -- 172.21.15.97:0/804628592 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f019c08a3c0 con 0x7f018c0047c0 2023-11-24T08:07:16.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.959+0000 7f01a4a2f640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f018406ae40 0x7f018406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.960+0000 7f01a4a2f640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f018406ae40 0x7f018406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0190034000 tx=0x7f0190039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:16.963+0000 7f0195ffb640 1 -- 172.21.15.97:0/804628592 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f019c055460 con 0x7f018c0047c0 2023-11-24T08:07:17.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.157+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01a0071e70 con 0x7f018c0047c0 2023-11-24T08:07:17.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.160+0000 7f0195ffb640 1 -- 172.21.15.97:0/804628592 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f019c058a80 con 0x7f018c0047c0 2023-11-24T08:07:17.162 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:17.162 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:17.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.162+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f018406ae40 msgr2=0x7f018406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f018406ae40 0x7f018406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0190034000 tx=0x7f0190039040 comp rx=0 tx=0).stop 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 msgr2=0x7f01a00ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f01a00ce620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f019c00ef70 tx=0x7f019c00c490 comp rx=0 tx=0).stop 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 shutdown_connections 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f018406ae40 0x7f018406d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a014f530 0x7f01a00cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a0160330 0x7f01a015eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 --2- 172.21.15.97:0/804628592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f018c0047c0 0x7f01a00ce620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 >> 172.21.15.97:0/804628592 conn(0x7f01a006a800 msgr2=0x7f01a006cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 shutdown_connections 2023-11-24T08:07:17.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.163+0000 7f01a7494640 1 -- 172.21.15.97:0/804628592 wait complete. 2023-11-24T08:07:17.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:17.185 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:17.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.400+0000 7f72f2c83640 1 Processor -- start 2023-11-24T08:07:17.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.400+0000 7f72f2c83640 1 -- start start 2023-11-24T08:07:17.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.401+0000 7f72f2c83640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f72ec0cf9a0 0x7f72ec166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.401+0000 7f72f2c83640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec15c5f0 con 0x7f72ec13df80 2023-11-24T08:07:17.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72f2c83640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec06c470 con 0x7f72ec13e360 2023-11-24T08:07:17.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72f2c83640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec06c750 con 0x7f72ec0cf9a0 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72f0a1f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f72ec13df80 0x7f72ec15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54040/0 (socket says 172.21.15.97:54040) 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72f0a1f640 1 -- 172.21.15.97:0/4005914555 learned_addr learned my addr 172.21.15.97:0/4005914555 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72f1220640 1 --2- 172.21.15.97:0/4005914555 >> v2:172.21.15.183:3300/0 conn(0x7f72ec0cf9a0 0x7f72ec166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740981641 0 0) 0x7f72ec15c5f0 con 0x7f72ec13df80 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72dc003520 con 0x7f72ec13df80 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119931539 0 0) 0x7f72dc003520 con 0x7f72ec13df80 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.402+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 >> v2:172.21.15.183:3300/0 conn(0x7f72ec0cf9a0 msgr2=0x7f72ec166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 --2- 172.21.15.97:0/4005914555 >> v2:172.21.15.183:3300/0 conn(0x7f72ec0cf9a0 0x7f72ec166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 >> v1:172.21.15.183:6789/0 conn(0x7f72ec13e360 legacy=0x7f72ec0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec06ca30 con 0x7f72ec13df80 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f72e0001670 con 0x7f72ec13df80 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 >> v1:172.21.15.97:6789/0 conn(0x7f72ec13df80 legacy=0x7f72ec15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc003970 0x7f72dc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72dc0047c0 0x7f72dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec06c750 con 0x7f72dc005180 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc00c000 con 0x7f72dc003970 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc00c1c0 con 0x7f72dc0047c0 2023-11-24T08:07:17.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72f1220640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72f0a1f640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc003970 0x7f72dc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72f1220640 1 -- 172.21.15.97:0/4005914555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72dc0047c0 msgr2=0x7f72dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72f1220640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72dc0047c0 0x7f72dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72f1220640 1 -- 172.21.15.97:0/4005914555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc003970 msgr2=0x7f72dc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72f1220640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc003970 0x7f72dc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.403+0000 7f72f1220640 1 -- 172.21.15.97:0/4005914555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc003520 con 0x7f72dc005180 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.404+0000 7f72f1220640 1 -- 172.21.15.97:0/4005914555 reap_dead start 2023-11-24T08:07:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72f1220640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72dc00b980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009f90 tx=0x7f72dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617dcf7e0f8d20ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e402cc20 con 0x7f72dc005180 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e400f040 con 0x7f72dc005180 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72eb7fe640 1 -- 172.21.15.97:0/4005914555 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4003990 con 0x7f72dc005180 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72f2c83640 1 -- 172.21.15.97:0/4005914555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 msgr2=0x7f72dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72f2c83640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72dc00b980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009f90 tx=0x7f72dc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72f2c83640 1 -- 172.21.15.97:0/4005914555 shutdown_connections 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72f2c83640 1 --2- 172.21.15.97:0/4005914555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72dc00b980 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.405+0000 7f72f2c83640 1 -- 172.21.15.97:0/4005914555 >> 172.21.15.97:0/4005914555 conn(0x7f72ec06a800 msgr2=0x7f72ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.406+0000 7f72f2c83640 1 -- 172.21.15.97:0/4005914555 shutdown_connections 2023-11-24T08:07:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.406+0000 7f72f2c83640 1 -- 172.21.15.97:0/4005914555 wait complete. 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.407+0000 7f72f2c83640 1 Processor -- start 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.408+0000 7f72f2c83640 1 -- start start 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.408+0000 7f72f2c83640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72ec131f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f2c83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72ec071820 0x7f72ec0aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f2c83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72ec0ab1f0 0x7f72ec1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f2c83640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0ab680 con 0x7f72dc005180 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f2c83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec1324c0 con 0x7f72ec071820 2023-11-24T08:07:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f2c83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0ad100 con 0x7f72ec0ab1f0 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72ec131f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72ec131f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36002/0 (socket says 172.21.15.97:36002) 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 -- 172.21.15.97:0/1465589567 learned_addr learned my addr 172.21.15.97:0/1465589567 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 -- 172.21.15.97:0/1465589567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72ec0ab1f0 msgr2=0x7f72ec1f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72ec0ab1f0 0x7f72ec1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 -- 172.21.15.97:0/1465589567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72ec071820 msgr2=0x7f72ec0aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72ec071820 0x7f72ec0aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 -- 172.21.15.97:0/1465589567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0ad3e0 con 0x7f72dc005180 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.409+0000 7f72f0a1f640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72ec131f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f72e000e7b0 tx=0x7f72e000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.410+0000 7f72e97fa640 1 -- 172.21.15.97:0/1465589567 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000eec0 con 0x7f72dc005180 2023-11-24T08:07:17.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.410+0000 7f72e97fa640 1 -- 172.21.15.97:0/1465589567 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e000c8d0 con 0x7f72dc005180 2023-11-24T08:07:17.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.410+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec0ad6c0 con 0x7f72dc005180 2023-11-24T08:07:17.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.410+0000 7f72e97fa640 1 -- 172.21.15.97:0/1465589567 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000cc60 con 0x7f72dc005180 2023-11-24T08:07:17.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.410+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec0adc80 con 0x7f72dc005180 2023-11-24T08:07:17.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.411+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec0ade40 con 0x7f72dc005180 2023-11-24T08:07:17.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.412+0000 7f72e97fa640 1 -- 172.21.15.97:0/1465589567 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72e001d460 con 0x7f72dc005180 2023-11-24T08:07:17.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.413+0000 7f72e97fa640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72d006ae70 0x7f72d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.413+0000 7f72e97fa640 1 -- 172.21.15.97:0/1465589567 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72e00895b0 con 0x7f72dc005180 2023-11-24T08:07:17.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.413+0000 7f72ebfff640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72d006ae70 0x7f72d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.414+0000 7f72ebfff640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72d006ae70 0x7f72d006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0cc790 tx=0x7f72d80079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.417+0000 7f72e97fa640 1 -- 172.21.15.97:0/1465589567 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72e0054660 con 0x7f72dc005180 2023-11-24T08:07:17.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.608+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72ec0675d0 con 0x7f72dc005180 2023-11-24T08:07:17.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.609+0000 7f72e97fa640 1 -- 172.21.15.97:0/1465589567 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72e0057c80 con 0x7f72dc005180 2023-11-24T08:07:17.610 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:17.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.611+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72d006ae70 msgr2=0x7f72d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.611+0000 7f72f2c83640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72d006ae70 0x7f72d006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0cc790 tx=0x7f72d80079b0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.611+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 msgr2=0x7f72ec131f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.611+0000 7f72f2c83640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72ec131f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f72e000e7b0 tx=0x7f72e000ec70 comp rx=0 tx=0).stop 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 shutdown_connections 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72d006ae70 0x7f72d006d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72ec0ab1f0 0x7f72ec1f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72ec071820 0x7f72ec0aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 --2- 172.21.15.97:0/1465589567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc005180 0x7f72ec131f80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 >> 172.21.15.97:0/1465589567 conn(0x7f72ec06a800 msgr2=0x7f72ec15c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 shutdown_connections 2023-11-24T08:07:17.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.612+0000 7f72f2c83640 1 -- 172.21.15.97:0/1465589567 wait complete. 2023-11-24T08:07:17.631 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:17.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.839+0000 7ff4da7ec640 1 Processor -- start 2023-11-24T08:07:17.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.839+0000 7ff4da7ec640 1 -- start start 2023-11-24T08:07:17.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.840+0000 7ff4da7ec640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff4d40cd240 0x7ff4d40b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.840+0000 7ff4da7ec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff4d406c6b0 0x7ff4d4099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.841+0000 7ff4da7ec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d406cea0 con 0x7ff4d4099fa0 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.841+0000 7ff4da7ec640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d409a410 con 0x7ff4d40cd240 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.841+0000 7ff4da7ec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d406cbc0 con 0x7ff4d406c6b0 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.841+0000 7ff4d3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff4d40cd240 0x7ff4d40b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.841+0000 7ff4d3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff4d40cd240 0x7ff4d40b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36006/0 (socket says 172.21.15.97:36006) 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.841+0000 7ff4d3fff640 1 -- 172.21.15.97:0/4214327743 learned_addr learned my addr 172.21.15.97:0/4214327743 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:17.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.841+0000 7ff4cbfff640 1 --2- 172.21.15.97:0/4214327743 >> v2:172.21.15.183:3300/0 conn(0x7ff4d406c6b0 0x7ff4d4099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.842+0000 7ff4d3fff640 1 -- 172.21.15.97:0/4214327743 >> v2:172.21.15.183:3300/0 conn(0x7ff4d406c6b0 msgr2=0x7ff4d4099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.842+0000 7ff4d3fff640 1 --2- 172.21.15.97:0/4214327743 >> v2:172.21.15.183:3300/0 conn(0x7ff4d406c6b0 0x7ff4d4099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.842+0000 7ff4d3fff640 1 -- 172.21.15.97:0/4214327743 >> v1:172.21.15.183:6789/0 conn(0x7ff4d4099fa0 legacy=0x7ff4d406b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.842+0000 7ff4d3fff640 1 -- 172.21.15.97:0/4214327743 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d406f350 con 0x7ff4d40cd240 2023-11-24T08:07:17.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.843+0000 7ff4d3fff640 1 --2- 172.21.15.97:0/4214327743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d40cd240 0x7ff4d40b3820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4071800 tx=0x7ff4c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53dd4c8a7c57644 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4d37fe640 1 -- 172.21.15.97:0/4214327743 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4030860 con 0x7ff4d40cd240 2023-11-24T08:07:17.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4d37fe640 1 -- 172.21.15.97:0/4214327743 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c40309c0 con 0x7ff4d40cd240 2023-11-24T08:07:17.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4d37fe640 1 -- 172.21.15.97:0/4214327743 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4030d50 con 0x7ff4d40cd240 2023-11-24T08:07:17.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 -- 172.21.15.97:0/4214327743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d40cd240 msgr2=0x7ff4d40b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/4214327743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d40cd240 0x7ff4d40b3820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4071800 tx=0x7ff4c402b9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 -- 172.21.15.97:0/4214327743 shutdown_connections 2023-11-24T08:07:17.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/4214327743 >> v2:172.21.15.183:3300/0 conn(0x7ff4d406c6b0 0x7ff4d4099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/4214327743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d40cd240 0x7ff4d40b3820 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 -- 172.21.15.97:0/4214327743 >> 172.21.15.97:0/4214327743 conn(0x7ff4d40b2d00 msgr2=0x7ff4d40b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 -- 172.21.15.97:0/4214327743 shutdown_connections 2023-11-24T08:07:17.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.844+0000 7ff4da7ec640 1 -- 172.21.15.97:0/4214327743 wait complete. 2023-11-24T08:07:17.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.846+0000 7ff4da7ec640 1 Processor -- start 2023-11-24T08:07:17.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.846+0000 7ff4da7ec640 1 -- start start 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.847+0000 7ff4da7ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4d406c6b0 0x7ff4d4159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.847+0000 7ff4da7ec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d4099fa0 0x7ff4d40b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.847+0000 7ff4da7ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4d40cd240 0x7ff4d40aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.847+0000 7ff4da7ec640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40b6ae0 con 0x7ff4d4099fa0 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.847+0000 7ff4da7ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c9cd0 con 0x7ff4d40cd240 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.847+0000 7ff4da7ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40b5c50 con 0x7ff4d406c6b0 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.847+0000 7ff4cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d4099fa0 0x7ff4d40b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d4099fa0 0x7ff4d40b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36018/0 (socket says 172.21.15.97:36018) 2023-11-24T08:07:17.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 -- 172.21.15.97:0/3856332876 learned_addr learned my addr 172.21.15.97:0/3856332876 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4d3fff640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4d406c6b0 0x7ff4d4159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4d8d89640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4d40cd240 0x7ff4d40aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 -- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4d406c6b0 msgr2=0x7ff4d4159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4d406c6b0 0x7ff4d4159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 -- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4d40cd240 msgr2=0x7ff4d40aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4d40cd240 0x7ff4d40aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 -- 172.21.15.97:0/3856332876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40094d0 con 0x7ff4d4099fa0 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4d8d89640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4d40cd240 0x7ff4d40aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.848+0000 7ff4cbfff640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d4099fa0 0x7ff4d40b54f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00e870 tx=0x7ff4bc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.849+0000 7ff4d17fa640 1 -- 172.21.15.97:0/3856332876 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0094b0 con 0x7ff4d4099fa0 2023-11-24T08:07:17.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.849+0000 7ff4d17fa640 1 -- 172.21.15.97:0/3856332876 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00ee60 con 0x7ff4d4099fa0 2023-11-24T08:07:17.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.849+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40b6f00 con 0x7ff4d4099fa0 2023-11-24T08:07:17.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.849+0000 7ff4d17fa640 1 -- 172.21.15.97:0/3856332876 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00cb80 con 0x7ff4d4099fa0 2023-11-24T08:07:17.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.849+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40b5e60 con 0x7ff4d4099fa0 2023-11-24T08:07:17.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.850+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d40b6c20 con 0x7ff4d4099fa0 2023-11-24T08:07:17.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.851+0000 7ff4d17fa640 1 -- 172.21.15.97:0/3856332876 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4bc00cce0 con 0x7ff4d4099fa0 2023-11-24T08:07:17.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.852+0000 7ff4d17fa640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff4b406ae40 0x7ff4b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.852+0000 7ff4d17fa640 1 -- 172.21.15.97:0/3856332876 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4bc089770 con 0x7ff4d4099fa0 2023-11-24T08:07:17.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.852+0000 7ff4d3fff640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff4b406ae40 0x7ff4b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.853+0000 7ff4d3fff640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff4b406ae40 0x7ff4b406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4036000 tx=0x7ff4c403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:17.857+0000 7ff4d17fa640 1 -- 172.21.15.97:0/3856332876 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4d40b6c20 con 0x7ff4d4099fa0 2023-11-24T08:07:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.047+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4d40b6c20 con 0x7ff4d4099fa0 2023-11-24T08:07:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.048+0000 7ff4d17fa640 1 -- 172.21.15.97:0/3856332876 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4d40b6c20 con 0x7ff4d4099fa0 2023-11-24T08:07:18.050 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:18.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff4b406ae40 msgr2=0x7ff4b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff4b406ae40 0x7ff4b406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4036000 tx=0x7ff4c403b040 comp rx=0 tx=0).stop 2023-11-24T08:07:18.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d4099fa0 msgr2=0x7ff4d40b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d4099fa0 0x7ff4d40b54f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00e870 tx=0x7ff4bc00ed30 comp rx=0 tx=0).stop 2023-11-24T08:07:18.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 shutdown_connections 2023-11-24T08:07:18.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff4b406ae40 0x7ff4b406d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4d40cd240 0x7ff4d40aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4d4099fa0 0x7ff4d40b54f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 --2- 172.21.15.97:0/3856332876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4d406c6b0 0x7ff4d4159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 >> 172.21.15.97:0/3856332876 conn(0x7ff4d40b2d00 msgr2=0x7ff4d40cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 shutdown_connections 2023-11-24T08:07:18.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.051+0000 7ff4da7ec640 1 -- 172.21.15.97:0/3856332876 wait complete. 2023-11-24T08:07:18.071 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:18.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.274+0000 7f872e2ad640 1 Processor -- start 2023-11-24T08:07:18.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.274+0000 7f872e2ad640 1 -- start start 2023-11-24T08:07:18.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.275+0000 7f872e2ad640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f87280adf20 0x7f8728070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.275+0000 7f872e2ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f872815bf10 0x7f87280cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.275+0000 7f872e2ad640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87280cc980 0x7f8728143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.275+0000 7f872e2ad640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872815f970 con 0x7f87280cc980 2023-11-24T08:07:18.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.275+0000 7f872e2ad640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872815f4e0 con 0x7f87280adf20 2023-11-24T08:07:18.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.275+0000 7f872e2ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280cce10 con 0x7f872815bf10 2023-11-24T08:07:18.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87280cc980 0x7f8728143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87280cc980 0x7f8728143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36032/0 (socket says 172.21.15.97:36032) 2023-11-24T08:07:18.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 -- 172.21.15.97:0/84166204 learned_addr learned my addr 172.21.15.97:0/84166204 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872caaa640 1 --2- 172.21.15.97:0/84166204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f872815bf10 0x7f87280cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 -- 172.21.15.97:0/84166204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f872815bf10 msgr2=0x7f87280cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 --2- 172.21.15.97:0/84166204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f872815bf10 0x7f87280cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 -- 172.21.15.97:0/84166204 >> v2:172.21.15.183:3300/0 conn(0x7f87280adf20 msgr2=0x7f8728070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872d2ab640 1 --2- 172.21.15.97:0/84166204 >> v2:172.21.15.183:3300/0 conn(0x7f87280adf20 0x7f8728070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 --2- 172.21.15.97:0/84166204 >> v2:172.21.15.183:3300/0 conn(0x7f87280adf20 0x7f8728070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872daac640 1 -- 172.21.15.97:0/84166204 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728071130 con 0x7f87280cc980 2023-11-24T08:07:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872caaa640 1 --2- 172.21.15.97:0/84166204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f872815bf10 0x7f87280cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.276+0000 7f872d2ab640 1 --2- 172.21.15.97:0/84166204 >> v2:172.21.15.183:3300/0 conn(0x7f87280adf20 0x7f8728070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.277+0000 7f872daac640 1 --2- 172.21.15.97:0/84166204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87280cc980 0x7f8728143d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f87280b4150 tx=0x7f872002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bcee6ab49ebb7e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f871ffff640 1 -- 172.21.15.97:0/84166204 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872002c9f0 con 0x7f87280cc980 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f871ffff640 1 -- 172.21.15.97:0/84166204 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872002cb50 con 0x7f87280cc980 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f871ffff640 1 -- 172.21.15.97:0/84166204 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200343f0 con 0x7f87280cc980 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 -- 172.21.15.97:0/84166204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87280cc980 msgr2=0x7f8728143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 --2- 172.21.15.97:0/84166204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87280cc980 0x7f8728143d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f87280b4150 tx=0x7f872002be50 comp rx=0 tx=0).stop 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 -- 172.21.15.97:0/84166204 shutdown_connections 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 --2- 172.21.15.97:0/84166204 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87280cc980 0x7f8728143d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 --2- 172.21.15.97:0/84166204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f872815bf10 0x7f87280cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 --2- 172.21.15.97:0/84166204 >> v2:172.21.15.183:3300/0 conn(0x7f87280adf20 0x7f8728070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 -- 172.21.15.97:0/84166204 >> 172.21.15.97:0/84166204 conn(0x7f872806a7d0 msgr2=0x7f872806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 -- 172.21.15.97:0/84166204 shutdown_connections 2023-11-24T08:07:18.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.278+0000 7f872e2ad640 1 -- 172.21.15.97:0/84166204 wait complete. 2023-11-24T08:07:18.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.280+0000 7f872e2ad640 1 Processor -- start 2023-11-24T08:07:18.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.280+0000 7f872e2ad640 1 -- start start 2023-11-24T08:07:18.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.281+0000 7f872e2ad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87280adf20 0x7f87281424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.281+0000 7f872e2ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87280cc980 0x7f87280b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.281+0000 7f872e2ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f872815bf10 0x7f87280713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.281+0000 7f872e2ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87281429f0 con 0x7f872815bf10 2023-11-24T08:07:18.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.281+0000 7f872e2ad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c9a00 con 0x7f87280adf20 2023-11-24T08:07:18.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.281+0000 7f872e2ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c9ca0 con 0x7f87280cc980 2023-11-24T08:07:18.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f872815bf10 0x7f87280713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f872815bf10 0x7f87280713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36044/0 (socket says 172.21.15.97:36044) 2023-11-24T08:07:18.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 -- 172.21.15.97:0/290553848 learned_addr learned my addr 172.21.15.97:0/290553848 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872d2ab640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87280adf20 0x7f87281424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 -- 172.21.15.97:0/290553848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87280cc980 msgr2=0x7f87280b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87280cc980 0x7f87280b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 -- 172.21.15.97:0/290553848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87280adf20 msgr2=0x7f87281424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87280adf20 0x7f87281424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 -- 172.21.15.97:0/290553848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720009b30 con 0x7f872815bf10 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.282+0000 7f872daac640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f872815bf10 0x7f87280713c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8720009f40 tx=0x7f8720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.283+0000 7f871dffb640 1 -- 172.21.15.97:0/290553848 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720009510 con 0x7f872815bf10 2023-11-24T08:07:18.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.283+0000 7f871dffb640 1 -- 172.21.15.97:0/290553848 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872003e450 con 0x7f872815bf10 2023-11-24T08:07:18.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.283+0000 7f871dffb640 1 -- 172.21.15.97:0/290553848 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872003e7e0 con 0x7f872815bf10 2023-11-24T08:07:18.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.283+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87280c9f40 con 0x7f872815bf10 2023-11-24T08:07:18.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.283+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87280ca500 con 0x7f872815bf10 2023-11-24T08:07:18.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.284+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8728067450 con 0x7f872815bf10 2023-11-24T08:07:18.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.285+0000 7f871dffb640 1 -- 172.21.15.97:0/290553848 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f872003e940 con 0x7f872815bf10 2023-11-24T08:07:18.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.286+0000 7f871dffb640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f870c06ae40 0x7f870c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.286+0000 7f871dffb640 1 -- 172.21.15.97:0/290553848 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87200ac580 con 0x7f872815bf10 2023-11-24T08:07:18.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.286+0000 7f872d2ab640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f870c06ae40 0x7f870c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.287+0000 7f872d2ab640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f870c06ae40 0x7f870c06d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f872400b7c0 tx=0x7f8724008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.290+0000 7f871dffb640 1 -- 172.21.15.97:0/290553848 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87200776b0 con 0x7f872815bf10 2023-11-24T08:07:18.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.480+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87280ad720 con 0x7f872815bf10 2023-11-24T08:07:18.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.481+0000 7f871dffb640 1 -- 172.21.15.97:0/290553848 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f872007acd0 con 0x7f872815bf10 2023-11-24T08:07:18.483 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:18.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f870c06ae40 msgr2=0x7f870c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f870c06ae40 0x7f870c06d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f872400b7c0 tx=0x7f8724008040 comp rx=0 tx=0).stop 2023-11-24T08:07:18.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f872815bf10 msgr2=0x7f87280713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f872815bf10 0x7f87280713c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8720009f40 tx=0x7f8720004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:18.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 shutdown_connections 2023-11-24T08:07:18.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f870c06ae40 0x7f870c06d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f872815bf10 0x7f87280713c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87280cc980 0x7f87280b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 --2- 172.21.15.97:0/290553848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87280adf20 0x7f87281424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 >> 172.21.15.97:0/290553848 conn(0x7f872806a7d0 msgr2=0x7f87280af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 shutdown_connections 2023-11-24T08:07:18.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.484+0000 7f872e2ad640 1 -- 172.21.15.97:0/290553848 wait complete. 2023-11-24T08:07:18.504 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:18.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.715+0000 7f9a40fc5640 1 Processor -- start 2023-11-24T08:07:18.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.715+0000 7f9a40fc5640 1 -- start start 2023-11-24T08:07:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.716+0000 7f9a40fc5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9a3c0ced30 0x7f9a3c0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.716+0000 7f9a40fc5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0cf1c0 con 0x7f9a3c160f80 2023-11-24T08:07:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.716+0000 7f9a40fc5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0d0de0 con 0x7f9a3c0ce8f0 2023-11-24T08:07:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.716+0000 7f9a40fc5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c0d10c0 con 0x7f9a3c0ced30 2023-11-24T08:07:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.716+0000 7f9a3a59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9a3c160f80 0x7f9a3c161360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54044/0 (socket says 172.21.15.97:54044) 2023-11-24T08:07:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.716+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1555297387 learned_addr learned my addr 172.21.15.97:0/1555297387 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a3ad9d640 1 --2- 172.21.15.97:0/1555297387 >> v2:172.21.15.183:3300/0 conn(0x7f9a3c0ced30 0x7f9a3c0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098974604 0 0) 0x7f9a2c001110 con 0x7f9a3c160f80 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a28003520 con 0x7f9a3c160f80 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423984131 0 0) 0x7f9a28003520 con 0x7f9a3c160f80 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 >> v2:172.21.15.183:3300/0 conn(0x7f9a3c0ced30 msgr2=0x7f9a3c0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 --2- 172.21.15.97:0/1555297387 >> v2:172.21.15.183:3300/0 conn(0x7f9a3c0ced30 0x7f9a3c0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 >> v1:172.21.15.183:6789/0 conn(0x7f9a3c0ce8f0 legacy=0x7f9a3c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0d13a0 con 0x7f9a3c160f80 2023-11-24T08:07:18.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f9a2c001800 con 0x7f9a3c160f80 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 >> v1:172.21.15.97:6789/0 conn(0x7f9a3c160f80 legacy=0x7f9a3c161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a280047c0 0x7f9a28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a28005180 0x7f9a2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0d10c0 con 0x7f9a28003970 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2800c020 con 0x7f9a280047c0 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.717+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2800c1e0 con 0x7f9a28005180 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3a59c640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a33fff640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a280047c0 0x7f9a28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3ad9d640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a28005180 0x7f9a2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a28005180 msgr2=0x7f9a2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3a59c640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a28005180 0x7f9a2800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a280047c0 msgr2=0x7f9a28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3a59c640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a280047c0 0x7f9a28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1555297387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28003520 con 0x7f9a28003970 2023-11-24T08:07:18.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.718+0000 7f9a3ad9d640 1 -- 172.21.15.97:0/1555297387 reap_dead start 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.719+0000 7f9a3a59c640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a28003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c240 tx=0x7f9a280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe90f711c45fe1b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.719+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c005ad0 con 0x7f9a28003970 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.719+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c005c50 con 0x7f9a28003970 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.719+0000 7f9a39d9b640 1 -- 172.21.15.97:0/1555297387 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c02c850 con 0x7f9a28003970 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.720+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1555297387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 msgr2=0x7f9a28003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.720+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a28003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c240 tx=0x7f9a280057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.720+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1555297387 shutdown_connections 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.720+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1555297387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a28003d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.720+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1555297387 >> 172.21.15.97:0/1555297387 conn(0x7f9a3c09c550 msgr2=0x7f9a3c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.720+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1555297387 shutdown_connections 2023-11-24T08:07:18.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.720+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1555297387 wait complete. 2023-11-24T08:07:18.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.722+0000 7f9a40fc5640 1 Processor -- start 2023-11-24T08:07:18.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.722+0000 7f9a40fc5640 1 -- start start 2023-11-24T08:07:18.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.723+0000 7f9a40fc5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a3c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.723+0000 7f9a40fc5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a3c14d460 0x7f9a3c0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.723+0000 7f9a40fc5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a3c14c6e0 0x7f9a3c14cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a40fc5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c9340 con 0x7f9a28003970 2023-11-24T08:07:18.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a40fc5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c14d0b0 con 0x7f9a3c14c6e0 2023-11-24T08:07:18.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a40fc5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c8730 con 0x7f9a3c14d460 2023-11-24T08:07:18.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a3c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a3c0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36066/0 (socket says 172.21.15.97:36066) 2023-11-24T08:07:18.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1507571409 learned_addr learned my addr 172.21.15.97:0/1507571409 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:18.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3ad9d640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a3c14c6e0 0x7f9a3c14cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a33fff640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a3c14d460 0x7f9a3c0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a3c14d460 msgr2=0x7f9a3c0c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a3c14d460 0x7f9a3c0c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a3c14c6e0 msgr2=0x7f9a3c14cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a3c14c6e0 0x7f9a3c14cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3a59c640 1 -- 172.21.15.97:0/1507571409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0c8a10 con 0x7f9a28003970 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.724+0000 7f9a3ad9d640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a3c14c6e0 0x7f9a3c14cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.725+0000 7f9a3a59c640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a3c0ccb90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c02c3f0 tx=0x7f9a2c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.725+0000 7f9a32ffd640 1 -- 172.21.15.97:0/1507571409 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c03c040 con 0x7f9a28003970 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.725+0000 7f9a32ffd640 1 -- 172.21.15.97:0/1507571409 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c02cc60 con 0x7f9a28003970 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.725+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c0c8cf0 con 0x7f9a28003970 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.725+0000 7f9a32ffd640 1 -- 172.21.15.97:0/1507571409 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c007070 con 0x7f9a28003970 2023-11-24T08:07:18.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.725+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c0cd0d0 con 0x7f9a28003970 2023-11-24T08:07:18.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.726+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c0d3920 con 0x7f9a28003970 2023-11-24T08:07:18.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.727+0000 7f9a32ffd640 1 -- 172.21.15.97:0/1507571409 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a2c032070 con 0x7f9a28003970 2023-11-24T08:07:18.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.728+0000 7f9a32ffd640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9a1c06ae70 0x7f9a1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.728+0000 7f9a32ffd640 1 -- 172.21.15.97:0/1507571409 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a2c0aa890 con 0x7f9a28003970 2023-11-24T08:07:18.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.729+0000 7f9a33fff640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9a1c06ae70 0x7f9a1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.729+0000 7f9a33fff640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9a1c06ae70 0x7f9a1c06d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000c00 tx=0x7f9a24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.732+0000 7f9a32ffd640 1 -- 172.21.15.97:0/1507571409 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a2c075a60 con 0x7f9a28003970 2023-11-24T08:07:18.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.921+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a3c0cf1c0 con 0x7f9a28003970 2023-11-24T08:07:18.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.924+0000 7f9a32ffd640 1 -- 172.21.15.97:0/1507571409 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f9a3c0cf1c0 con 0x7f9a28003970 2023-11-24T08:07:18.927 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:18.927 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:18.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9a1c06ae70 msgr2=0x7f9a1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9a1c06ae70 0x7f9a1c06d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000c00 tx=0x7f9a24009040 comp rx=0 tx=0).stop 2023-11-24T08:07:18.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 msgr2=0x7f9a3c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a3c0ccb90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c02c3f0 tx=0x7f9a2c02e070 comp rx=0 tx=0).stop 2023-11-24T08:07:18.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 shutdown_connections 2023-11-24T08:07:18.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9a1c06ae70 0x7f9a1c06d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a3c14c6e0 0x7f9a3c14cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a3c14d460 0x7f9a3c0c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 --2- 172.21.15.97:0/1507571409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a28003970 0x7f9a3c0ccb90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 >> 172.21.15.97:0/1507571409 conn(0x7f9a3c09c550 msgr2=0x7f9a3c0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 shutdown_connections 2023-11-24T08:07:18.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:18.927+0000 7f9a40fc5640 1 -- 172.21.15.97:0/1507571409 wait complete. 2023-11-24T08:07:18.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:18.948 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:19.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.165+0000 7faa45a61640 1 Processor -- start 2023-11-24T08:07:19.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.165+0000 7faa45a61640 1 -- start start 2023-11-24T08:07:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.166+0000 7faa45a61640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faa4013df80 0x7faa4015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.166+0000 7faa45a61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4013e360 0x7faa400cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.166+0000 7faa45a61640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faa4015f9c0 0x7faa400cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.166+0000 7faa45a61640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4006c470 con 0x7faa4013df80 2023-11-24T08:07:19.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.167+0000 7faa45a61640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4006c750 con 0x7faa4015f9c0 2023-11-24T08:07:19.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.167+0000 7faa45a61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4006ca30 con 0x7faa4013e360 2023-11-24T08:07:19.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.167+0000 7faa3effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faa4013df80 0x7faa4015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.167+0000 7faa3effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faa4013df80 0x7faa4015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36072/0 (socket says 172.21.15.97:36072) 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.167+0000 7faa3effd640 1 -- 172.21.15.97:0/1078244531 learned_addr learned my addr 172.21.15.97:0/1078244531 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.167+0000 7faa3e7fc640 1 --2- 172.21.15.97:0/1078244531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4013e360 0x7faa400cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.167+0000 7faa3f7fe640 1 --2- 172.21.15.97:0/1078244531 >> v2:172.21.15.183:3300/0 conn(0x7faa4015f9c0 0x7faa400cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.168+0000 7faa3effd640 1 -- 172.21.15.97:0/1078244531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4013e360 msgr2=0x7faa400cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.168+0000 7faa3effd640 1 --2- 172.21.15.97:0/1078244531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4013e360 0x7faa400cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.168+0000 7faa3effd640 1 -- 172.21.15.97:0/1078244531 >> v2:172.21.15.183:3300/0 conn(0x7faa4015f9c0 msgr2=0x7faa400cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.168+0000 7faa3effd640 1 --2- 172.21.15.97:0/1078244531 >> v2:172.21.15.183:3300/0 conn(0x7faa4015f9c0 0x7faa400cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.168+0000 7faa3effd640 1 -- 172.21.15.97:0/1078244531 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4006cd10 con 0x7faa4013df80 2023-11-24T08:07:19.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.169+0000 7faa3effd640 1 --2- 172.21.15.97:0/1078244531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4015bee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa4006e6d0 tx=0x7faa3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6ab4887b3b5ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.169+0000 7faa3dffb640 1 -- 172.21.15.97:0/1078244531 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30031870 con 0x7faa4013df80 2023-11-24T08:07:19.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.169+0000 7faa3dffb640 1 -- 172.21.15.97:0/1078244531 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa300319d0 con 0x7faa4013df80 2023-11-24T08:07:19.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.169+0000 7faa3dffb640 1 -- 172.21.15.97:0/1078244531 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30031d60 con 0x7faa4013df80 2023-11-24T08:07:19.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 -- 172.21.15.97:0/1078244531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 msgr2=0x7faa4015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 --2- 172.21.15.97:0/1078244531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4015bee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa4006e6d0 tx=0x7faa3002b910 comp rx=0 tx=0).stop 2023-11-24T08:07:19.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 -- 172.21.15.97:0/1078244531 shutdown_connections 2023-11-24T08:07:19.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 --2- 172.21.15.97:0/1078244531 >> v2:172.21.15.183:3300/0 conn(0x7faa4015f9c0 0x7faa400cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 --2- 172.21.15.97:0/1078244531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4013e360 0x7faa400cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 --2- 172.21.15.97:0/1078244531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4015bee0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 -- 172.21.15.97:0/1078244531 >> 172.21.15.97:0/1078244531 conn(0x7faa4006a800 msgr2=0x7faa4006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 -- 172.21.15.97:0/1078244531 shutdown_connections 2023-11-24T08:07:19.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.170+0000 7faa45a61640 1 -- 172.21.15.97:0/1078244531 wait complete. 2023-11-24T08:07:19.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.172+0000 7faa45a61640 1 Processor -- start 2023-11-24T08:07:19.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.172+0000 7faa45a61640 1 -- start start 2023-11-24T08:07:19.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa45a61640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4013aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa45a61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa4013e360 0x7faa401569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa45a61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4015f9c0 0x7faa400b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa45a61640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401576d0 con 0x7faa4013df80 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa45a61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40159830 con 0x7faa4013e360 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa45a61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40159b10 con 0x7faa4015f9c0 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa3effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4013aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa3effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4013aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36088/0 (socket says 172.21.15.97:36088) 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.173+0000 7faa3effd640 1 -- 172.21.15.97:0/1541153589 learned_addr learned my addr 172.21.15.97:0/1541153589 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3f7fe640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4015f9c0 0x7faa400b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3effd640 1 -- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4015f9c0 msgr2=0x7faa400b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3effd640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4015f9c0 0x7faa400b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3e7fc640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa4013e360 0x7faa401569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3effd640 1 -- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa4013e360 msgr2=0x7faa401569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3effd640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa4013e360 0x7faa401569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3effd640 1 -- 172.21.15.97:0/1541153589 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300094d0 con 0x7faa4013df80 2023-11-24T08:07:19.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa3effd640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4013aea0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa3002b950 tx=0x7faa300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa37fff640 1 -- 172.21.15.97:0/1541153589 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3003ac60 con 0x7faa4013df80 2023-11-24T08:07:19.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa37fff640 1 -- 172.21.15.97:0/1541153589 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3003adc0 con 0x7faa4013df80 2023-11-24T08:07:19.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa37fff640 1 -- 172.21.15.97:0/1541153589 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300445f0 con 0x7faa4013df80 2023-11-24T08:07:19.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa40157360 con 0x7faa4013df80 2023-11-24T08:07:19.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.174+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa40159df0 con 0x7faa4013df80 2023-11-24T08:07:19.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.176+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa400675d0 con 0x7faa4013df80 2023-11-24T08:07:19.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.177+0000 7faa37fff640 1 -- 172.21.15.97:0/1541153589 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa3004d450 con 0x7faa4013df80 2023-11-24T08:07:19.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.177+0000 7faa37fff640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa2006ae40 0x7faa2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.178+0000 7faa37fff640 1 -- 172.21.15.97:0/1541153589 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa3002d040 con 0x7faa4013df80 2023-11-24T08:07:19.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.178+0000 7faa3e7fc640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa2006ae40 0x7faa2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.178+0000 7faa3e7fc640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa2006ae40 0x7faa2006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa4015ec00 tx=0x7faa28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.182+0000 7faa37fff640 1 -- 172.21.15.97:0/1541153589 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa30076c60 con 0x7faa4013df80 2023-11-24T08:07:19.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.374+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa4006df00 con 0x7faa4013df80 2023-11-24T08:07:19.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.375+0000 7faa37fff640 1 -- 172.21.15.97:0/1541153589 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa30035070 con 0x7faa4013df80 2023-11-24T08:07:19.377 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:19.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.377+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa2006ae40 msgr2=0x7faa2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.377+0000 7faa45a61640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa2006ae40 0x7faa2006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa4015ec00 tx=0x7faa28008040 comp rx=0 tx=0).stop 2023-11-24T08:07:19.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.377+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 msgr2=0x7faa4013aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.377+0000 7faa45a61640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4013aea0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa3002b950 tx=0x7faa300046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 shutdown_connections 2023-11-24T08:07:19.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa2006ae40 0x7faa2006d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa4015f9c0 0x7faa400b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa4013e360 0x7faa401569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 --2- 172.21.15.97:0/1541153589 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa4013df80 0x7faa4013aea0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 >> 172.21.15.97:0/1541153589 conn(0x7faa4006a800 msgr2=0x7faa400aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 shutdown_connections 2023-11-24T08:07:19.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.378+0000 7faa45a61640 1 -- 172.21.15.97:0/1541153589 wait complete. 2023-11-24T08:07:19.399 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:19.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.616+0000 7f15d66bb640 1 Processor -- start 2023-11-24T08:07:19.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.616+0000 7f15d66bb640 1 -- start start 2023-11-24T08:07:19.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.618+0000 7f15d66bb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15d00b2e00 0x7f15d0070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.618+0000 7f15d66bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00706a0 con 0x7f15d006cb10 2023-11-24T08:07:19.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.618+0000 7f15d66bb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00708d0 con 0x7f15d006c730 2023-11-24T08:07:19.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.618+0000 7f15d66bb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d00b3290 con 0x7f15d00b2e00 2023-11-24T08:07:19.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.618+0000 7f15d5eba640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f15d006cb10 0x7f15d006cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54050/0 (socket says 172.21.15.97:54050) 2023-11-24T08:07:19.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.618+0000 7f15d5eba640 1 -- 172.21.15.97:0/1735774014 learned_addr learned my addr 172.21.15.97:0/1735774014 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:19.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15d4eb8640 1 --2- 172.21.15.97:0/1735774014 >> v2:172.21.15.183:3300/0 conn(0x7f15d00b2e00 0x7f15d0070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832646404 0 0) 0x7f15d00706a0 con 0x7f15d006cb10 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15bc003520 con 0x7f15d006cb10 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4198258293 0 0) 0x7f15bc003520 con 0x7f15d006cb10 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 >> v2:172.21.15.183:3300/0 conn(0x7f15d00b2e00 msgr2=0x7f15d0070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 --2- 172.21.15.97:0/1735774014 >> v2:172.21.15.183:3300/0 conn(0x7f15d00b2e00 0x7f15d0070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 >> v1:172.21.15.183:6789/0 conn(0x7f15d006c730 legacy=0x7f15d0071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0070bb0 con 0x7f15d006cb10 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f15c80019f0 con 0x7f15d006cb10 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.619+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 >> v1:172.21.15.97:6789/0 conn(0x7f15d006cb10 legacy=0x7f15d006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15c7fff640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc003970 0x7f15bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15c7fff640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc0047c0 0x7f15bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15c7fff640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc005180 0x7f15bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00bff0 con 0x7f15bc003970 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00c160 con 0x7f15bc0047c0 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00c320 con 0x7f15bc005180 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d56b9640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc003970 0x7f15bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d4eb8640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc0047c0 0x7f15bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d56b9640 1 -- 172.21.15.97:0/1735774014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc005180 msgr2=0x7f15bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d56b9640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc005180 0x7f15bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d56b9640 1 -- 172.21.15.97:0/1735774014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc0047c0 msgr2=0x7f15bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d56b9640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc0047c0 0x7f15bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d56b9640 1 -- 172.21.15.97:0/1735774014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc003520 con 0x7f15bc003970 2023-11-24T08:07:19.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.620+0000 7f15d5eba640 1 -- 172.21.15.97:0/1735774014 reap_dead start 2023-11-24T08:07:19.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.621+0000 7f15d56b9640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc003970 0x7f15bc003d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f15cc001750 tx=0x7f15bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0c285a5e2cc8c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0052d0 con 0x7f15bc003970 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc02e050 con 0x7f15bc003970 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15c7fff640 1 -- 172.21.15.97:0/1735774014 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc003830 con 0x7f15bc003970 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15d66bb640 1 -- 172.21.15.97:0/1735774014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc003970 msgr2=0x7f15bc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15d66bb640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc003970 0x7f15bc003d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f15cc001750 tx=0x7f15bc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15d66bb640 1 -- 172.21.15.97:0/1735774014 shutdown_connections 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15d66bb640 1 --2- 172.21.15.97:0/1735774014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc003970 0x7f15bc003d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15d66bb640 1 -- 172.21.15.97:0/1735774014 >> 172.21.15.97:0/1735774014 conn(0x7f15d006a7d0 msgr2=0x7f15d006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15d66bb640 1 -- 172.21.15.97:0/1735774014 shutdown_connections 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.622+0000 7f15d66bb640 1 -- 172.21.15.97:0/1735774014 wait complete. 2023-11-24T08:07:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.624+0000 7f15d66bb640 1 Processor -- start 2023-11-24T08:07:19.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.624+0000 7f15d66bb640 1 -- start start 2023-11-24T08:07:19.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d66bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc003970 0x7f15d00aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d66bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15d00a9d30 0x7f15d0156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d66bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15d0156b70 0x7f15d00ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d66bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00aae80 con 0x7f15d00a9d30 2023-11-24T08:07:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d66bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0155590 con 0x7f15bc003970 2023-11-24T08:07:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d66bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0155870 con 0x7f15d0156b70 2023-11-24T08:07:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d4eb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15d00a9d30 0x7f15d0156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d4eb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15d00a9d30 0x7f15d0156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36106/0 (socket says 172.21.15.97:36106) 2023-11-24T08:07:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.625+0000 7f15d4eb8640 1 -- 172.21.15.97:0/3901975350 learned_addr learned my addr 172.21.15.97:0/3901975350 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d56b9640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc003970 0x7f15d00aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d5eba640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15d0156b70 0x7f15d00ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d4eb8640 1 -- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15d0156b70 msgr2=0x7f15d00ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d4eb8640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15d0156b70 0x7f15d00ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d4eb8640 1 -- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc003970 msgr2=0x7f15d00aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d4eb8640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc003970 0x7f15d00aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d4eb8640 1 -- 172.21.15.97:0/3901975350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0155b50 con 0x7f15d00a9d30 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d56b9640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc003970 0x7f15d00aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15d4eb8640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15d00a9d30 0x7f15d0156630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15c00114e0 tx=0x7f15c00119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15c5ffb640 1 -- 172.21.15.97:0/3901975350 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0015870 con 0x7f15d00a9d30 2023-11-24T08:07:19.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.626+0000 7f15c5ffb640 1 -- 172.21.15.97:0/3901975350 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c00159d0 con 0x7f15d00a9d30 2023-11-24T08:07:19.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.627+0000 7f15c5ffb640 1 -- 172.21.15.97:0/3901975350 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0015d40 con 0x7f15d00a9d30 2023-11-24T08:07:19.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.627+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d0155e30 con 0x7f15d00a9d30 2023-11-24T08:07:19.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.627+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d0154ff0 con 0x7f15d00a9d30 2023-11-24T08:07:19.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.628+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d0067450 con 0x7f15d00a9d30 2023-11-24T08:07:19.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.629+0000 7f15c5ffb640 1 -- 172.21.15.97:0/3901975350 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15c0013400 con 0x7f15d00a9d30 2023-11-24T08:07:19.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.630+0000 7f15c5ffb640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15b406ae40 0x7f15b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.630+0000 7f15c5ffb640 1 -- 172.21.15.97:0/3901975350 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15c0089920 con 0x7f15d00a9d30 2023-11-24T08:07:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.630+0000 7f15d56b9640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15b406ae40 0x7f15b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.631+0000 7f15d56b9640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15b406ae40 0x7f15b406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f15cc033000 tx=0x7f15cc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.634+0000 7f15c5ffb640 1 -- 172.21.15.97:0/3901975350 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15c0054a60 con 0x7f15d00a9d30 2023-11-24T08:07:19.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.822+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15d006df80 con 0x7f15d00a9d30 2023-11-24T08:07:19.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.823+0000 7f15c5ffb640 1 -- 172.21.15.97:0/3901975350 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15c0022020 con 0x7f15d00a9d30 2023-11-24T08:07:19.825 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:19.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.825+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15b406ae40 msgr2=0x7f15b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.825+0000 7f15d66bb640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15b406ae40 0x7f15b406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f15cc033000 tx=0x7f15cc009030 comp rx=0 tx=0).stop 2023-11-24T08:07:19.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.825+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15d00a9d30 msgr2=0x7f15d0156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.825+0000 7f15d66bb640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15d00a9d30 0x7f15d0156630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15c00114e0 tx=0x7f15c00119a0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 shutdown_connections 2023-11-24T08:07:19.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15b406ae40 0x7f15b406d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15d0156b70 0x7f15d00ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15d00a9d30 0x7f15d0156630 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 --2- 172.21.15.97:0/3901975350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc003970 0x7f15d00aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 >> 172.21.15.97:0/3901975350 conn(0x7f15d006a7d0 msgr2=0x7f15d006cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 shutdown_connections 2023-11-24T08:07:19.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:19.826+0000 7f15d66bb640 1 -- 172.21.15.97:0/3901975350 wait complete. 2023-11-24T08:07:19.846 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:20.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.048+0000 7fb4e1751640 1 Processor -- start 2023-11-24T08:07:20.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.048+0000 7fb4e1751640 1 -- start start 2023-11-24T08:07:20.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.049+0000 7fb4e1751640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb4dc13e360 0x7fb4dc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.049+0000 7fb4e1751640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 0x7fb4dc0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.049+0000 7fb4e1751640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4dc15c5f0 con 0x7fb4dc13df80 2023-11-24T08:07:20.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.049+0000 7fb4e1751640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4dc06c470 con 0x7fb4dc13e360 2023-11-24T08:07:20.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.049+0000 7fb4e1751640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc06c750 con 0x7fb4dc15f9c0 2023-11-24T08:07:20.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.050+0000 7fb4daffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb4dc13df80 0x7fb4dc15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54064/0 (socket says 172.21.15.97:54064) 2023-11-24T08:07:20.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.050+0000 7fb4daffd640 1 -- 172.21.15.97:0/2213451774 learned_addr learned my addr 172.21.15.97:0/2213451774 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:20.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.050+0000 7fb4da7fc640 1 --2- 172.21.15.97:0/2213451774 >> v2:172.21.15.183:3300/0 conn(0x7fb4dc13e360 0x7fb4dc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.050+0000 7fb4db7fe640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 0x7fb4dc0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.050+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004044228 0 0) 0x7fb4dc15c5f0 con 0x7fb4dc13df80 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c4003520 con 0x7fb4dc13df80 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1259814646 0 0) 0x7fb4c4003520 con 0x7fb4dc13df80 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 msgr2=0x7fb4dc0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 0x7fb4dc0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 >> v2:172.21.15.183:3300/0 conn(0x7fb4dc13e360 msgr2=0x7fb4dc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 --2- 172.21.15.97:0/2213451774 >> v2:172.21.15.183:3300/0 conn(0x7fb4dc13e360 0x7fb4dc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc06ca30 con 0x7fb4dc13df80 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fb4cc001a10 con 0x7fb4dc13df80 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 >> v1:172.21.15.97:6789/0 conn(0x7fb4dc13df80 legacy=0x7fb4dc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4c4003970 0x7fb4c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 0x7fb4c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c4004d00 0x7fb4c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc06c470 con 0x7fb4c4003970 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc06c750 con 0x7fb4c4004d00 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.051+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c400b980 con 0x7fb4dc15f9c0 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.052+0000 7fb4daffd640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4c4003970 0x7fb4c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.052+0000 7fb4da7fc640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 0x7fb4c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.052+0000 7fb4daffd640 1 -- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 msgr2=0x7fb4c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.052+0000 7fb4daffd640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc15f9c0 0x7fb4c40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.052+0000 7fb4daffd640 1 -- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c4004d00 msgr2=0x7fb4c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.052+0000 7fb4daffd640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c4004d00 0x7fb4c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.052+0000 7fb4daffd640 1 -- 172.21.15.97:0/2213451774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4003520 con 0x7fb4c4003970 2023-11-24T08:07:20.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.053+0000 7fb4daffd640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4c4003970 0x7fb4c4003d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00a780 tx=0x7fb4c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434d1944e838a6ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.053+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc034630 con 0x7fb4c4003970 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.053+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc02f070 con 0x7fb4c4003970 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.053+0000 7fb4d9ffb640 1 -- 172.21.15.97:0/2213451774 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0349f0 con 0x7fb4c4003970 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.054+0000 7fb4e1751640 1 -- 172.21.15.97:0/2213451774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4c4003970 msgr2=0x7fb4c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.054+0000 7fb4e1751640 1 --2- 172.21.15.97:0/2213451774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4c4003970 0x7fb4c4003d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00a780 tx=0x7fb4c40057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.054+0000 7fb4db7fe640 1 -- 172.21.15.97:0/2213451774 reap_dead start 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.054+0000 7fb4e1751640 1 -- 172.21.15.97:0/2213451774 shutdown_connections 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.054+0000 7fb4e1751640 1 -- 172.21.15.97:0/2213451774 >> 172.21.15.97:0/2213451774 conn(0x7fb4dc06a800 msgr2=0x7fb4dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.054+0000 7fb4e1751640 1 -- 172.21.15.97:0/2213451774 shutdown_connections 2023-11-24T08:07:20.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.054+0000 7fb4e1751640 1 -- 172.21.15.97:0/2213451774 wait complete. 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.056+0000 7fb4e1751640 1 Processor -- start 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.056+0000 7fb4e1751640 1 -- start start 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4e1751640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c4003970 0x7fb4dc15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4e1751640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4dc148da0 0x7fb4dc149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4e1751640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc149760 0x7fb4dc0af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4e1751640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0aec00 con 0x7fb4dc148da0 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4e1751640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc149be0 con 0x7fb4c4003970 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4e1751640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc13d760 con 0x7fb4dc149760 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4dc148da0 0x7fb4dc149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4dc148da0 0x7fb4dc149220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36128/0 (socket says 172.21.15.97:36128) 2023-11-24T08:07:20.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 -- 172.21.15.97:0/596921775 learned_addr learned my addr 172.21.15.97:0/596921775 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 -- 172.21.15.97:0/596921775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc149760 msgr2=0x7fb4dc0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc149760 0x7fb4dc0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 -- 172.21.15.97:0/596921775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c4003970 msgr2=0x7fb4dc15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c4003970 0x7fb4dc15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.057+0000 7fb4da7fc640 1 -- 172.21.15.97:0/596921775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc13cec0 con 0x7fb4dc148da0 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.058+0000 7fb4da7fc640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4dc148da0 0x7fb4dc149220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0010820 tx=0x7fb4d0010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.058+0000 7fb4c37fe640 1 -- 172.21.15.97:0/596921775 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00095d0 con 0x7fb4dc148da0 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.058+0000 7fb4c37fe640 1 -- 172.21.15.97:0/596921775 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d000eae0 con 0x7fb4dc148da0 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.058+0000 7fb4c37fe640 1 -- 172.21.15.97:0/596921775 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000ee70 con 0x7fb4dc148da0 2023-11-24T08:07:20.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.058+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc13d1a0 con 0x7fb4dc148da0 2023-11-24T08:07:20.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.058+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4dc0b2260 con 0x7fb4dc148da0 2023-11-24T08:07:20.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.059+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4dc0aee70 con 0x7fb4dc148da0 2023-11-24T08:07:20.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.060+0000 7fb4c37fe640 1 -- 172.21.15.97:0/596921775 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4d001c400 con 0x7fb4dc148da0 2023-11-24T08:07:20.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.061+0000 7fb4c37fe640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb4c806ae40 0x7fb4c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.061+0000 7fb4c37fe640 1 -- 172.21.15.97:0/596921775 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4d0089ab0 con 0x7fb4dc148da0 2023-11-24T08:07:20.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.061+0000 7fb4daffd640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb4c806ae40 0x7fb4c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.062+0000 7fb4daffd640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb4c806ae40 0x7fb4c806d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc034000 tx=0x7fb4cc007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.065+0000 7fb4c37fe640 1 -- 172.21.15.97:0/596921775 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4d0054ac0 con 0x7fb4dc148da0 2023-11-24T08:07:20.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.258+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4dc0675d0 con 0x7fb4dc148da0 2023-11-24T08:07:20.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.259+0000 7fb4c37fe640 1 -- 172.21.15.97:0/596921775 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4d00580e0 con 0x7fb4dc148da0 2023-11-24T08:07:20.261 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb4c806ae40 msgr2=0x7fb4c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb4c806ae40 0x7fb4c806d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc034000 tx=0x7fb4cc007000 comp rx=0 tx=0).stop 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4dc148da0 msgr2=0x7fb4dc149220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4dc148da0 0x7fb4dc149220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0010820 tx=0x7fb4d0010ce0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 shutdown_connections 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb4c806ae40 0x7fb4c806d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4dc149760 0x7fb4dc0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4dc148da0 0x7fb4dc149220 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 --2- 172.21.15.97:0/596921775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c4003970 0x7fb4dc15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 >> 172.21.15.97:0/596921775 conn(0x7fb4dc06a800 msgr2=0x7fb4dc154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 shutdown_connections 2023-11-24T08:07:20.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.262+0000 7fb4e1751640 1 -- 172.21.15.97:0/596921775 wait complete. 2023-11-24T08:07:20.285 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:20.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.495+0000 7f3707b5a640 1 Processor -- start 2023-11-24T08:07:20.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.495+0000 7f3707b5a640 1 -- start start 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f3707b5a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f370014b2c0 0x7f37000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f3707b5a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37000cf7d0 0x7f3700070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f3707b5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f37000b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f3707b5a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370014b6a0 con 0x7f37000cf7d0 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f3707b5a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000cfbf0 con 0x7f370014b2c0 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f3707b5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3700071690 con 0x7f3700070ea0 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f37050f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37000cf7d0 0x7f3700070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f37050f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f37000cf7d0 0x7f3700070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36132/0 (socket says 172.21.15.97:36132) 2023-11-24T08:07:20.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f37050f5640 1 -- 172.21.15.97:0/1660433397 learned_addr learned my addr 172.21.15.97:0/1660433397 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:20.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.497+0000 7f37058f6640 1 --2- 172.21.15.97:0/1660433397 >> v2:172.21.15.183:3300/0 conn(0x7f370014b2c0 0x7f37000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.498+0000 7f37060f7640 1 --2- 172.21.15.97:0/1660433397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f37000b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.498+0000 7f37050f5640 1 -- 172.21.15.97:0/1660433397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 msgr2=0x7f37000b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.498+0000 7f37050f5640 1 --2- 172.21.15.97:0/1660433397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f37000b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.498+0000 7f37050f5640 1 -- 172.21.15.97:0/1660433397 >> v2:172.21.15.183:3300/0 conn(0x7f370014b2c0 msgr2=0x7f37000cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.498+0000 7f37050f5640 1 --2- 172.21.15.97:0/1660433397 >> v2:172.21.15.183:3300/0 conn(0x7f370014b2c0 0x7f37000cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.498+0000 7f37050f5640 1 -- 172.21.15.97:0/1660433397 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700071970 con 0x7f37000cf7d0 2023-11-24T08:07:20.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.499+0000 7f37050f5640 1 --2- 172.21.15.97:0/1660433397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f3700070960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f370006e650 tx=0x7f36f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2319309b892846c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.499+0000 7f37048f4640 1 -- 172.21.15.97:0/1660433397 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0031870 con 0x7f37000cf7d0 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.499+0000 7f37048f4640 1 -- 172.21.15.97:0/1660433397 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f00319d0 con 0x7f37000cf7d0 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.499+0000 7f37048f4640 1 -- 172.21.15.97:0/1660433397 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0031d60 con 0x7f37000cf7d0 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 -- 172.21.15.97:0/1660433397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 msgr2=0x7f3700070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 --2- 172.21.15.97:0/1660433397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f3700070960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f370006e650 tx=0x7f36f002b910 comp rx=0 tx=0).stop 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 -- 172.21.15.97:0/1660433397 shutdown_connections 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 --2- 172.21.15.97:0/1660433397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f37000b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 --2- 172.21.15.97:0/1660433397 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f3700070960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 --2- 172.21.15.97:0/1660433397 >> v2:172.21.15.183:3300/0 conn(0x7f370014b2c0 0x7f37000cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 -- 172.21.15.97:0/1660433397 >> 172.21.15.97:0/1660433397 conn(0x7f370006a800 msgr2=0x7f370006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 -- 172.21.15.97:0/1660433397 shutdown_connections 2023-11-24T08:07:20.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.500+0000 7f3707b5a640 1 -- 172.21.15.97:0/1660433397 wait complete. 2023-11-24T08:07:20.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.502+0000 7f3707b5a640 1 Processor -- start 2023-11-24T08:07:20.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.502+0000 7f3707b5a640 1 -- start start 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f3707b5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f370015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f3707b5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f37000cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f3707b5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f370014b2c0 0x7f37000cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f3707b5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700163620 con 0x7f37000cf7d0 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f3707b5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700163900 con 0x7f370014b2c0 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f3707b5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3700163be0 con 0x7f3700070ea0 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f37050f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f37000cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f37050f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f37000cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36148/0 (socket says 172.21.15.97:36148) 2023-11-24T08:07:20.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.503+0000 7f37050f5640 1 -- 172.21.15.97:0/543218557 learned_addr learned my addr 172.21.15.97:0/543218557 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37058f6640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f370015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37050f5640 1 -- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 msgr2=0x7f370015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37050f5640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f370015e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37050f5640 1 -- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f370014b2c0 msgr2=0x7f37000cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37060f7640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f370014b2c0 0x7f37000cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37050f5640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f370014b2c0 0x7f37000cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37050f5640 1 -- 172.21.15.97:0/543218557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f00094d0 con 0x7f37000cf7d0 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f37050f5640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f37000cd510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36f002b950 tx=0x7f36f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f36f67fc640 1 -- 172.21.15.97:0/543218557 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f003ad30 con 0x7f37000cf7d0 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f36f67fc640 1 -- 172.21.15.97:0/543218557 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f00443f0 con 0x7f37000cf7d0 2023-11-24T08:07:20.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3700163ec0 con 0x7f37000cf7d0 2023-11-24T08:07:20.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.504+0000 7f36f67fc640 1 -- 172.21.15.97:0/543218557 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00447a0 con 0x7f37000cf7d0 2023-11-24T08:07:20.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.505+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3700148570 con 0x7f37000cf7d0 2023-11-24T08:07:20.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.506+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37001643e0 con 0x7f37000cf7d0 2023-11-24T08:07:20.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.507+0000 7f36f67fc640 1 -- 172.21.15.97:0/543218557 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36f004d450 con 0x7f37000cf7d0 2023-11-24T08:07:20.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.508+0000 7f36f67fc640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f36e406ae40 0x7f36e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.509+0000 7f36f67fc640 1 -- 172.21.15.97:0/543218557 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36f002d040 con 0x7f37000cf7d0 2023-11-24T08:07:20.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.509+0000 7f37058f6640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f36e406ae40 0x7f36e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.509+0000 7f37058f6640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f36e406ae40 0x7f36e406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36fc006fd0 tx=0x7f36fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.513+0000 7f36f67fc640 1 -- 172.21.15.97:0/543218557 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37001643e0 con 0x7f37000cf7d0 2023-11-24T08:07:20.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.689+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37001643e0 con 0x7f37000cf7d0 2023-11-24T08:07:20.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.692+0000 7f36f67fc640 1 -- 172.21.15.97:0/543218557 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f37001643e0 con 0x7f37000cf7d0 2023-11-24T08:07:20.695 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:20.695 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:20.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f36e406ae40 msgr2=0x7f36e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f36e406ae40 0x7f36e406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36fc006fd0 tx=0x7f36fc008040 comp rx=0 tx=0).stop 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 msgr2=0x7f37000cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f37000cd510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36f002b950 tx=0x7f36f00046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 shutdown_connections 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f36e406ae40 0x7f36e406d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f370014b2c0 0x7f37000cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f37000cf7d0 0x7f37000cd510 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 --2- 172.21.15.97:0/543218557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3700070ea0 0x7f370015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 >> 172.21.15.97:0/543218557 conn(0x7f370006a800 msgr2=0x7f370006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 shutdown_connections 2023-11-24T08:07:20.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.694+0000 7f3707b5a640 1 -- 172.21.15.97:0/543218557 wait complete. 2023-11-24T08:07:20.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:20.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:20.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.930+0000 7f561bd68640 1 Processor -- start 2023-11-24T08:07:20.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.930+0000 7f561bd68640 1 -- start start 2023-11-24T08:07:20.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f561bd68640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f56140cf9a0 0x7f5614166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f561bd68640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561415c5f0 con 0x7f561413e360 2023-11-24T08:07:20.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f561bd68640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561406c470 con 0x7f561413df80 2023-11-24T08:07:20.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f561bd68640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561406c750 con 0x7f56140cf9a0 2023-11-24T08:07:20.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f5619303640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f561413e360 0x7f56140cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54072/0 (socket says 172.21.15.97:54072) 2023-11-24T08:07:20.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f5619303640 1 -- 172.21.15.97:0/57545933 learned_addr learned my addr 172.21.15.97:0/57545933 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f561a305640 1 --2- 172.21.15.97:0/57545933 >> v2:172.21.15.183:3300/0 conn(0x7f56140cf9a0 0x7f5614166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.932+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688556738 0 0) 0x7f561415c5f0 con 0x7f561413e360 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5600003520 con 0x7f561413e360 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2615202157 0 0) 0x7f5600003520 con 0x7f561413e360 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 >> v2:172.21.15.183:3300/0 conn(0x7f56140cf9a0 msgr2=0x7f5614166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 --2- 172.21.15.97:0/57545933 >> v2:172.21.15.183:3300/0 conn(0x7f56140cf9a0 0x7f5614166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 >> v1:172.21.15.183:6789/0 conn(0x7f561413df80 legacy=0x7f561415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561406ca30 con 0x7f561413e360 2023-11-24T08:07:20.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f5604001670 con 0x7f561413e360 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 >> v1:172.21.15.97:6789/0 conn(0x7f561413e360 legacy=0x7f56140cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5600003970 0x7f5600003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56000047c0 0x7f5600004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600005180 0x7f560000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561406c750 con 0x7f5600003970 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560000c020 con 0x7f5600005180 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560000c1e0 con 0x7f56000047c0 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.933+0000 7f5619b04640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5600003970 0x7f5600003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f561a305640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600005180 0x7f560000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f5619303640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56000047c0 0x7f5600004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f5619b04640 1 -- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56000047c0 msgr2=0x7f5600004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f5619b04640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56000047c0 0x7f5600004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f5619b04640 1 -- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600005180 msgr2=0x7f560000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f5619b04640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600005180 0x7f560000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f561a305640 1 -- 172.21.15.97:0/57545933 reap_dead start 2023-11-24T08:07:20.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f5619b04640 1 -- 172.21.15.97:0/57545933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600003520 con 0x7f5600003970 2023-11-24T08:07:20.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.934+0000 7f5619303640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56000047c0 0x7f5600004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:20.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.935+0000 7f5619b04640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5600003970 0x7f5600003d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5610001750 tx=0x7f56000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448ca031c6a0efb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.935+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100052d0 con 0x7f5600003970 2023-11-24T08:07:20.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.935+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561002e050 con 0x7f5600003970 2023-11-24T08:07:20.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.935+0000 7f5618b02640 1 -- 172.21.15.97:0/57545933 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610003830 con 0x7f5600003970 2023-11-24T08:07:20.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.936+0000 7f561bd68640 1 -- 172.21.15.97:0/57545933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5600003970 msgr2=0x7f5600003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.936+0000 7f561bd68640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5600003970 0x7f5600003d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5610001750 tx=0x7f56000057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.936+0000 7f561bd68640 1 -- 172.21.15.97:0/57545933 shutdown_connections 2023-11-24T08:07:20.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.936+0000 7f561bd68640 1 --2- 172.21.15.97:0/57545933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5600003970 0x7f5600003d90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.936+0000 7f561bd68640 1 -- 172.21.15.97:0/57545933 >> 172.21.15.97:0/57545933 conn(0x7f561406a800 msgr2=0x7f561406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.936+0000 7f561bd68640 1 -- 172.21.15.97:0/57545933 shutdown_connections 2023-11-24T08:07:20.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.936+0000 7f561bd68640 1 -- 172.21.15.97:0/57545933 wait complete. 2023-11-24T08:07:20.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.938+0000 7f561bd68640 1 Processor -- start 2023-11-24T08:07:20.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.938+0000 7f561bd68640 1 -- start start 2023-11-24T08:07:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f561bd68640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600003970 0x7f5614151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f561bd68640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56141f4020 0x7f561414de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f561bd68640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f561414b850 0x7f56140afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f561bd68640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561414b070 con 0x7f56141f4020 2023-11-24T08:07:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f561bd68640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141f4800 con 0x7f5600003970 2023-11-24T08:07:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f561bd68640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56141f4ae0 con 0x7f561414b850 2023-11-24T08:07:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f5619303640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56141f4020 0x7f561414de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f5619303640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56141f4020 0x7f561414de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36168/0 (socket says 172.21.15.97:36168) 2023-11-24T08:07:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.939+0000 7f5619303640 1 -- 172.21.15.97:0/3579864455 learned_addr learned my addr 172.21.15.97:0/3579864455 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619b04640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600003970 0x7f5614151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f561a305640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f561414b850 0x7f56140afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619303640 1 -- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f561414b850 msgr2=0x7f56140afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619303640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f561414b850 0x7f56140afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619303640 1 -- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600003970 msgr2=0x7f5614151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619303640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600003970 0x7f5614151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619303640 1 -- 172.21.15.97:0/3579864455 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56141f4dc0 con 0x7f56141f4020 2023-11-24T08:07:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619b04640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600003970 0x7f5614151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f5619303640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56141f4020 0x7f561414de00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f560400d6c0 tx=0x7f560400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f560a7fc640 1 -- 172.21.15.97:0/3579864455 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56040072d0 con 0x7f56141f4020 2023-11-24T08:07:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f560a7fc640 1 -- 172.21.15.97:0/3579864455 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604007430 con 0x7f56141f4020 2023-11-24T08:07:20.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561414b330 con 0x7f56141f4020 2023-11-24T08:07:20.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f560a7fc640 1 -- 172.21.15.97:0/3579864455 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56040047e0 con 0x7f56141f4020 2023-11-24T08:07:20.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.940+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56141f4460 con 0x7f56141f4020 2023-11-24T08:07:20.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.942+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56140675d0 con 0x7f56141f4020 2023-11-24T08:07:20.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.943+0000 7f560a7fc640 1 -- 172.21.15.97:0/3579864455 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5604004940 con 0x7f56141f4020 2023-11-24T08:07:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.944+0000 7f560a7fc640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f55f806ae70 0x7f55f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.944+0000 7f560a7fc640 1 -- 172.21.15.97:0/3579864455 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5604088f00 con 0x7f56141f4020 2023-11-24T08:07:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.944+0000 7f5619b04640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f55f806ae70 0x7f55f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.945+0000 7f5619b04640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f55f806ae70 0x7f55f806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5610033000 tx=0x7f5610009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:20.948+0000 7f560a7fc640 1 -- 172.21.15.97:0/3579864455 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5604053f10 con 0x7f56141f4020 2023-11-24T08:07:21.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.140+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f561406df00 con 0x7f56141f4020 2023-11-24T08:07:21.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.141+0000 7f560a7fc640 1 -- 172.21.15.97:0/3579864455 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56040190a0 con 0x7f56141f4020 2023-11-24T08:07:21.143 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:21.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f55f806ae70 msgr2=0x7f55f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f55f806ae70 0x7f55f806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5610033000 tx=0x7f5610009030 comp rx=0 tx=0).stop 2023-11-24T08:07:21.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56141f4020 msgr2=0x7f561414de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56141f4020 0x7f561414de00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f560400d6c0 tx=0x7f560400db80 comp rx=0 tx=0).stop 2023-11-24T08:07:21.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 shutdown_connections 2023-11-24T08:07:21.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f55f806ae70 0x7f55f806d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f561414b850 0x7f56140afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56141f4020 0x7f561414de00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 --2- 172.21.15.97:0/3579864455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5600003970 0x7f5614151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 >> 172.21.15.97:0/3579864455 conn(0x7f561406a800 msgr2=0x7f56140b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 shutdown_connections 2023-11-24T08:07:21.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.144+0000 7f561bd68640 1 -- 172.21.15.97:0/3579864455 wait complete. 2023-11-24T08:07:21.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:21.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.371+0000 7f6c1d02b640 1 Processor -- start 2023-11-24T08:07:21.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.371+0000 7f6c1d02b640 1 -- start start 2023-11-24T08:07:21.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c1d02b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6c1813df80 0x7f6c1815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c1d02b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6c1813e360 0x7f6c180cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c1d02b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c1d02b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1806c470 con 0x7f6c1813df80 2023-11-24T08:07:21.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c1d02b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1806c750 con 0x7f6c1813e360 2023-11-24T08:07:21.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c1d02b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1806ca30 con 0x7f6c1815f9c0 2023-11-24T08:07:21.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c16d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6c1813df80 0x7f6c1815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.373+0000 7f6c16d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6c1813df80 0x7f6c1815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36170/0 (socket says 172.21.15.97:36170) 2023-11-24T08:07:21.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c16d9d640 1 -- 172.21.15.97:0/2174672412 learned_addr learned my addr 172.21.15.97:0/2174672412 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:21.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c0ffff640 1 --2- 172.21.15.97:0/2174672412 >> v2:172.21.15.183:3300/0 conn(0x7f6c1813e360 0x7f6c180cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c1759e640 1 --2- 172.21.15.97:0/2174672412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c16d9d640 1 -- 172.21.15.97:0/2174672412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 msgr2=0x7f6c180cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c16d9d640 1 --2- 172.21.15.97:0/2174672412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c16d9d640 1 -- 172.21.15.97:0/2174672412 >> v2:172.21.15.183:3300/0 conn(0x7f6c1813e360 msgr2=0x7f6c180cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c16d9d640 1 --2- 172.21.15.97:0/2174672412 >> v2:172.21.15.183:3300/0 conn(0x7f6c1813e360 0x7f6c180cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c16d9d640 1 -- 172.21.15.97:0/2174672412 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1806cd10 con 0x7f6c1813df80 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c1759e640 1 --2- 172.21.15.97:0/2174672412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:21.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.374+0000 7f6c0ffff640 1 --2- 172.21.15.97:0/2174672412 >> v2:172.21.15.183:3300/0 conn(0x7f6c1813e360 0x7f6c180cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:21.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.375+0000 7f6c16d9d640 1 --2- 172.21.15.97:0/2174672412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c1815bee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806ded0 tx=0x7f6c0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3213fd443461b852 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.375+0000 7f6c1659c640 1 -- 172.21.15.97:0/2174672412 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08031870 con 0x7f6c1813df80 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.375+0000 7f6c1659c640 1 -- 172.21.15.97:0/2174672412 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080319d0 con 0x7f6c1813df80 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.375+0000 7f6c1659c640 1 -- 172.21.15.97:0/2174672412 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08031d60 con 0x7f6c1813df80 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 -- 172.21.15.97:0/2174672412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 msgr2=0x7f6c1815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/2174672412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c1815bee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806ded0 tx=0x7f6c0802b910 comp rx=0 tx=0).stop 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 -- 172.21.15.97:0/2174672412 shutdown_connections 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/2174672412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/2174672412 >> v2:172.21.15.183:3300/0 conn(0x7f6c1813e360 0x7f6c180cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/2174672412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c1815bee0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 -- 172.21.15.97:0/2174672412 >> 172.21.15.97:0/2174672412 conn(0x7f6c1806a800 msgr2=0x7f6c1806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 -- 172.21.15.97:0/2174672412 shutdown_connections 2023-11-24T08:07:21.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.376+0000 7f6c1d02b640 1 -- 172.21.15.97:0/2174672412 wait complete. 2023-11-24T08:07:21.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.378+0000 7f6c1d02b640 1 Processor -- start 2023-11-24T08:07:21.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.378+0000 7f6c1d02b640 1 -- start start 2023-11-24T08:07:21.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c1d02b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c180a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c1d02b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c1813e360 0x7f6c181f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c1d02b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c1d02b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c181f29d0 con 0x7f6c1813df80 2023-11-24T08:07:21.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c1d02b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180b2d60 con 0x7f6c1813e360 2023-11-24T08:07:21.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c1d02b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180aad40 con 0x7f6c1815f9c0 2023-11-24T08:07:21.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c16d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c180a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c16d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c180a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36172/0 (socket says 172.21.15.97:36172) 2023-11-24T08:07:21.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.379+0000 7f6c16d9d640 1 -- 172.21.15.97:0/4207855778 learned_addr learned my addr 172.21.15.97:0/4207855778 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:21.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c16d9d640 1 -- 172.21.15.97:0/4207855778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 msgr2=0x7f6c180b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c16d9d640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c16d9d640 1 -- 172.21.15.97:0/4207855778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c1813e360 msgr2=0x7f6c181f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c16d9d640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c1813e360 0x7f6c181f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c16d9d640 1 -- 172.21.15.97:0/4207855778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c080094d0 con 0x7f6c1813df80 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c16d9d640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c180a9750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c08000c00 tx=0x7f6c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c0f7fe640 1 -- 172.21.15.97:0/4207855778 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08031860 con 0x7f6c1813df80 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c0f7fe640 1 -- 172.21.15.97:0/4207855778 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080443f0 con 0x7f6c1813df80 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c0f7fe640 1 -- 172.21.15.97:0/4207855778 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080447a0 con 0x7f6c1813df80 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.380+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c180aaa60 con 0x7f6c1813df80 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.381+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c180b2020 con 0x7f6c1813df80 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.382+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c180675d0 con 0x7f6c1813df80 2023-11-24T08:07:21.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.383+0000 7f6c0f7fe640 1 -- 172.21.15.97:0/4207855778 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c08044900 con 0x7f6c1813df80 2023-11-24T08:07:21.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.384+0000 7f6c0f7fe640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6bf806ae40 0x7f6bf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.384+0000 7f6c0f7fe640 1 -- 172.21.15.97:0/4207855778 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c0802d040 con 0x7f6c1813df80 2023-11-24T08:07:21.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.384+0000 7f6c0ffff640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6bf806ae40 0x7f6bf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.384+0000 7f6c0ffff640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6bf806ae40 0x7f6bf806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c00006fd0 tx=0x7f6c00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.388+0000 7f6c0f7fe640 1 -- 172.21.15.97:0/4207855778 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c08076fa0 con 0x7f6c1813df80 2023-11-24T08:07:21.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.577+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c1806df00 con 0x7f6c1813df80 2023-11-24T08:07:21.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.578+0000 7f6c0f7fe640 1 -- 172.21.15.97:0/4207855778 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c080350a0 con 0x7f6c1813df80 2023-11-24T08:07:21.580 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:21.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6bf806ae40 msgr2=0x7f6bf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6bf806ae40 0x7f6bf806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c00006fd0 tx=0x7f6c00008040 comp rx=0 tx=0).stop 2023-11-24T08:07:21.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 msgr2=0x7f6c180a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c180a9750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c08000c00 tx=0x7f6c080046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 shutdown_connections 2023-11-24T08:07:21.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6bf806ae40 0x7f6bf806d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c1815f9c0 0x7f6c180b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c1813e360 0x7f6c181f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 --2- 172.21.15.97:0/4207855778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1813df80 0x7f6c180a9750 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 >> 172.21.15.97:0/4207855778 conn(0x7f6c1806a800 msgr2=0x7f6c1806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 shutdown_connections 2023-11-24T08:07:21.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.581+0000 7f6c1d02b640 1 -- 172.21.15.97:0/4207855778 wait complete. 2023-11-24T08:07:21.600 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:21.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.807+0000 7f04ff7a9640 1 Processor -- start 2023-11-24T08:07:21.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.807+0000 7f04ff7a9640 1 -- start start 2023-11-24T08:07:21.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.808+0000 7f04ff7a9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04f80d17e0 0x7f04f80d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.808+0000 7f04ff7a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.808+0000 7f04ff7a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f80d2180 con 0x7f04f815d610 2023-11-24T08:07:21.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.808+0000 7f04ff7a9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80d1390 con 0x7f04f80d17e0 2023-11-24T08:07:21.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.808+0000 7f04ff7a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80b3400 con 0x7f04f80b3890 2023-11-24T08:07:21.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.809+0000 7f04fdd46640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.809+0000 7f04fcd44640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04f80d17e0 0x7f04f80d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.809+0000 7f04fdd46640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:50396/0 (socket says 172.21.15.97:50396) 2023-11-24T08:07:21.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.809+0000 7f04fdd46640 1 -- 172.21.15.97:0/3901369275 learned_addr learned my addr 172.21.15.97:0/3901369275 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:21.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.810+0000 7f04fcd44640 1 -- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 msgr2=0x7f04f80b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.810+0000 7f04fcd44640 1 --2- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.810+0000 7f04fcd44640 1 -- 172.21.15.97:0/3901369275 >> v1:172.21.15.183:6789/0 conn(0x7f04f815d610 legacy=0x7f04f80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.810+0000 7f04fcd44640 1 -- 172.21.15.97:0/3901369275 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80b27f0 con 0x7f04f80d17e0 2023-11-24T08:07:21.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.810+0000 7f04fdd46640 1 --2- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:21.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.811+0000 7f04fcd44640 1 --2- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f80d17e0 0x7f04f80d1c40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097a0 tx=0x7f04e402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56f1eeccef60566 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.812+0000 7f04f7fff640 1 -- 172.21.15.97:0/3901369275 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4031830 con 0x7f04f80d17e0 2023-11-24T08:07:21.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.812+0000 7f04f7fff640 1 -- 172.21.15.97:0/3901369275 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e4031990 con 0x7f04f80d17e0 2023-11-24T08:07:21.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.812+0000 7f04f7fff640 1 -- 172.21.15.97:0/3901369275 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4031d20 con 0x7f04f80d17e0 2023-11-24T08:07:21.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 -- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f80d17e0 msgr2=0x7f04f80d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f80d17e0 0x7f04f80d1c40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097a0 tx=0x7f04e402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 -- 172.21.15.97:0/3901369275 shutdown_connections 2023-11-24T08:07:21.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/3901369275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f80d17e0 0x7f04f80d1c40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 -- 172.21.15.97:0/3901369275 >> 172.21.15.97:0/3901369275 conn(0x7f04f809c540 msgr2=0x7f04f80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 -- 172.21.15.97:0/3901369275 shutdown_connections 2023-11-24T08:07:21.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.813+0000 7f04ff7a9640 1 -- 172.21.15.97:0/3901369275 wait complete. 2023-11-24T08:07:21.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.815+0000 7f04ff7a9640 1 Processor -- start 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.815+0000 7f04ff7a9640 1 -- start start 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.816+0000 7f04ff7a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04ff7a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04f80d17e0 0x7f04f815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04ff7a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f815d610 0x7f04f815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04ff7a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81f65a0 con 0x7f04f80d17e0 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04ff7a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81f6880 con 0x7f04f815d610 2023-11-24T08:07:21.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04ff7a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81f6b60 con 0x7f04f80b3890 2023-11-24T08:07:21.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04f80d17e0 0x7f04f815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04f80d17e0 0x7f04f815fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36174/0 (socket says 172.21.15.97:36174) 2023-11-24T08:07:21.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 -- 172.21.15.97:0/79664881 learned_addr learned my addr 172.21.15.97:0/79664881 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:21.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fd545640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fdd46640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f815d610 0x7f04f815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 -- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 msgr2=0x7f04f80b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 -- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f815d610 msgr2=0x7f04f815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f815d610 0x7f04f815a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fcd44640 1 -- 172.21.15.97:0/79664881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00094d0 con 0x7f04f80d17e0 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.817+0000 7f04fd545640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.818+0000 7f04fcd44640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04f80d17e0 0x7f04f815fea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04e402bee0 tx=0x7f04e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.818+0000 7f04f5ffb640 1 -- 172.21.15.97:0/79664881 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e403b9f0 con 0x7f04f80d17e0 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.818+0000 7f04f5ffb640 1 -- 172.21.15.97:0/79664881 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e403bb70 con 0x7f04f80d17e0 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.818+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e4009400 con 0x7f04f80d17e0 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.818+0000 7f04f5ffb640 1 -- 172.21.15.97:0/79664881 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40453f0 con 0x7f04f80d17e0 2023-11-24T08:07:21.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.818+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f80b6590 con 0x7f04f80d17e0 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.819+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f81f7360 con 0x7f04f80d17e0 2023-11-24T08:07:21.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.820+0000 7f04f5ffb640 1 -- 172.21.15.97:0/79664881 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04e404e450 con 0x7f04f80d17e0 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.821+0000 7f04f5ffb640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04dc06ae70 0x7f04dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.821+0000 7f04f5ffb640 1 -- 172.21.15.97:0/79664881 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04e40ab740 con 0x7f04f80d17e0 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.822+0000 7f04fd545640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04dc06ae70 0x7f04dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.822+0000 7f04fd545640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04dc06ae70 0x7f04dc06d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04f8066880 tx=0x7f04ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:21.826+0000 7f04f5ffb640 1 -- 172.21.15.97:0/79664881 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04f81f7360 con 0x7f04f80d17e0 2023-11-24T08:07:22.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.017+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04f81f7360 con 0x7f04f80d17e0 2023-11-24T08:07:22.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.018+0000 7f04f5ffb640 1 -- 172.21.15.97:0/79664881 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04f81f7360 con 0x7f04f80d17e0 2023-11-24T08:07:22.020 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:22.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04dc06ae70 msgr2=0x7f04dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04dc06ae70 0x7f04dc06d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04f8066880 tx=0x7f04ec009040 comp rx=0 tx=0).stop 2023-11-24T08:07:22.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04f80d17e0 msgr2=0x7f04f815fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04f80d17e0 0x7f04f815fea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04e402bee0 tx=0x7f04e40046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 shutdown_connections 2023-11-24T08:07:22.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04dc06ae70 0x7f04dc06d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04f815d610 0x7f04f815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04f80d17e0 0x7f04f815fea0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 --2- 172.21.15.97:0/79664881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04f80b3890 0x7f04f80b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.020+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 >> 172.21.15.97:0/79664881 conn(0x7f04f809c540 msgr2=0x7f04f806c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.021+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 shutdown_connections 2023-11-24T08:07:22.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.021+0000 7f04ff7a9640 1 -- 172.21.15.97:0/79664881 wait complete. 2023-11-24T08:07:22.040 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:22.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.244+0000 7f8554dfb640 1 Processor -- start 2023-11-24T08:07:22.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.244+0000 7f8554dfb640 1 -- start start 2023-11-24T08:07:22.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.245+0000 7f8554dfb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8550150760 0x7f8550072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.245+0000 7f8554dfb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f855015d300 0x7f855015d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f8554dfb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855015dc80 con 0x7f85500b2bd0 2023-11-24T08:07:22.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f8554dfb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85500b3770 con 0x7f8550150760 2023-11-24T08:07:22.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f8554dfb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8550071190 con 0x7f855015d300 2023-11-24T08:07:22.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f854ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f85500b2bd0 0x7f85500b3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54084/0 (socket says 172.21.15.97:54084) 2023-11-24T08:07:22.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f854ed9d640 1 -- 172.21.15.97:0/1981031650 learned_addr learned my addr 172.21.15.97:0/1981031650 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f8547fff640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f855015d300 0x7f855015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f854e59c640 1 --2- 172.21.15.97:0/1981031650 >> v2:172.21.15.183:3300/0 conn(0x7f8550150760 0x7f8550072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127253960 0 0) 0x7f855015dc80 con 0x7f85500b2bd0 2023-11-24T08:07:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.246+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f853c003520 con 0x7f85500b2bd0 2023-11-24T08:07:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148373122 0 0) 0x7f853c003520 con 0x7f85500b2bd0 2023-11-24T08:07:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f855015d300 msgr2=0x7f855015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f855015d300 0x7f855015d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 >> v2:172.21.15.183:3300/0 conn(0x7f8550150760 msgr2=0x7f8550072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 --2- 172.21.15.97:0/1981031650 >> v2:172.21.15.183:3300/0 conn(0x7f8550150760 0x7f8550072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550071470 con 0x7f85500b2bd0 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f85480019f0 con 0x7f85500b2bd0 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854e59c640 1 --2- 172.21.15.97:0/1981031650 >> v2:172.21.15.183:3300/0 conn(0x7f8550150760 0x7f8550072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 >> v1:172.21.15.97:6789/0 conn(0x7f85500b2bd0 legacy=0x7f85500b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f853c003970 0x7f853c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c0047c0 0x7f853c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f855015d300 0x7f853c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85500b3770 con 0x7f853c003970 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550071190 con 0x7f853c0047c0 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c00b980 con 0x7f855015d300 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.247+0000 7f854e59c640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f853c003970 0x7f853c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.248+0000 7f8547fff640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c0047c0 0x7f853c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.248+0000 7f854e59c640 1 -- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f855015d300 msgr2=0x7f853c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.248+0000 7f854e59c640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f855015d300 0x7f853c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.248+0000 7f854e59c640 1 -- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c0047c0 msgr2=0x7f853c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.248+0000 7f854e59c640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c0047c0 0x7f853c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.248+0000 7f854e59c640 1 -- 172.21.15.97:0/1981031650 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c003520 con 0x7f853c003970 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.249+0000 7f854e59c640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f853c003970 0x7f853c003d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85400098a0 tx=0x7f853c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e110f8febe5901e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.249+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540004230 con 0x7f853c003970 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.249+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8540004390 con 0x7f853c003970 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.249+0000 7f854dd9b640 1 -- 172.21.15.97:0/1981031650 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540003830 con 0x7f853c003970 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.249+0000 7f8554dfb640 1 -- 172.21.15.97:0/1981031650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f853c003970 msgr2=0x7f853c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.249+0000 7f8554dfb640 1 --2- 172.21.15.97:0/1981031650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f853c003970 0x7f853c003d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85400098a0 tx=0x7f853c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.249+0000 7f854ed9d640 1 -- 172.21.15.97:0/1981031650 reap_dead start 2023-11-24T08:07:22.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.250+0000 7f8554dfb640 1 -- 172.21.15.97:0/1981031650 shutdown_connections 2023-11-24T08:07:22.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.250+0000 7f8554dfb640 1 -- 172.21.15.97:0/1981031650 >> 172.21.15.97:0/1981031650 conn(0x7f855006a800 msgr2=0x7f855006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.250+0000 7f8554dfb640 1 -- 172.21.15.97:0/1981031650 shutdown_connections 2023-11-24T08:07:22.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.250+0000 7f8554dfb640 1 -- 172.21.15.97:0/1981031650 wait complete. 2023-11-24T08:07:22.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.251+0000 7f8554dfb640 1 Processor -- start 2023-11-24T08:07:22.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.252+0000 7f8554dfb640 1 -- start start 2023-11-24T08:07:22.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f8554dfb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c003970 0x7f8550144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f8554dfb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8550157930 0x7f855014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f8554dfb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8550159e30 0x7f85500cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f8554dfb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855015aa60 con 0x7f8550159e30 2023-11-24T08:07:22.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f8554dfb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855015a780 con 0x7f853c003970 2023-11-24T08:07:22.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f8554dfb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85500cbf70 con 0x7f8550157930 2023-11-24T08:07:22.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8550159e30 0x7f85500cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8550159e30 0x7f85500cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36202/0 (socket says 172.21.15.97:36202) 2023-11-24T08:07:22.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 -- 172.21.15.97:0/4005378594 learned_addr learned my addr 172.21.15.97:0/4005378594 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:22.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f8547fff640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8550157930 0x7f855014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854e59c640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c003970 0x7f8550144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 -- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8550157930 msgr2=0x7f855014bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8550157930 0x7f855014bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 -- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c003970 msgr2=0x7f8550144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c003970 0x7f8550144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854ed9d640 1 -- 172.21.15.97:0/4005378594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500cc250 con 0x7f8550159e30 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.253+0000 7f854e59c640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c003970 0x7f8550144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.254+0000 7f854ed9d640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8550159e30 0x7f85500cdff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f85500b1ca0 tx=0x7f854800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.254+0000 7f8546ffd640 1 -- 172.21.15.97:0/4005378594 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800a610 con 0x7f8550159e30 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.254+0000 7f8546ffd640 1 -- 172.21.15.97:0/4005378594 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800a790 con 0x7f8550159e30 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.254+0000 7f8546ffd640 1 -- 172.21.15.97:0/4005378594 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800ab40 con 0x7f8550159e30 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.254+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85500cc530 con 0x7f8550159e30 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.254+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855015a4c0 con 0x7f8550159e30 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.255+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85500cc720 con 0x7f8550159e30 2023-11-24T08:07:22.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.256+0000 7f8546ffd640 1 -- 172.21.15.97:0/4005378594 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f854800aca0 con 0x7f8550159e30 2023-11-24T08:07:22.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.257+0000 7f8546ffd640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f853006ae70 0x7f853006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.257+0000 7f8546ffd640 1 -- 172.21.15.97:0/4005378594 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8548088e10 con 0x7f8550159e30 2023-11-24T08:07:22.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.257+0000 7f854e59c640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f853006ae70 0x7f853006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.258+0000 7f854e59c640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f853006ae70 0x7f853006d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8540035000 tx=0x7f8540039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.262+0000 7f8546ffd640 1 -- 172.21.15.97:0/4005378594 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f854808c030 con 0x7f8550159e30 2023-11-24T08:07:22.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.453+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85500675d0 con 0x7f8550159e30 2023-11-24T08:07:22.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.454+0000 7f8546ffd640 1 -- 172.21.15.97:0/4005378594 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f854801a070 con 0x7f8550159e30 2023-11-24T08:07:22.457 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:22.457 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:22.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f853006ae70 msgr2=0x7f853006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f853006ae70 0x7f853006d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8540035000 tx=0x7f8540039040 comp rx=0 tx=0).stop 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8550159e30 msgr2=0x7f85500cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8550159e30 0x7f85500cdff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f85500b1ca0 tx=0x7f854800ce80 comp rx=0 tx=0).stop 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 shutdown_connections 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f853006ae70 0x7f853006d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8550159e30 0x7f85500cdff0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8550157930 0x7f855014bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 --2- 172.21.15.97:0/4005378594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853c003970 0x7f8550144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.457+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 >> 172.21.15.97:0/4005378594 conn(0x7f855006a800 msgr2=0x7f855014f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.458+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 shutdown_connections 2023-11-24T08:07:22.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.458+0000 7f8554dfb640 1 -- 172.21.15.97:0/4005378594 wait complete. 2023-11-24T08:07:22.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:22.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:22.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.690+0000 7fe70ce39640 1 Processor -- start 2023-11-24T08:07:22.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.690+0000 7fe70ce39640 1 -- start start 2023-11-24T08:07:22.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.691+0000 7fe70ce39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe708070a30 0x7fe70815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe70ce39640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70815f4e0 con 0x7fe7080ccb50 2023-11-24T08:07:22.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe70ce39640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe708070ee0 con 0x7fe7080adf20 2023-11-24T08:07:22.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe70ce39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70815c450 con 0x7fe708070a30 2023-11-24T08:07:22.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe706ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe7080ccb50 0x7fe708143d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54092/0 (socket says 172.21.15.97:54092) 2023-11-24T08:07:22.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe706ffd640 1 -- 172.21.15.97:0/107100582 learned_addr learned my addr 172.21.15.97:0/107100582 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe707fff640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe708070a30 0x7fe70815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544156852 0 0) 0x7fe70815f4e0 con 0x7fe7080ccb50 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.692+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0003520 con 0x7fe7080ccb50 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333524748 0 0) 0x7fe6f0003520 con 0x7fe7080ccb50 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe708070a30 msgr2=0x7fe70815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe708070a30 0x7fe70815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 >> v1:172.21.15.183:6789/0 conn(0x7fe7080adf20 legacy=0x7fe7080cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708071130 con 0x7fe7080ccb50 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fe6fc001670 con 0x7fe7080ccb50 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 >> v1:172.21.15.97:6789/0 conn(0x7fe7080ccb50 legacy=0x7fe708143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe708070a30 0x7fe6f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f0003f20 0x7fe6f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0004d00 0x7fe6f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70815c450 con 0x7fe6f0003f20 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000bb10 con 0x7fe6f0004d00 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000bcd0 con 0x7fe708070a30 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.693+0000 7fe706ffd640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f0003f20 0x7fe6f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.694+0000 7fe706ffd640 1 -- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe708070a30 msgr2=0x7fe6f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.694+0000 7fe706ffd640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe708070a30 0x7fe6f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.694+0000 7fe706ffd640 1 -- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0004d00 msgr2=0x7fe6f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.694+0000 7fe706ffd640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0004d00 0x7fe6f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.694+0000 7fe706ffd640 1 -- 172.21.15.97:0/107100582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0003520 con 0x7fe6f0003f20 2023-11-24T08:07:22.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.695+0000 7fe706ffd640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f0003f20 0x7fe6f00047c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe7080ccf90 tx=0x7fe6f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5729ad2b85dd35e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.695+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc005ad0 con 0x7fe6f0003f20 2023-11-24T08:07:22.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.695+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc005c30 con 0x7fe6f0003f20 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.695+0000 7fe7067fc640 1 -- 172.21.15.97:0/107100582 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc02c850 con 0x7fe6f0003f20 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.696+0000 7fe70ce39640 1 -- 172.21.15.97:0/107100582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f0003f20 msgr2=0x7fe6f00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.696+0000 7fe70ce39640 1 --2- 172.21.15.97:0/107100582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f0003f20 0x7fe6f00047c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe7080ccf90 tx=0x7fe6f00057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.696+0000 7fe707fff640 1 -- 172.21.15.97:0/107100582 reap_dead start 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.696+0000 7fe70ce39640 1 -- 172.21.15.97:0/107100582 shutdown_connections 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.696+0000 7fe70ce39640 1 -- 172.21.15.97:0/107100582 >> 172.21.15.97:0/107100582 conn(0x7fe70806a7d0 msgr2=0x7fe70806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.696+0000 7fe70ce39640 1 -- 172.21.15.97:0/107100582 shutdown_connections 2023-11-24T08:07:22.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.696+0000 7fe70ce39640 1 -- 172.21.15.97:0/107100582 wait complete. 2023-11-24T08:07:22.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.698+0000 7fe70ce39640 1 Processor -- start 2023-11-24T08:07:22.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.698+0000 7fe70ce39640 1 -- start start 2023-11-24T08:07:22.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe70ce39640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0003f20 0x7fe7081ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe70ce39640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7081f1c20 0x7fe70812d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe70ce39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70812dc80 0x7fe70812af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe70ce39640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70812d320 con 0x7fe70812dc80 2023-11-24T08:07:22.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe70ce39640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70812cfd0 con 0x7fe6f0003f20 2023-11-24T08:07:22.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe70ce39640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7081f20a0 con 0x7fe7081f1c20 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe707fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70812dc80 0x7fe70812af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe707fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70812dc80 0x7fe70812af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36216/0 (socket says 172.21.15.97:36216) 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe707fff640 1 -- 172.21.15.97:0/1586204819 learned_addr learned my addr 172.21.15.97:0/1586204819 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe7077fe640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0003f20 0x7fe7081ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe706ffd640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7081f1c20 0x7fe70812d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.699+0000 7fe707fff640 1 -- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7081f1c20 msgr2=0x7fe70812d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe707fff640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7081f1c20 0x7fe70812d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe707fff640 1 -- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0003f20 msgr2=0x7fe7081ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe707fff640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0003f20 0x7fe7081ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe707fff640 1 -- 172.21.15.97:0/1586204819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7081f2350 con 0x7fe70812dc80 2023-11-24T08:07:22.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe707fff640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70812dc80 0x7fe70812af40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe70815fb10 tx=0x7fe70000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe6effff640 1 -- 172.21.15.97:0/1586204819 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700010040 con 0x7fe70812dc80 2023-11-24T08:07:22.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe6effff640 1 -- 172.21.15.97:0/1586204819 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70000bae0 con 0x7fe70812dc80 2023-11-24T08:07:22.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7081f2630 con 0x7fe70812dc80 2023-11-24T08:07:22.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe6effff640 1 -- 172.21.15.97:0/1586204819 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700014400 con 0x7fe70812dc80 2023-11-24T08:07:22.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.700+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70812b480 con 0x7fe70812dc80 2023-11-24T08:07:22.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.702+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70812d460 con 0x7fe70812dc80 2023-11-24T08:07:22.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.703+0000 7fe6effff640 1 -- 172.21.15.97:0/1586204819 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe700014560 con 0x7fe70812dc80 2023-11-24T08:07:22.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.703+0000 7fe6effff640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe6f406ae40 0x7fe6f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.704+0000 7fe6effff640 1 -- 172.21.15.97:0/1586204819 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7000899b0 con 0x7fe70812dc80 2023-11-24T08:07:22.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.704+0000 7fe7077fe640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe6f406ae40 0x7fe6f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.704+0000 7fe7077fe640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe6f406ae40 0x7fe6f406d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8001690 tx=0x7fe6f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.708+0000 7fe6effff640 1 -- 172.21.15.97:0/1586204819 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe70812d460 con 0x7fe70812dc80 2023-11-24T08:07:22.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.900+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe70812d460 con 0x7fe70812dc80 2023-11-24T08:07:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.901+0000 7fe6effff640 1 -- 172.21.15.97:0/1586204819 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe70812d460 con 0x7fe70812dc80 2023-11-24T08:07:22.903 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:22.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe6f406ae40 msgr2=0x7fe6f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe6f406ae40 0x7fe6f406d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8001690 tx=0x7fe6f8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70812dc80 msgr2=0x7fe70812af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70812dc80 0x7fe70812af40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe70815fb10 tx=0x7fe70000b480 comp rx=0 tx=0).stop 2023-11-24T08:07:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 shutdown_connections 2023-11-24T08:07:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe6f406ae40 0x7fe6f406d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe70812dc80 0x7fe70812af40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7081f1c20 0x7fe70812d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 --2- 172.21.15.97:0/1586204819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6f0003f20 0x7fe7081ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 >> 172.21.15.97:0/1586204819 conn(0x7fe70806a7d0 msgr2=0x7fe7081444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.905+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 shutdown_connections 2023-11-24T08:07:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:22.906+0000 7fe70ce39640 1 -- 172.21.15.97:0/1586204819 wait complete. 2023-11-24T08:07:22.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:23.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.139+0000 7fb652c13640 1 Processor -- start 2023-11-24T08:07:23.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.139+0000 7fb652c13640 1 -- start start 2023-11-24T08:07:23.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.141+0000 7fb652c13640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c071e40 0x7fb64c0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.141+0000 7fb652c13640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb64c15d770 0x7fb64c15dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.141+0000 7fb652c13640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c15e140 con 0x7fb64c143810 2023-11-24T08:07:23.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.141+0000 7fb652c13640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c143bf0 con 0x7fb64c15d770 2023-11-24T08:07:23.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.141+0000 7fb652c13640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0722c0 con 0x7fb64c071e40 2023-11-24T08:07:23.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.142+0000 7fb652412640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb64c15d770 0x7fb64c15dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.142+0000 7fb651410640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c071e40 0x7fb64c0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.142+0000 7fb652412640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb64c15d770 0x7fb64c15dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:53106/0 (socket says 172.21.15.97:53106) 2023-11-24T08:07:23.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.142+0000 7fb651410640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c071e40 0x7fb64c0ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:50458/0 (socket says 172.21.15.97:50458) 2023-11-24T08:07:23.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.142+0000 7fb652412640 1 -- 172.21.15.97:0/1016960067 learned_addr learned my addr 172.21.15.97:0/1016960067 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:23.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.143+0000 7fb651410640 1 -- 172.21.15.97:0/1016960067 >> v2:172.21.15.183:3300/0 conn(0x7fb64c15d770 msgr2=0x7fb64c15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:23.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.143+0000 7fb651410640 1 --2- 172.21.15.97:0/1016960067 >> v2:172.21.15.183:3300/0 conn(0x7fb64c15d770 0x7fb64c15dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.143+0000 7fb651410640 1 -- 172.21.15.97:0/1016960067 >> v1:172.21.15.183:6789/0 conn(0x7fb64c143810 legacy=0x7fb64c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.143+0000 7fb650c0f640 1 -- 172.21.15.97:0/1016960067 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046446189 0 0) 0x7fb64c15e140 con 0x7fb64c143810 2023-11-24T08:07:23.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.143+0000 7fb651410640 1 -- 172.21.15.97:0/1016960067 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c06c730 con 0x7fb64c071e40 2023-11-24T08:07:23.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.143+0000 7fb652412640 1 --2- 172.21.15.97:0/1016960067 >> v2:172.21.15.183:3300/0 conn(0x7fb64c15d770 0x7fb64c15dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:23.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.144+0000 7fb651410640 1 --2- 172.21.15.97:0/1016960067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c071e40 0x7fb64c0ae170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be6d8429166e5c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb650c0f640 1 -- 172.21.15.97:0/1016960067 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c02f050 con 0x7fb64c071e40 2023-11-24T08:07:23.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb650c0f640 1 -- 172.21.15.97:0/1016960067 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c031700 con 0x7fb64c071e40 2023-11-24T08:07:23.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb650c0f640 1 -- 172.21.15.97:0/1016960067 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c031a90 con 0x7fb64c071e40 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb652c13640 1 -- 172.21.15.97:0/1016960067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c071e40 msgr2=0x7fb64c0ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb652c13640 1 --2- 172.21.15.97:0/1016960067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c071e40 0x7fb64c0ae170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02b7a0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb652c13640 1 -- 172.21.15.97:0/1016960067 shutdown_connections 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb652c13640 1 --2- 172.21.15.97:0/1016960067 >> v2:172.21.15.183:3300/0 conn(0x7fb64c15d770 0x7fb64c15dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb652c13640 1 --2- 172.21.15.97:0/1016960067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c071e40 0x7fb64c0ae170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.145+0000 7fb652c13640 1 -- 172.21.15.97:0/1016960067 >> 172.21.15.97:0/1016960067 conn(0x7fb64c06a7d0 msgr2=0x7fb64c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.146+0000 7fb652c13640 1 -- 172.21.15.97:0/1016960067 shutdown_connections 2023-11-24T08:07:23.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.146+0000 7fb652c13640 1 -- 172.21.15.97:0/1016960067 wait complete. 2023-11-24T08:07:23.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.147+0000 7fb652c13640 1 Processor -- start 2023-11-24T08:07:23.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.148+0000 7fb652c13640 1 -- start start 2023-11-24T08:07:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.148+0000 7fb652c13640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb64c071e40 0x7fb64c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.148+0000 7fb652c13640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c143810 0x7fb64c144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb652c13640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c15d770 0x7fb64c15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb652c13640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c13fe40 con 0x7fb64c071e40 2023-11-24T08:07:23.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb652c13640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0cc8b0 con 0x7fb64c143810 2023-11-24T08:07:23.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb652c13640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c144b30 con 0x7fb64c15d770 2023-11-24T08:07:23.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb64c071e40 0x7fb64c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb64c071e40 0x7fb64c0ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36226/0 (socket says 172.21.15.97:36226) 2023-11-24T08:07:23.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 -- 172.21.15.97:0/2981888511 learned_addr learned my addr 172.21.15.97:0/2981888511 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:23.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 -- 172.21.15.97:0/2981888511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c15d770 msgr2=0x7fb64c15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c15d770 0x7fb64c15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 -- 172.21.15.97:0/2981888511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c143810 msgr2=0x7fb64c144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c143810 0x7fb64c144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.149+0000 7fb651c11640 1 -- 172.21.15.97:0/2981888511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644009b30 con 0x7fb64c071e40 2023-11-24T08:07:23.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.150+0000 7fb651c11640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb64c071e40 0x7fb64c0ce0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb64800c4e0 tx=0x7fb64800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.150+0000 7fb6427fc640 1 -- 172.21.15.97:0/2981888511 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648005480 con 0x7fb64c071e40 2023-11-24T08:07:23.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.150+0000 7fb6427fc640 1 -- 172.21.15.97:0/2981888511 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb648003610 con 0x7fb64c071e40 2023-11-24T08:07:23.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.150+0000 7fb6427fc640 1 -- 172.21.15.97:0/2981888511 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6480039c0 con 0x7fb64c071e40 2023-11-24T08:07:23.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.150+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c009400 con 0x7fb64c071e40 2023-11-24T08:07:23.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.150+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c0ccde0 con 0x7fb64c071e40 2023-11-24T08:07:23.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.151+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c067450 con 0x7fb64c071e40 2023-11-24T08:07:23.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.152+0000 7fb6427fc640 1 -- 172.21.15.97:0/2981888511 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb648003b20 con 0x7fb64c071e40 2023-11-24T08:07:23.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.153+0000 7fb6427fc640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb63006ae40 0x7fb63006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.153+0000 7fb6427fc640 1 -- 172.21.15.97:0/2981888511 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6480889b0 con 0x7fb64c071e40 2023-11-24T08:07:23.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.153+0000 7fb651410640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb63006ae40 0x7fb63006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.154+0000 7fb651410640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb63006ae40 0x7fb63006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb63c035000 tx=0x7fb63c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.157+0000 7fb6427fc640 1 -- 172.21.15.97:0/2981888511 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb648053c60 con 0x7fb64c071e40 2023-11-24T08:07:23.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.347+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb64c0b1e90 con 0x7fb64c071e40 2023-11-24T08:07:23.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.347+0000 7fb6427fc640 1 -- 172.21.15.97:0/2981888511 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb648017020 con 0x7fb64c071e40 2023-11-24T08:07:23.349 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:23.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.350+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb63006ae40 msgr2=0x7fb63006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.350+0000 7fb652c13640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb63006ae40 0x7fb63006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb63c035000 tx=0x7fb63c030000 comp rx=0 tx=0).stop 2023-11-24T08:07:23.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.350+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb64c071e40 msgr2=0x7fb64c0ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.350+0000 7fb652c13640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb64c071e40 0x7fb64c0ce0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb64800c4e0 tx=0x7fb64800c9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 shutdown_connections 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb63006ae40 0x7fb63006d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb64c15d770 0x7fb64c15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb64c143810 0x7fb64c144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 --2- 172.21.15.97:0/2981888511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb64c071e40 0x7fb64c0ce0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 >> 172.21.15.97:0/2981888511 conn(0x7fb64c06a7d0 msgr2=0x7fb64c0ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 shutdown_connections 2023-11-24T08:07:23.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.351+0000 7fb652c13640 1 -- 172.21.15.97:0/2981888511 wait complete. 2023-11-24T08:07:23.371 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.584+0000 7fb9a7051640 1 Processor -- start 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.584+0000 7fb9a7051640 1 -- start start 2023-11-24T08:07:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a7051640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb9a013e360 0x7fb9a00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a7051640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9a015f9c0 0x7fb9a00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a7051640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a015c5f0 con 0x7fb9a013df80 2023-11-24T08:07:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a7051640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a006c470 con 0x7fb9a015f9c0 2023-11-24T08:07:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a7051640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a006c750 con 0x7fb9a013e360 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a55ee640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9a015f9c0 0x7fb9a00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a55ee640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb9a015f9c0 0x7fb9a00cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36234/0 (socket says 172.21.15.97:36234) 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb9a55ee640 1 -- 172.21.15.97:0/1574642557 learned_addr learned my addr 172.21.15.97:0/1574642557 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.586+0000 7fb99ffff640 1 --2- 172.21.15.97:0/1574642557 >> v2:172.21.15.183:3300/0 conn(0x7fb9a013e360 0x7fb9a00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.587+0000 7fb9a55ee640 1 -- 172.21.15.97:0/1574642557 >> v2:172.21.15.183:3300/0 conn(0x7fb9a013e360 msgr2=0x7fb9a00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.587+0000 7fb9a55ee640 1 --2- 172.21.15.97:0/1574642557 >> v2:172.21.15.183:3300/0 conn(0x7fb9a013e360 0x7fb9a00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.587+0000 7fb9a55ee640 1 -- 172.21.15.97:0/1574642557 >> v1:172.21.15.183:6789/0 conn(0x7fb9a013df80 legacy=0x7fb9a015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.587+0000 7fb9a55ee640 1 -- 172.21.15.97:0/1574642557 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a006ca30 con 0x7fb9a015f9c0 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.588+0000 7fb9a55ee640 1 --2- 172.21.15.97:0/1574642557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a015f9c0 0x7fb9a00cf7d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00ccae0 tx=0x7fb99802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafa275c8e7789d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.588+0000 7fb99f7fe640 1 -- 172.21.15.97:0/1574642557 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99802ca50 con 0x7fb9a015f9c0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.588+0000 7fb99f7fe640 1 -- 172.21.15.97:0/1574642557 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99802cbb0 con 0x7fb9a015f9c0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.588+0000 7fb99f7fe640 1 -- 172.21.15.97:0/1574642557 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980343f0 con 0x7fb9a015f9c0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.588+0000 7fb9a7051640 1 -- 172.21.15.97:0/1574642557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a015f9c0 msgr2=0x7fb9a00cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.588+0000 7fb9a7051640 1 --2- 172.21.15.97:0/1574642557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a015f9c0 0x7fb9a00cf7d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00ccae0 tx=0x7fb99802beb0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.589+0000 7fb9a7051640 1 -- 172.21.15.97:0/1574642557 shutdown_connections 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.589+0000 7fb9a7051640 1 --2- 172.21.15.97:0/1574642557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a015f9c0 0x7fb9a00cf7d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.589+0000 7fb9a7051640 1 --2- 172.21.15.97:0/1574642557 >> v2:172.21.15.183:3300/0 conn(0x7fb9a013e360 0x7fb9a00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.589+0000 7fb9a7051640 1 -- 172.21.15.97:0/1574642557 >> 172.21.15.97:0/1574642557 conn(0x7fb9a006a800 msgr2=0x7fb9a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.589+0000 7fb9a7051640 1 -- 172.21.15.97:0/1574642557 shutdown_connections 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.589+0000 7fb9a7051640 1 -- 172.21.15.97:0/1574642557 wait complete. 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.590+0000 7fb9a7051640 1 Processor -- start 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.591+0000 7fb9a7051640 1 -- start start 2023-11-24T08:07:23.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.591+0000 7fb9a7051640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a013df80 0x7fb9a013d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.591+0000 7fb9a7051640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a013e360 0x7fb9a00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.591+0000 7fb9a7051640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9a015f9c0 0x7fb9a00b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.591+0000 7fb9a7051640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00aaaa0 con 0x7fb9a013df80 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.591+0000 7fb9a7051640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00a9a40 con 0x7fb9a013e360 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.591+0000 7fb9a7051640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00a9ce0 con 0x7fb9a015f9c0 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a013df80 0x7fb9a013d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a013df80 0x7fb9a013d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36238/0 (socket says 172.21.15.97:36238) 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 -- 172.21.15.97:0/2389688309 learned_addr learned my addr 172.21.15.97:0/2389688309 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:23.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 -- 172.21.15.97:0/2389688309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9a015f9c0 msgr2=0x7fb9a00b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9a015f9c0 0x7fb9a00b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 -- 172.21.15.97:0/2389688309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a013e360 msgr2=0x7fb9a00b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a013e360 0x7fb9a00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.592+0000 7fb9a4ded640 1 -- 172.21.15.97:0/2389688309 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998009b30 con 0x7fb9a013df80 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.593+0000 7fb9a4ded640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a013df80 0x7fb9a013d940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb99400b3f0 tx=0x7fb99400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.593+0000 7fb99d7fa640 1 -- 172.21.15.97:0/2389688309 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994011830 con 0x7fb9a013df80 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.593+0000 7fb99d7fa640 1 -- 172.21.15.97:0/2389688309 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb994011990 con 0x7fb9a013df80 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.593+0000 7fb99d7fa640 1 -- 172.21.15.97:0/2389688309 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994011d40 con 0x7fb9a013df80 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.593+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a00a9fc0 con 0x7fb9a013df80 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.593+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a00aa580 con 0x7fb9a013df80 2023-11-24T08:07:23.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.594+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a00675d0 con 0x7fb9a013df80 2023-11-24T08:07:23.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.595+0000 7fb99d7fa640 1 -- 172.21.15.97:0/2389688309 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb99401a400 con 0x7fb9a013df80 2023-11-24T08:07:23.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.596+0000 7fb99d7fa640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb98406ae40 0x7fb98406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.596+0000 7fb99d7fa640 1 -- 172.21.15.97:0/2389688309 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9940894e0 con 0x7fb9a013df80 2023-11-24T08:07:23.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.596+0000 7fb99ffff640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb98406ae40 0x7fb98406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.597+0000 7fb99ffff640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb98406ae40 0x7fb98406d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00721d0 tx=0x7fb98c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.600+0000 7fb99d7fa640 1 -- 172.21.15.97:0/2389688309 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9940544f0 con 0x7fb9a013df80 2023-11-24T08:07:23.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.790+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9a00a9780 con 0x7fb9a013df80 2023-11-24T08:07:23.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.790+0000 7fb99d7fa640 1 -- 172.21.15.97:0/2389688309 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb994057b10 con 0x7fb9a013df80 2023-11-24T08:07:23.792 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb98406ae40 msgr2=0x7fb98406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb98406ae40 0x7fb98406d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00721d0 tx=0x7fb98c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a013df80 msgr2=0x7fb9a013d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a013df80 0x7fb9a013d940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb99400b3f0 tx=0x7fb99400b8b0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 shutdown_connections 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb98406ae40 0x7fb98406d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9a015f9c0 0x7fb9a00b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a013e360 0x7fb9a00b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 --2- 172.21.15.97:0/2389688309 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9a013df80 0x7fb9a013d940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 >> 172.21.15.97:0/2389688309 conn(0x7fb9a006a800 msgr2=0x7fb9a015a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 shutdown_connections 2023-11-24T08:07:23.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:23.793+0000 7fb9a7051640 1 -- 172.21.15.97:0/2389688309 wait complete. 2023-11-24T08:07:23.881 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T08:07:23.881 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:24.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.099+0000 7f7fd942e640 1 Processor -- start 2023-11-24T08:07:24.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.099+0000 7f7fd942e640 1 -- start start 2023-11-24T08:07:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.101+0000 7f7fd942e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40cc500 0x7f7fd40cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.101+0000 7f7fd942e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fd406d160 0x7f7fd406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.101+0000 7f7fd942e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd4070e50 con 0x7f7fd4143c40 2023-11-24T08:07:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.101+0000 7f7fd942e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40723c0 con 0x7f7fd406d160 2023-11-24T08:07:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.101+0000 7f7fd942e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4144020 con 0x7f7fd40cc500 2023-11-24T08:07:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.102+0000 7f7fd8c2d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fd406d160 0x7f7fd406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.102+0000 7f7fd37fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40cc500 0x7f7fd40cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.102+0000 7f7fd8c2d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fd406d160 0x7f7fd406d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:53156/0 (socket says 172.21.15.97:53156) 2023-11-24T08:07:24.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.102+0000 7f7fd8c2d640 1 -- 172.21.15.97:0/2443018676 learned_addr learned my addr 172.21.15.97:0/2443018676 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:24.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.103+0000 7f7fd37fe640 1 -- 172.21.15.97:0/2443018676 >> v2:172.21.15.183:3300/0 conn(0x7f7fd406d160 msgr2=0x7f7fd406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:24.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.103+0000 7f7fd37fe640 1 --2- 172.21.15.97:0/2443018676 >> v2:172.21.15.183:3300/0 conn(0x7f7fd406d160 0x7f7fd406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.103+0000 7f7fd37fe640 1 -- 172.21.15.97:0/2443018676 >> v1:172.21.15.183:6789/0 conn(0x7f7fd4143c40 legacy=0x7f7fd4071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.103+0000 7f7fd37fe640 1 -- 172.21.15.97:0/2443018676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40ccea0 con 0x7f7fd40cc500 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.103+0000 7f7fd8c2d640 1 --2- 172.21.15.97:0/2443018676 >> v2:172.21.15.183:3300/0 conn(0x7f7fd406d160 0x7f7fd406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.104+0000 7f7fd37fe640 1 --2- 172.21.15.97:0/2443018676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40cc500 0x7f7fd40cc960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0097a0 tx=0x7f7fbc02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c09c9d99d21529e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.104+0000 7f7fd2ffd640 1 -- 172.21.15.97:0/2443018676 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc031780 con 0x7f7fd40cc500 2023-11-24T08:07:24.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd2ffd640 1 -- 172.21.15.97:0/2443018676 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc0318e0 con 0x7f7fd40cc500 2023-11-24T08:07:24.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd2ffd640 1 -- 172.21.15.97:0/2443018676 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc031c70 con 0x7f7fd40cc500 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 -- 172.21.15.97:0/2443018676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40cc500 msgr2=0x7f7fd40cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 --2- 172.21.15.97:0/2443018676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40cc500 0x7f7fd40cc960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0097a0 tx=0x7f7fbc02b820 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 -- 172.21.15.97:0/2443018676 shutdown_connections 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 --2- 172.21.15.97:0/2443018676 >> v2:172.21.15.183:3300/0 conn(0x7f7fd406d160 0x7f7fd406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 --2- 172.21.15.97:0/2443018676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40cc500 0x7f7fd40cc960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 -- 172.21.15.97:0/2443018676 >> 172.21.15.97:0/2443018676 conn(0x7f7fd406a800 msgr2=0x7f7fd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 -- 172.21.15.97:0/2443018676 shutdown_connections 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.105+0000 7f7fd942e640 1 -- 172.21.15.97:0/2443018676 wait complete. 2023-11-24T08:07:24.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.107+0000 7f7fd942e640 1 Processor -- start 2023-11-24T08:07:24.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.107+0000 7f7fd942e640 1 -- start start 2023-11-24T08:07:24.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.108+0000 7f7fd942e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd406d160 0x7f7fd415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.108+0000 7f7fd942e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40cc500 0x7f7fd41f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.108+0000 7f7fd942e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd4143c40 0x7f7fd41f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.108+0000 7f7fd942e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd415ae30 con 0x7f7fd4143c40 2023-11-24T08:07:24.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.108+0000 7f7fd942e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40ad330 con 0x7f7fd40cc500 2023-11-24T08:07:24.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.108+0000 7f7fd942e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40b07f0 con 0x7f7fd406d160 2023-11-24T08:07:24.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd4143c40 0x7f7fd41f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd4143c40 0x7f7fd41f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36246/0 (socket says 172.21.15.97:36246) 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 -- 172.21.15.97:0/3260366011 learned_addr learned my addr 172.21.15.97:0/3260366011 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd37fe640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40cc500 0x7f7fd41f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd3fff640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd406d160 0x7f7fd415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 -- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd406d160 msgr2=0x7f7fd415a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd406d160 0x7f7fd415a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 -- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40cc500 msgr2=0x7f7fd41f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40cc500 0x7f7fd41f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 -- 172.21.15.97:0/3260366011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc009b30 con 0x7f7fd4143c40 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.109+0000 7f7fd8c2d640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd4143c40 0x7f7fd41f68a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00efc0 tx=0x7f7fcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.110+0000 7f7fd0ff9640 1 -- 172.21.15.97:0/3260366011 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc018070 con 0x7f7fd4143c40 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.110+0000 7f7fd0ff9640 1 -- 172.21.15.97:0/3260366011 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc00f040 con 0x7f7fd4143c40 2023-11-24T08:07:24.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.110+0000 7f7fd0ff9640 1 -- 172.21.15.97:0/3260366011 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc00ce00 con 0x7f7fd4143c40 2023-11-24T08:07:24.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.110+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc009400 con 0x7f7fd4143c40 2023-11-24T08:07:24.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.110+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd40acce0 con 0x7f7fd4143c40 2023-11-24T08:07:24.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.111+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd40cdf30 con 0x7f7fd4143c40 2023-11-24T08:07:24.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.112+0000 7f7fd0ff9640 1 -- 172.21.15.97:0/3260366011 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fcc014480 con 0x7f7fd4143c40 2023-11-24T08:07:24.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.113+0000 7f7fd0ff9640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7fb406ae40 0x7f7fb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.113+0000 7f7fd0ff9640 1 -- 172.21.15.97:0/3260366011 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fcc0899e0 con 0x7f7fd4143c40 2023-11-24T08:07:24.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.113+0000 7f7fd3fff640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7fb406ae40 0x7f7fb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.114+0000 7f7fd3fff640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7fb406ae40 0x7f7fb406d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f60 tx=0x7f7fc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.117+0000 7f7fd0ff9640 1 -- 172.21.15.97:0/3260366011 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fcc054a80 con 0x7f7fd4143c40 2023-11-24T08:07:24.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.312+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fd4067450 con 0x7f7fd4143c40 2023-11-24T08:07:24.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.314+0000 7f7fd0ff9640 1 -- 172.21.15.97:0/3260366011 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7fcc0580a0 con 0x7f7fd4143c40 2023-11-24T08:07:24.316 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:24.316 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:24.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7fb406ae40 msgr2=0x7f7fb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7fb406ae40 0x7f7fb406d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000f60 tx=0x7f7fc4009040 comp rx=0 tx=0).stop 2023-11-24T08:07:24.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd4143c40 msgr2=0x7f7fd41f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd4143c40 0x7f7fd41f68a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00efc0 tx=0x7f7fcc00c490 comp rx=0 tx=0).stop 2023-11-24T08:07:24.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 shutdown_connections 2023-11-24T08:07:24.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7fb406ae40 0x7f7fb406d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fd4143c40 0x7f7fd41f68a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40cc500 0x7f7fd41f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 --2- 172.21.15.97:0/3260366011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd406d160 0x7f7fd415a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.317+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 >> 172.21.15.97:0/3260366011 conn(0x7f7fd406a800 msgr2=0x7f7fd4071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.318+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 shutdown_connections 2023-11-24T08:07:24.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.318+0000 7f7fd942e640 1 -- 172.21.15.97:0/3260366011 wait complete. 2023-11-24T08:07:24.338 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:24.339 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:24.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.542+0000 7f4544db0640 1 Processor -- start 2023-11-24T08:07:24.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.542+0000 7f4544db0640 1 -- start start 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f4544db0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f454013df80 0x7f454015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f4544db0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 0x7f45400cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f4544db0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f454015f9c0 0x7f45400cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f4544db0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454006c470 con 0x7f454013df80 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f4544db0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454006c750 con 0x7f454015f9c0 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f4544db0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454006ca30 con 0x7f454013e360 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f453e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f454013df80 0x7f454015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f453e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f454013df80 0x7f454015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36252/0 (socket says 172.21.15.97:36252) 2023-11-24T08:07:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.544+0000 7f453e59c640 1 -- 172.21.15.97:0/2242192066 learned_addr learned my addr 172.21.15.97:0/2242192066 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.545+0000 7f453e59c640 1 -- 172.21.15.97:0/2242192066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 msgr2=0x7f45400cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.545+0000 7f453e59c640 1 --2- 172.21.15.97:0/2242192066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 0x7f45400cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.545+0000 7f453e59c640 1 -- 172.21.15.97:0/2242192066 >> v2:172.21.15.183:3300/0 conn(0x7f454015f9c0 msgr2=0x7f45400cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.545+0000 7f453e59c640 1 --2- 172.21.15.97:0/2242192066 >> v2:172.21.15.183:3300/0 conn(0x7f454015f9c0 0x7f45400cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.545+0000 7f453e59c640 1 -- 172.21.15.97:0/2242192066 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454006cd10 con 0x7f454013df80 2023-11-24T08:07:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.546+0000 7f453e59c640 1 --2- 172.21.15.97:0/2242192066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454013df80 0x7f454015bee0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f454006e6d0 tx=0x7f453002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c3e095ce8c19da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.546+0000 7f453dd9b640 1 -- 172.21.15.97:0/2242192066 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530031870 con 0x7f454013df80 2023-11-24T08:07:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.546+0000 7f453dd9b640 1 -- 172.21.15.97:0/2242192066 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45300319d0 con 0x7f454013df80 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.546+0000 7f453dd9b640 1 -- 172.21.15.97:0/2242192066 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530031d60 con 0x7f454013df80 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 -- 172.21.15.97:0/2242192066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454013df80 msgr2=0x7f454015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 --2- 172.21.15.97:0/2242192066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454013df80 0x7f454015bee0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f454006e6d0 tx=0x7f453002b910 comp rx=0 tx=0).stop 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 -- 172.21.15.97:0/2242192066 shutdown_connections 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 --2- 172.21.15.97:0/2242192066 >> v2:172.21.15.183:3300/0 conn(0x7f454015f9c0 0x7f45400cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 --2- 172.21.15.97:0/2242192066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 0x7f45400cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 --2- 172.21.15.97:0/2242192066 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454013df80 0x7f454015bee0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 -- 172.21.15.97:0/2242192066 >> 172.21.15.97:0/2242192066 conn(0x7f454006a800 msgr2=0x7f454006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 -- 172.21.15.97:0/2242192066 shutdown_connections 2023-11-24T08:07:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.547+0000 7f4544db0640 1 -- 172.21.15.97:0/2242192066 wait complete. 2023-11-24T08:07:24.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.549+0000 7f4544db0640 1 Processor -- start 2023-11-24T08:07:24.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.549+0000 7f4544db0640 1 -- start start 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f4544db0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454013df80 0x7f4540154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f4544db0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 0x7f45401f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f4544db0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454015f9c0 0x7f454015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f4544db0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540154ca0 con 0x7f454015f9c0 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f4544db0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400706a0 con 0x7f454013df80 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f4544db0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b38d0 con 0x7f454013e360 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454015f9c0 0x7f454015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454015f9c0 0x7f454015a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36264/0 (socket says 172.21.15.97:36264) 2023-11-24T08:07:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453ed9d640 1 -- 172.21.15.97:0/2022643051 learned_addr learned my addr 172.21.15.97:0/2022643051 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453e59c640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454013df80 0x7f4540154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453ed9d640 1 -- 172.21.15.97:0/2022643051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 msgr2=0x7f45401f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453ed9d640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 0x7f45401f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453ed9d640 1 -- 172.21.15.97:0/2022643051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454013df80 msgr2=0x7f4540154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.550+0000 7f453ed9d640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454013df80 0x7f4540154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.551+0000 7f453ed9d640 1 -- 172.21.15.97:0/2022643051 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300094d0 con 0x7f454015f9c0 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.551+0000 7f453ed9d640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454015f9c0 0x7f454015a140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f453800b9a0 tx=0x7f453800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.551+0000 7f4536ffd640 1 -- 172.21.15.97:0/2022643051 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800cba0 con 0x7f454015f9c0 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.551+0000 7f4536ffd640 1 -- 172.21.15.97:0/2022643051 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800cd20 con 0x7f454015f9c0 2023-11-24T08:07:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.551+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45400b3bb0 con 0x7f454015f9c0 2023-11-24T08:07:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.551+0000 7f4536ffd640 1 -- 172.21.15.97:0/2022643051 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538014680 con 0x7f454015f9c0 2023-11-24T08:07:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.551+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4540070f20 con 0x7f454015f9c0 2023-11-24T08:07:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.552+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400675d0 con 0x7f454015f9c0 2023-11-24T08:07:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.553+0000 7f4536ffd640 1 -- 172.21.15.97:0/2022643051 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f453801d3b0 con 0x7f454015f9c0 2023-11-24T08:07:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.554+0000 7f4536ffd640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f452006ae40 0x7f452006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.554+0000 7f4536ffd640 1 -- 172.21.15.97:0/2022643051 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45380895c0 con 0x7f454015f9c0 2023-11-24T08:07:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.554+0000 7f453e59c640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f452006ae40 0x7f452006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.555+0000 7f453e59c640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f452006ae40 0x7f452006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4530036000 tx=0x7f453003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.558+0000 7f4536ffd640 1 -- 172.21.15.97:0/2022643051 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4538054660 con 0x7f454015f9c0 2023-11-24T08:07:24.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.741+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f454015eb50 con 0x7f454015f9c0 2023-11-24T08:07:24.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.742+0000 7f4536ffd640 1 -- 172.21.15.97:0/2022643051 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4538019020 con 0x7f454015f9c0 2023-11-24T08:07:24.744 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:24.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f452006ae40 msgr2=0x7f452006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f452006ae40 0x7f452006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4530036000 tx=0x7f453003c040 comp rx=0 tx=0).stop 2023-11-24T08:07:24.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454015f9c0 msgr2=0x7f454015a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454015f9c0 0x7f454015a140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f453800b9a0 tx=0x7f453800be60 comp rx=0 tx=0).stop 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 shutdown_connections 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f452006ae40 0x7f452006d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f454015f9c0 0x7f454015a140 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454013e360 0x7f45401f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 --2- 172.21.15.97:0/2022643051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454013df80 0x7f4540154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.744+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 >> 172.21.15.97:0/2022643051 conn(0x7f454006a800 msgr2=0x7f454013eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.745+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 shutdown_connections 2023-11-24T08:07:24.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.745+0000 7f4544db0640 1 -- 172.21.15.97:0/2022643051 wait complete. 2023-11-24T08:07:24.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:24.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.961+0000 7fc781683640 1 Processor -- start 2023-11-24T08:07:24.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.962+0000 7fc781683640 1 -- start start 2023-11-24T08:07:24.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.964+0000 7fc781683640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc77c14b2c0 0x7fc77c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.964+0000 7fc781683640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c0cfbf0 con 0x7fc77c0cf7d0 2023-11-24T08:07:24.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.964+0000 7fc781683640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c071690 con 0x7fc77c071070 2023-11-24T08:07:24.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.964+0000 7fc781683640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c14b6a0 con 0x7fc77c14b2c0 2023-11-24T08:07:24.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.964+0000 7fc77affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc77c14b2c0 0x7fc77c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.964+0000 7fc773fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc77c0cf7d0 0x7fc77c070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54096/0 (socket says 172.21.15.97:54096) 2023-11-24T08:07:24.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.964+0000 7fc773fff640 1 -- 172.21.15.97:0/1763937579 learned_addr learned my addr 172.21.15.97:0/1763937579 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:24.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.965+0000 7fc77affd640 1 -- 172.21.15.97:0/1763937579 >> v1:172.21.15.183:6789/0 conn(0x7fc77c071070 legacy=0x7fc77c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:24.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.965+0000 7fc77affd640 1 -- 172.21.15.97:0/1763937579 >> v1:172.21.15.97:6789/0 conn(0x7fc77c0cf7d0 legacy=0x7fc77c070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.965+0000 7fc77affd640 1 -- 172.21.15.97:0/1763937579 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c071970 con 0x7fc77c14b2c0 2023-11-24T08:07:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.966+0000 7fc77affd640 1 --2- 172.21.15.97:0/1763937579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c14b2c0 0x7fc77c0cf290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0097a0 tx=0x7fc76c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a8a5354f4ce97e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.966+0000 7fc77a7fc640 1 -- 172.21.15.97:0/1763937579 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c031830 con 0x7fc77c14b2c0 2023-11-24T08:07:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.966+0000 7fc77a7fc640 1 -- 172.21.15.97:0/1763937579 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c031990 con 0x7fc77c14b2c0 2023-11-24T08:07:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.966+0000 7fc77a7fc640 1 -- 172.21.15.97:0/1763937579 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c031d20 con 0x7fc77c14b2c0 2023-11-24T08:07:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.967+0000 7fc781683640 1 -- 172.21.15.97:0/1763937579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c14b2c0 msgr2=0x7fc77c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.967+0000 7fc781683640 1 --2- 172.21.15.97:0/1763937579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c14b2c0 0x7fc77c0cf290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0097a0 tx=0x7fc76c02b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.967+0000 7fc781683640 1 -- 172.21.15.97:0/1763937579 shutdown_connections 2023-11-24T08:07:24.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.967+0000 7fc781683640 1 --2- 172.21.15.97:0/1763937579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c14b2c0 0x7fc77c0cf290 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.967+0000 7fc781683640 1 -- 172.21.15.97:0/1763937579 >> 172.21.15.97:0/1763937579 conn(0x7fc77c06a800 msgr2=0x7fc77c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.967+0000 7fc781683640 1 -- 172.21.15.97:0/1763937579 shutdown_connections 2023-11-24T08:07:24.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.967+0000 7fc781683640 1 -- 172.21.15.97:0/1763937579 wait complete. 2023-11-24T08:07:24.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.969+0000 7fc781683640 1 Processor -- start 2023-11-24T08:07:24.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.969+0000 7fc781683640 1 -- start start 2023-11-24T08:07:24.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.969+0000 7fc781683640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c071070 0x7fc77c141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc781683640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc77c0cf7d0 0x7fc77c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc781683640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc77c14b2c0 0x7fc77c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc781683640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1f7340 con 0x7fc77c071070 2023-11-24T08:07:24.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc781683640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c151970 con 0x7fc77c0cf7d0 2023-11-24T08:07:24.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc781683640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c151c50 con 0x7fc77c14b2c0 2023-11-24T08:07:24.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c071070 0x7fc77c141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c071070 0x7fc77c141ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36278/0 (socket says 172.21.15.97:36278) 2023-11-24T08:07:24.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 -- 172.21.15.97:0/287220286 learned_addr learned my addr 172.21.15.97:0/287220286 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:24.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 -- 172.21.15.97:0/287220286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc77c14b2c0 msgr2=0x7fc77c0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc77c14b2c0 0x7fc77c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 -- 172.21.15.97:0/287220286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc77c0cf7d0 msgr2=0x7fc77c142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc773fff640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc77c0cf7d0 0x7fc77c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc77c0cf7d0 0x7fc77c142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.970+0000 7fc77affd640 1 -- 172.21.15.97:0/287220286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c009400 con 0x7fc77c071070 2023-11-24T08:07:24.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.971+0000 7fc77affd640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c071070 0x7fc77c141ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc76c000c00 tx=0x7fc76c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.971+0000 7fc7737fe640 1 -- 172.21.15.97:0/287220286 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c03aa60 con 0x7fc77c071070 2023-11-24T08:07:24.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.971+0000 7fc7737fe640 1 -- 172.21.15.97:0/287220286 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c03abc0 con 0x7fc77c071070 2023-11-24T08:07:24.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.971+0000 7fc7737fe640 1 -- 172.21.15.97:0/287220286 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0443f0 con 0x7fc77c071070 2023-11-24T08:07:24.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.971+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c151f30 con 0x7fc77c071070 2023-11-24T08:07:24.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.971+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c1524f0 con 0x7fc77c071070 2023-11-24T08:07:24.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.972+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c1526e0 con 0x7fc77c071070 2023-11-24T08:07:24.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.973+0000 7fc7737fe640 1 -- 172.21.15.97:0/287220286 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc76c04d450 con 0x7fc77c071070 2023-11-24T08:07:24.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.974+0000 7fc7737fe640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc75c06ae40 0x7fc75c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.974+0000 7fc7737fe640 1 -- 172.21.15.97:0/287220286 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc76c0ab8b0 con 0x7fc77c071070 2023-11-24T08:07:24.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.974+0000 7fc773fff640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc75c06ae40 0x7fc75c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.975+0000 7fc773fff640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc75c06ae40 0x7fc75c06d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc77c161640 tx=0x7fc764009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:24.978+0000 7fc7737fe640 1 -- 172.21.15.97:0/287220286 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc76c0768c0 con 0x7fc77c071070 2023-11-24T08:07:25.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.170+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc77c0675d0 con 0x7fc77c071070 2023-11-24T08:07:25.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.171+0000 7fc7737fe640 1 -- 172.21.15.97:0/287220286 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc76c035020 con 0x7fc77c071070 2023-11-24T08:07:25.173 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:25.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc75c06ae40 msgr2=0x7fc75c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc75c06ae40 0x7fc75c06d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc77c161640 tx=0x7fc764009040 comp rx=0 tx=0).stop 2023-11-24T08:07:25.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c071070 msgr2=0x7fc77c141ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c071070 0x7fc77c141ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc76c000c00 tx=0x7fc76c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 shutdown_connections 2023-11-24T08:07:25.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc75c06ae40 0x7fc75c06d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc77c14b2c0 0x7fc77c0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc77c0cf7d0 0x7fc77c142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 --2- 172.21.15.97:0/287220286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc77c071070 0x7fc77c141ee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 >> 172.21.15.97:0/287220286 conn(0x7fc77c06a800 msgr2=0x7fc77c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:25.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 shutdown_connections 2023-11-24T08:07:25.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.174+0000 7fc781683640 1 -- 172.21.15.97:0/287220286 wait complete. 2023-11-24T08:07:25.195 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:25.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.411+0000 7fd18893a640 1 Processor -- start 2023-11-24T08:07:25.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.411+0000 7fd18893a640 1 -- start start 2023-11-24T08:07:25.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.413+0000 7fd18893a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840b3ae0 0x7fd18415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.413+0000 7fd18893a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd1840cf290 0x7fd1840cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.413+0000 7fd18893a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd184070c40 con 0x7fd1840ae5a0 2023-11-24T08:07:25.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.413+0000 7fd18893a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd184071450 con 0x7fd1840cf290 2023-11-24T08:07:25.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.413+0000 7fd18893a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840cfc60 con 0x7fd1840b3ae0 2023-11-24T08:07:25.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.413+0000 7fd182d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd1840cf290 0x7fd1840cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.413+0000 7fd18259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd1840ae5a0 0x7fd18406cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54108/0 (socket says 172.21.15.97:54108) 2023-11-24T08:07:25.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.414+0000 7fd18259c640 1 -- 172.21.15.97:0/206247321 learned_addr learned my addr 172.21.15.97:0/206247321 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:25.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.414+0000 7fd17bfff640 1 --2- 172.21.15.97:0/206247321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840b3ae0 0x7fd18415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.414+0000 7fd182d9d640 1 -- 172.21.15.97:0/206247321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840b3ae0 msgr2=0x7fd18415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:25.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.414+0000 7fd182d9d640 1 --2- 172.21.15.97:0/206247321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840b3ae0 0x7fd18415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.414+0000 7fd182d9d640 1 -- 172.21.15.97:0/206247321 >> v1:172.21.15.97:6789/0 conn(0x7fd1840ae5a0 legacy=0x7fd18406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.414+0000 7fd182d9d640 1 -- 172.21.15.97:0/206247321 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18406c470 con 0x7fd1840cf290 2023-11-24T08:07:25.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.414+0000 7fd181d9b640 1 -- 172.21.15.97:0/206247321 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146566989 0 0) 0x7fd184070c40 con 0x7fd1840ae5a0 2023-11-24T08:07:25.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.415+0000 7fd182d9d640 1 --2- 172.21.15.97:0/206247321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840cf290 0x7fd1840cf720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009d90 tx=0x7fd17c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4c7ea052eb27c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.415+0000 7fd181d9b640 1 -- 172.21.15.97:0/206247321 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c02cce0 con 0x7fd1840cf290 2023-11-24T08:07:25.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.415+0000 7fd181d9b640 1 -- 172.21.15.97:0/206247321 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c02ce40 con 0x7fd1840cf290 2023-11-24T08:07:25.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.415+0000 7fd181d9b640 1 -- 172.21.15.97:0/206247321 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c034660 con 0x7fd1840cf290 2023-11-24T08:07:25.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 -- 172.21.15.97:0/206247321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840cf290 msgr2=0x7fd1840cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 --2- 172.21.15.97:0/206247321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840cf290 0x7fd1840cf720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009d90 tx=0x7fd17c02bf30 comp rx=0 tx=0).stop 2023-11-24T08:07:25.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 -- 172.21.15.97:0/206247321 shutdown_connections 2023-11-24T08:07:25.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 --2- 172.21.15.97:0/206247321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840cf290 0x7fd1840cf720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 --2- 172.21.15.97:0/206247321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840b3ae0 0x7fd18415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 -- 172.21.15.97:0/206247321 >> 172.21.15.97:0/206247321 conn(0x7fd18406a800 msgr2=0x7fd18406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:25.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 -- 172.21.15.97:0/206247321 shutdown_connections 2023-11-24T08:07:25.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.416+0000 7fd18893a640 1 -- 172.21.15.97:0/206247321 wait complete. 2023-11-24T08:07:25.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.418+0000 7fd18893a640 1 Processor -- start 2023-11-24T08:07:25.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.418+0000 7fd18893a640 1 -- start start 2023-11-24T08:07:25.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.419+0000 7fd18893a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840ae5a0 0x7fd1841f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.419+0000 7fd18893a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1840b3ae0 0x7fd18415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.419+0000 7fd18893a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840cf290 0x7fd18415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.419+0000 7fd18893a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd184157ca0 con 0x7fd1840ae5a0 2023-11-24T08:07:25.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.419+0000 7fd18893a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd184157f80 con 0x7fd1840b3ae0 2023-11-24T08:07:25.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.419+0000 7fd18893a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd184158260 con 0x7fd1840cf290 2023-11-24T08:07:25.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.419+0000 7fd18259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840ae5a0 0x7fd1841f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840ae5a0 0x7fd1841f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36298/0 (socket says 172.21.15.97:36298) 2023-11-24T08:07:25.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 -- 172.21.15.97:0/1937965514 learned_addr learned my addr 172.21.15.97:0/1937965514 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:25.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd182d9d640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840cf290 0x7fd18415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd17bfff640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1840b3ae0 0x7fd18415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 -- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840cf290 msgr2=0x7fd18415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840cf290 0x7fd18415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 -- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1840b3ae0 msgr2=0x7fd18415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1840b3ae0 0x7fd18415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 -- 172.21.15.97:0/1937965514 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c009a70 con 0x7fd1840ae5a0 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18259c640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840ae5a0 0x7fd1841f2410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd17400c4d0 tx=0x7fd17400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd17affd640 1 -- 172.21.15.97:0/1937965514 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1740074e0 con 0x7fd1840ae5a0 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd17affd640 1 -- 172.21.15.97:0/1937965514 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174007660 con 0x7fd1840ae5a0 2023-11-24T08:07:25.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd17affd640 1 -- 172.21.15.97:0/1937965514 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174004a20 con 0x7fd1840ae5a0 2023-11-24T08:07:25.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.420+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd184158540 con 0x7fd1840ae5a0 2023-11-24T08:07:25.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.421+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd184157110 con 0x7fd1840ae5a0 2023-11-24T08:07:25.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.422+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1840675d0 con 0x7fd1840ae5a0 2023-11-24T08:07:25.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.423+0000 7fd17affd640 1 -- 172.21.15.97:0/1937965514 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd174004b80 con 0x7fd1840ae5a0 2023-11-24T08:07:25.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.423+0000 7fd17affd640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd16406ae40 0x7fd16406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.424+0000 7fd17affd640 1 -- 172.21.15.97:0/1937965514 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1740887b0 con 0x7fd1840ae5a0 2023-11-24T08:07:25.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.424+0000 7fd17bfff640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd16406ae40 0x7fd16406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.425+0000 7fd17bfff640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd16406ae40 0x7fd16406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd184158eb0 tx=0x7fd16c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.428+0000 7fd17affd640 1 -- 172.21.15.97:0/1937965514 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd174053850 con 0x7fd1840ae5a0 2023-11-24T08:07:25.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.620+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd18415eb50 con 0x7fd1840ae5a0 2023-11-24T08:07:25.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.621+0000 7fd17affd640 1 -- 172.21.15.97:0/1937965514 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1740180a0 con 0x7fd1840ae5a0 2023-11-24T08:07:25.624 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd16406ae40 msgr2=0x7fd16406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd16406ae40 0x7fd16406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd184158eb0 tx=0x7fd16c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840ae5a0 msgr2=0x7fd1841f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840ae5a0 0x7fd1841f2410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd17400c4d0 tx=0x7fd17400c990 comp rx=0 tx=0).stop 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 shutdown_connections 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd16406ae40 0x7fd16406d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1840cf290 0x7fd18415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1840b3ae0 0x7fd18415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 --2- 172.21.15.97:0/1937965514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1840ae5a0 0x7fd1841f2410 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 >> 172.21.15.97:0/1937965514 conn(0x7fd18406a800 msgr2=0x7fd18414fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:25.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 shutdown_connections 2023-11-24T08:07:25.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.624+0000 7fd18893a640 1 -- 172.21.15.97:0/1937965514 wait complete. 2023-11-24T08:07:25.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-11-24T08:07:25.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.839+0000 7f381b59e640 1 Processor -- start 2023-11-24T08:07:25.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.839+0000 7f381b59e640 1 -- start start 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c160920 0x7f381c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381b59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f381c0cf9f0 0x7f381c0cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381b59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f381c161010 0x7f381c1614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381b59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0d03b0 con 0x7f381c161010 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381b59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0d0a10 con 0x7f381c0cf9f0 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381b59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0cf080 con 0x7f381c160920 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381ad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f381c161010 0x7f381c1614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381ad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f381c161010 0x7f381c1614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36300/0 (socket says 172.21.15.97:36300) 2023-11-24T08:07:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.841+0000 7f381ad9d640 1 -- 172.21.15.97:0/2875858981 learned_addr learned my addr 172.21.15.97:0/2875858981 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.842+0000 7f381a59c640 1 --2- 172.21.15.97:0/2875858981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c160920 0x7f381c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.842+0000 7f381ad9d640 1 -- 172.21.15.97:0/2875858981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c160920 msgr2=0x7f381c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.842+0000 7f381ad9d640 1 --2- 172.21.15.97:0/2875858981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c160920 0x7f381c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.842+0000 7f381ad9d640 1 -- 172.21.15.97:0/2875858981 >> v2:172.21.15.183:3300/0 conn(0x7f381c0cf9f0 msgr2=0x7f381c0cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:25.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.842+0000 7f3819d9b640 1 --2- 172.21.15.97:0/2875858981 >> v2:172.21.15.183:3300/0 conn(0x7f381c0cf9f0 0x7f381c0cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.842+0000 7f381ad9d640 1 --2- 172.21.15.97:0/2875858981 >> v2:172.21.15.183:3300/0 conn(0x7f381c0cf9f0 0x7f381c0cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.842+0000 7f381ad9d640 1 -- 172.21.15.97:0/2875858981 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0c6be0 con 0x7f381c161010 2023-11-24T08:07:25.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.843+0000 7f381ad9d640 1 --2- 172.21.15.97:0/2875858981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c1614a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f381c08d300 tx=0x7f381402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4612c0a059fedcb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.843+0000 7f381959a640 1 -- 172.21.15.97:0/2875858981 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814031870 con 0x7f381c161010 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.843+0000 7f381959a640 1 -- 172.21.15.97:0/2875858981 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140319d0 con 0x7f381c161010 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.843+0000 7f381959a640 1 -- 172.21.15.97:0/2875858981 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814031d60 con 0x7f381c161010 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 -- 172.21.15.97:0/2875858981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 msgr2=0x7f381c1614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 --2- 172.21.15.97:0/2875858981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c1614a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f381c08d300 tx=0x7f381402b910 comp rx=0 tx=0).stop 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 -- 172.21.15.97:0/2875858981 shutdown_connections 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 --2- 172.21.15.97:0/2875858981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c1614a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 --2- 172.21.15.97:0/2875858981 >> v2:172.21.15.183:3300/0 conn(0x7f381c0cf9f0 0x7f381c0cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 --2- 172.21.15.97:0/2875858981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c160920 0x7f381c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 -- 172.21.15.97:0/2875858981 >> 172.21.15.97:0/2875858981 conn(0x7f381c0d3090 msgr2=0x7f381c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:25.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 -- 172.21.15.97:0/2875858981 shutdown_connections 2023-11-24T08:07:25.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.844+0000 7f381b59e640 1 -- 172.21.15.97:0/2875858981 wait complete. 2023-11-24T08:07:25.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.846+0000 7f381b59e640 1 Processor -- start 2023-11-24T08:07:25.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.846+0000 7f381b59e640 1 -- start start 2023-11-24T08:07:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381b59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c0cf9f0 0x7f381c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381b59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f381c160920 0x7f381c0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381b59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c154510 con 0x7f381c161010 2023-11-24T08:07:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381b59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b6610 con 0x7f381c160920 2023-11-24T08:07:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381b59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b68f0 con 0x7f381c0cf9f0 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36310/0 (socket says 172.21.15.97:36310) 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 -- 172.21.15.97:0/1271106548 learned_addr learned my addr 172.21.15.97:0/1271106548 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381a59c640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c0cf9f0 0x7f381c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f3819d9b640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f381c160920 0x7f381c0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 -- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c0cf9f0 msgr2=0x7f381c153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c0cf9f0 0x7f381c153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 -- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f381c160920 msgr2=0x7f381c0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f381c160920 0x7f381c0b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.848+0000 7f381ad9d640 1 -- 172.21.15.97:0/1271106548 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38140094d0 con 0x7f381c161010 2023-11-24T08:07:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.849+0000 7f381ad9d640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c0caa50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f38140090b0 tx=0x7f38140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.849+0000 7f3812ffd640 1 -- 172.21.15.97:0/1271106548 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381403ac60 con 0x7f381c161010 2023-11-24T08:07:25.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.849+0000 7f3812ffd640 1 -- 172.21.15.97:0/1271106548 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381403adc0 con 0x7f381c161010 2023-11-24T08:07:25.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.849+0000 7f3812ffd640 1 -- 172.21.15.97:0/1271106548 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814044630 con 0x7f381c161010 2023-11-24T08:07:25.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.849+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c0b6bd0 con 0x7f381c161010 2023-11-24T08:07:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.849+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c0b7190 con 0x7f381c161010 2023-11-24T08:07:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.850+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c0b7380 con 0x7f381c161010 2023-11-24T08:07:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.851+0000 7f3812ffd640 1 -- 172.21.15.97:0/1271106548 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f381404d450 con 0x7f381c161010 2023-11-24T08:07:25.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.852+0000 7f3812ffd640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37fc06ae40 0x7f37fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.852+0000 7f3812ffd640 1 -- 172.21.15.97:0/1271106548 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f381402d040 con 0x7f381c161010 2023-11-24T08:07:25.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.852+0000 7f381a59c640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37fc06ae40 0x7f37fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.853+0000 7f381a59c640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37fc06ae40 0x7f37fc06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f380c009f30 tx=0x7f380c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:25.858+0000 7f3812ffd640 1 -- 172.21.15.97:0/1271106548 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3814076c20 con 0x7f381c161010 2023-11-24T08:07:26.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.115+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f381c067450 con 0x7f381c161010 2023-11-24T08:07:26.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.156+0000 7f3812ffd640 1 -- 172.21.15.97:0/1271106548 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3814035070 con 0x7f381c161010 2023-11-24T08:07:26.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.158+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37fc06ae40 msgr2=0x7f37fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.158+0000 7f381b59e640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37fc06ae40 0x7f37fc06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f380c009f30 tx=0x7f380c00b040 comp rx=0 tx=0).stop 2023-11-24T08:07:26.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.158+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 msgr2=0x7f381c0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.158+0000 7f381b59e640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c0caa50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f38140090b0 tx=0x7f38140046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 shutdown_connections 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f37fc06ae40 0x7f37fc06d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c161010 0x7f381c0caa50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f381c160920 0x7f381c0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 --2- 172.21.15.97:0/1271106548 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f381c0cf9f0 0x7f381c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 >> 172.21.15.97:0/1271106548 conn(0x7f381c0d3090 msgr2=0x7f381c0d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 shutdown_connections 2023-11-24T08:07:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.159+0000 7f381b59e640 1 -- 172.21.15.97:0/1271106548 wait complete. 2023-11-24T08:07:26.181 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:07:26.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.380+0000 7fd73a090640 1 Processor -- start 2023-11-24T08:07:26.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.381+0000 7fd73a090640 1 -- start start 2023-11-24T08:07:26.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.382+0000 7fd73a090640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd73415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.382+0000 7fd73a090640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd73413e360 0x7fd7340cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.382+0000 7fd73a090640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73406c470 con 0x7fd73415f9c0 2023-11-24T08:07:26.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.382+0000 7fd73a090640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73406c750 con 0x7fd73413e360 2023-11-24T08:07:26.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.382+0000 7fd73a090640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73406ca30 con 0x7fd73413df80 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd72bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd73413e360 0x7fd7340cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd72bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd73413e360 0x7fd7340cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50736/0 (socket says 172.21.15.97:50736) 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd72bfff640 1 -- 172.21.15.97:0/889816176 learned_addr learned my addr 172.21.15.97:0/889816176 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:26.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd7337fe640 1 --2- 172.21.15.97:0/889816176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd73415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd72bfff640 1 -- 172.21.15.97:0/889816176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 msgr2=0x7fd73415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd72bfff640 1 --2- 172.21.15.97:0/889816176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd73415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd72bfff640 1 -- 172.21.15.97:0/889816176 >> v1:172.21.15.183:6789/0 conn(0x7fd73415f9c0 legacy=0x7fd7341408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.383+0000 7fd72bfff640 1 -- 172.21.15.97:0/889816176 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73406cd10 con 0x7fd73413e360 2023-11-24T08:07:26.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.384+0000 7fd72bfff640 1 --2- 172.21.15.97:0/889816176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd7340cf290 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009870 tx=0x7fd71c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04cd6d4e8282caa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd732ffd640 1 -- 172.21.15.97:0/889816176 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c031640 con 0x7fd73413e360 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd732ffd640 1 -- 172.21.15.97:0/889816176 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0317a0 con 0x7fd73413e360 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd732ffd640 1 -- 172.21.15.97:0/889816176 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c031b30 con 0x7fd73413e360 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd73a090640 1 -- 172.21.15.97:0/889816176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 msgr2=0x7fd7340cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd73a090640 1 --2- 172.21.15.97:0/889816176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd7340cf290 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009870 tx=0x7fd71c02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd73a090640 1 -- 172.21.15.97:0/889816176 shutdown_connections 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd73a090640 1 --2- 172.21.15.97:0/889816176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd7340cf290 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd73a090640 1 --2- 172.21.15.97:0/889816176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd73415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.385+0000 7fd73a090640 1 -- 172.21.15.97:0/889816176 >> 172.21.15.97:0/889816176 conn(0x7fd73406a800 msgr2=0x7fd73406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.386+0000 7fd73a090640 1 -- 172.21.15.97:0/889816176 shutdown_connections 2023-11-24T08:07:26.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.386+0000 7fd73a090640 1 -- 172.21.15.97:0/889816176 wait complete. 2023-11-24T08:07:26.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.388+0000 7fd73a090640 1 Processor -- start 2023-11-24T08:07:26.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.388+0000 7fd73a090640 1 -- start start 2023-11-24T08:07:26.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.389+0000 7fd73a090640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd734071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.389+0000 7fd73a090640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd734154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.389+0000 7fd73a090640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd73415f9c0 0x7fd73414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.389+0000 7fd73a090640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73414bfa0 con 0x7fd73413e360 2023-11-24T08:07:26.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.389+0000 7fd73a090640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7340713e0 con 0x7fd73415f9c0 2023-11-24T08:07:26.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.389+0000 7fd73a090640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7340716c0 con 0x7fd73413df80 2023-11-24T08:07:26.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd734154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd734154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50746/0 (socket says 172.21.15.97:50746) 2023-11-24T08:07:26.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 -- 172.21.15.97:0/1910791509 learned_addr learned my addr 172.21.15.97:0/1910791509 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:26.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 -- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 msgr2=0x7fd734071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd7337fe640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd734071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd733fff640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd73415f9c0 0x7fd73414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd734071ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 -- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd73415f9c0 msgr2=0x7fd73414b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd73415f9c0 0x7fd73414b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 -- 172.21.15.97:0/1910791509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0094d0 con 0x7fd73413e360 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.390+0000 7fd72bfff640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd734154160 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009870 tx=0x7fd71c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.391+0000 7fd730ff9640 1 -- 172.21.15.97:0/1910791509 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c03ac60 con 0x7fd73413e360 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.391+0000 7fd730ff9640 1 -- 172.21.15.97:0/1910791509 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c03ade0 con 0x7fd73413e360 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.391+0000 7fd730ff9640 1 -- 172.21.15.97:0/1910791509 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c044630 con 0x7fd73413e360 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.391+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7340719a0 con 0x7fd73413e360 2023-11-24T08:07:26.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.391+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7341546a0 con 0x7fd73413e360 2023-11-24T08:07:26.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.392+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7341548f0 con 0x7fd73413e360 2023-11-24T08:07:26.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.393+0000 7fd730ff9640 1 -- 172.21.15.97:0/1910791509 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd71c02f050 con 0x7fd73413e360 2023-11-24T08:07:26.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.394+0000 7fd730ff9640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd71406ae40 0x7fd71406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.394+0000 7fd730ff9640 1 -- 172.21.15.97:0/1910791509 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd71c0ab7a0 con 0x7fd73413e360 2023-11-24T08:07:26.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.394+0000 7fd7337fe640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd71406ae40 0x7fd71406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.395+0000 7fd7337fe640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd71406ae40 0x7fd71406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd72400b7c0 tx=0x7fd724008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.400+0000 7fd730ff9640 1 -- 172.21.15.97:0/1910791509 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd71c076840 con 0x7fd73413e360 2023-11-24T08:07:26.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.574+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd734071bb0 con 0x7fd73413e360 2023-11-24T08:07:26.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.582+0000 7fd730ff9640 1 -- 172.21.15.97:0/1910791509 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd71c079e60 con 0x7fd73413e360 2023-11-24T08:07:26.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.584+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd71406ae40 msgr2=0x7fd71406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.584+0000 7fd73a090640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd71406ae40 0x7fd71406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd72400b7c0 tx=0x7fd724008040 comp rx=0 tx=0).stop 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.584+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 msgr2=0x7fd734154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.584+0000 7fd73a090640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd734154160 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009870 tx=0x7fd71c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 shutdown_connections 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd71406ae40 0x7fd71406d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd73415f9c0 0x7fd73414b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd73413e360 0x7fd734154160 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 --2- 172.21.15.97:0/1910791509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd73413df80 0x7fd734071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 >> 172.21.15.97:0/1910791509 conn(0x7fd73406a800 msgr2=0x7fd73415d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 shutdown_connections 2023-11-24T08:07:26.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:26.585+0000 7fd73a090640 1 -- 172.21.15.97:0/1910791509 wait complete. 2023-11-24T08:07:26.605 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:07:26.605 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:26.712 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:26.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:26.745 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:26.836 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:07:26.837 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:07:26.837 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:26.892 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:07:26.892 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:26.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:27.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.192+0000 7f1c690cf640 1 Processor -- start 2023-11-24T08:07:27.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.192+0000 7f1c690cf640 1 -- start start 2023-11-24T08:07:27.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.194+0000 7f1c690cf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640ae5a0 0x7f1c6415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.194+0000 7f1c690cf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c64070c40 con 0x7f1c640cf290 2023-11-24T08:07:27.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.194+0000 7f1c690cf640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6406c470 con 0x7f1c640b3ae0 2023-11-24T08:07:27.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.194+0000 7f1c690cf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64071450 con 0x7f1c640ae5a0 2023-11-24T08:07:27.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.194+0000 7f1c6359e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1c640cf290 0x7f1c640b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34378/0 (socket says 172.21.15.97:34378) 2023-11-24T08:07:27.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.194+0000 7f1c6359e640 1 -- 172.21.15.97:0/688688987 learned_addr learned my addr 172.21.15.97:0/688688987 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:27.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.194+0000 7f1c62d9d640 1 --2- 172.21.15.97:0/688688987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640ae5a0 0x7f1c6415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.195+0000 7f1c6259c640 1 -- 172.21.15.97:0/688688987 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668821005 0 0) 0x7f1c64070c40 con 0x7f1c640cf290 2023-11-24T08:07:27.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.195+0000 7f1c6259c640 1 -- 172.21.15.97:0/688688987 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c50003520 con 0x7f1c640cf290 2023-11-24T08:07:27.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.195+0000 7f1c62d9d640 1 -- 172.21.15.97:0/688688987 >> v1:172.21.15.183:6789/0 conn(0x7f1c640b3ae0 legacy=0x7f1c6406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.195+0000 7f1c6259c640 1 -- 172.21.15.97:0/688688987 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764066464 0 0) 0x7f1c50003520 con 0x7f1c640cf290 2023-11-24T08:07:27.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.195+0000 7f1c62d9d640 1 -- 172.21.15.97:0/688688987 >> v1:172.21.15.97:6789/0 conn(0x7f1c640cf290 legacy=0x7f1c640b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.195+0000 7f1c62d9d640 1 -- 172.21.15.97:0/688688987 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6406c750 con 0x7f1c640ae5a0 2023-11-24T08:07:27.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.196+0000 7f1c62d9d640 1 --2- 172.21.15.97:0/688688987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640ae5a0 0x7f1c6415e430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097d0 tx=0x7f1c5402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb2f47f96d82db87 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c6259c640 1 -- 172.21.15.97:0/688688987 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0019f0 con 0x7f1c640ae5a0 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c6259c640 1 -- 172.21.15.97:0/688688987 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54031580 con 0x7f1c640ae5a0 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c6259c640 1 -- 172.21.15.97:0/688688987 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540318f0 con 0x7f1c640ae5a0 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c690cf640 1 -- 172.21.15.97:0/688688987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640ae5a0 msgr2=0x7f1c6415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c690cf640 1 --2- 172.21.15.97:0/688688987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640ae5a0 0x7f1c6415e430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097d0 tx=0x7f1c5402b8a0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c690cf640 1 -- 172.21.15.97:0/688688987 shutdown_connections 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c690cf640 1 --2- 172.21.15.97:0/688688987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640ae5a0 0x7f1c6415e430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c690cf640 1 -- 172.21.15.97:0/688688987 >> 172.21.15.97:0/688688987 conn(0x7f1c6406a800 msgr2=0x7f1c6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c690cf640 1 -- 172.21.15.97:0/688688987 shutdown_connections 2023-11-24T08:07:27.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.197+0000 7f1c690cf640 1 -- 172.21.15.97:0/688688987 wait complete. 2023-11-24T08:07:27.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.199+0000 7f1c690cf640 1 Processor -- start 2023-11-24T08:07:27.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.199+0000 7f1c690cf640 1 -- start start 2023-11-24T08:07:27.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.200+0000 7f1c690cf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c640ae5a0 0x7f1c64150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.200+0000 7f1c690cf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640b3ae0 0x7f1c6415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.200+0000 7f1c690cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c640cf290 0x7f1c641f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.200+0000 7f1c690cf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64150e00 con 0x7f1c640cf290 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.200+0000 7f1c690cf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641510e0 con 0x7f1c640ae5a0 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.200+0000 7f1c690cf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6415c290 con 0x7f1c640b3ae0 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.200+0000 7f1c6359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c640cf290 0x7f1c641f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c640cf290 0x7f1c641f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50754/0 (socket says 172.21.15.97:50754) 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 -- 172.21.15.97:0/1294175668 learned_addr learned my addr 172.21.15.97:0/1294175668 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c5bfff640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640b3ae0 0x7f1c6415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c62d9d640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c640ae5a0 0x7f1c64150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 -- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640b3ae0 msgr2=0x7f1c6415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640b3ae0 0x7f1c6415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 -- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c640ae5a0 msgr2=0x7f1c64150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c640ae5a0 0x7f1c64150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 -- 172.21.15.97:0/1294175668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54009400 con 0x7f1c640cf290 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c6359e640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c640cf290 0x7f1c641f25a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00cc00 tx=0x7f1c5c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c5b7fe640 1 -- 172.21.15.97:0/1294175668 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00ce10 con 0x7f1c640cf290 2023-11-24T08:07:27.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c5b7fe640 1 -- 172.21.15.97:0/1294175668 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c012400 con 0x7f1c640cf290 2023-11-24T08:07:27.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.201+0000 7f1c5b7fe640 1 -- 172.21.15.97:0/1294175668 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0127b0 con 0x7f1c640cf290 2023-11-24T08:07:27.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.202+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6415bf60 con 0x7f1c640cf290 2023-11-24T08:07:27.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.202+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c640afcb0 con 0x7f1c640cf290 2023-11-24T08:07:27.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.203+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6415c450 con 0x7f1c640cf290 2023-11-24T08:07:27.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.204+0000 7f1c5b7fe640 1 -- 172.21.15.97:0/1294175668 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c5c012910 con 0x7f1c640cf290 2023-11-24T08:07:27.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.205+0000 7f1c5b7fe640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1c4406ae40 0x7f1c4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.205+0000 7f1c5b7fe640 1 -- 172.21.15.97:0/1294175668 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c5c089cc0 con 0x7f1c640cf290 2023-11-24T08:07:27.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.205+0000 7f1c62d9d640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1c4406ae40 0x7f1c4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.206+0000 7f1c62d9d640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1c4406ae40 0x7f1c4406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c54036000 tx=0x7f1c54008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.210+0000 7f1c5b7fe640 1 -- 172.21.15.97:0/1294175668 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c5c054e00 con 0x7f1c640cf290 2023-11-24T08:07:27.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.407+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c6415f0d0 con 0x7f1c640cf290 2023-11-24T08:07:27.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.409+0000 7f1c5b7fe640 1 -- 172.21.15.97:0/1294175668 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f1c6415f0d0 con 0x7f1c640cf290 2023-11-24T08:07:27.413 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:27.413 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:06:43.081044+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1c4406ae40 msgr2=0x7f1c4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1c4406ae40 0x7f1c4406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c54036000 tx=0x7f1c54008030 comp rx=0 tx=0).stop 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c640cf290 msgr2=0x7f1c641f25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c640cf290 0x7f1c641f25a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00cc00 tx=0x7f1c5c00a430 comp rx=0 tx=0).stop 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 shutdown_connections 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1c4406ae40 0x7f1c4406d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c640cf290 0x7f1c641f25a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c640b3ae0 0x7f1c6415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 --2- 172.21.15.97:0/1294175668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c640ae5a0 0x7f1c64150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 >> 172.21.15.97:0/1294175668 conn(0x7f1c6406a800 msgr2=0x7f1c640b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 shutdown_connections 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.412+0000 7f1c690cf640 1 -- 172.21.15.97:0/1294175668 wait complete. 2023-11-24T08:07:27.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:27.434 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:27.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.638+0000 7f23f497a640 1 Processor -- start 2023-11-24T08:07:27.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.638+0000 7f23f497a640 1 -- start start 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23f497a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23f006c730 0x7f23f00b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23f497a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23f0070160 0x7f23f0071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23f497a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f00708d0 con 0x7f23f006cb10 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23f497a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f0070bb0 con 0x7f23f0070160 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23f497a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f0070e90 con 0x7f23f006c730 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23eeffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23f0070160 0x7f23f0071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23eeffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f23f0070160 0x7f23f0071970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50758/0 (socket says 172.21.15.97:50758) 2023-11-24T08:07:27.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.640+0000 7f23eeffd640 1 -- 172.21.15.97:0/3186309070 learned_addr learned my addr 172.21.15.97:0/3186309070 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:27.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.641+0000 7f23ef7fe640 1 --2- 172.21.15.97:0/3186309070 >> v2:172.21.15.183:3300/0 conn(0x7f23f006c730 0x7f23f00b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.641+0000 7f23eeffd640 1 -- 172.21.15.97:0/3186309070 >> v2:172.21.15.183:3300/0 conn(0x7f23f006c730 msgr2=0x7f23f00b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.641+0000 7f23eeffd640 1 --2- 172.21.15.97:0/3186309070 >> v2:172.21.15.183:3300/0 conn(0x7f23f006c730 0x7f23f00b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.641+0000 7f23eeffd640 1 -- 172.21.15.97:0/3186309070 >> v1:172.21.15.97:6789/0 conn(0x7f23f006cb10 legacy=0x7f23f006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.641+0000 7f23eeffd640 1 -- 172.21.15.97:0/3186309070 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0071170 con 0x7f23f0070160 2023-11-24T08:07:27.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.641+0000 7f23ee7fc640 1 -- 172.21.15.97:0/3186309070 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135643402 0 0) 0x7f23f00708d0 con 0x7f23f006cb10 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.642+0000 7f23eeffd640 1 --2- 172.21.15.97:0/3186309070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f0070160 0x7f23f0071970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f23f00727c0 tx=0x7f23e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b79e0d66f6ee22 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.642+0000 7f23ee7fc640 1 -- 172.21.15.97:0/3186309070 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4030860 con 0x7f23f0070160 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.642+0000 7f23ee7fc640 1 -- 172.21.15.97:0/3186309070 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e40309c0 con 0x7f23f0070160 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.642+0000 7f23ee7fc640 1 -- 172.21.15.97:0/3186309070 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4030d50 con 0x7f23f0070160 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 -- 172.21.15.97:0/3186309070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f0070160 msgr2=0x7f23f0071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 --2- 172.21.15.97:0/3186309070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f0070160 0x7f23f0071970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f23f00727c0 tx=0x7f23e402b9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 -- 172.21.15.97:0/3186309070 shutdown_connections 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 --2- 172.21.15.97:0/3186309070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f0070160 0x7f23f0071970 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 --2- 172.21.15.97:0/3186309070 >> v2:172.21.15.183:3300/0 conn(0x7f23f006c730 0x7f23f00b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 -- 172.21.15.97:0/3186309070 >> 172.21.15.97:0/3186309070 conn(0x7f23f006a7d0 msgr2=0x7f23f006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 -- 172.21.15.97:0/3186309070 shutdown_connections 2023-11-24T08:07:27.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.643+0000 7f23f497a640 1 -- 172.21.15.97:0/3186309070 wait complete. 2023-11-24T08:07:27.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.645+0000 7f23f497a640 1 Processor -- start 2023-11-24T08:07:27.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.645+0000 7f23f497a640 1 -- start start 2023-11-24T08:07:27.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23f497a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f006c730 0x7f23f00a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23f497a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23f006cb10 0x7f23f0149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23f497a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23f0070160 0x7f23f014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23f497a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f01f6dd0 con 0x7f23f006c730 2023-11-24T08:07:27.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23f497a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00a8a00 con 0x7f23f006cb10 2023-11-24T08:07:27.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23f497a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00accd0 con 0x7f23f0070160 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23ef7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f006c730 0x7f23f00a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23ef7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f006c730 0x7f23f00a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50764/0 (socket says 172.21.15.97:50764) 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.646+0000 7f23ef7fe640 1 -- 172.21.15.97:0/358493210 learned_addr learned my addr 172.21.15.97:0/358493210 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23effff640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23f0070160 0x7f23f014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23eeffd640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23f006cb10 0x7f23f0149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23ef7fe640 1 -- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23f0070160 msgr2=0x7f23f014a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23ef7fe640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23f0070160 0x7f23f014a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23ef7fe640 1 -- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23f006cb10 msgr2=0x7f23f0149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23ef7fe640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23f006cb10 0x7f23f0149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23ef7fe640 1 -- 172.21.15.97:0/358493210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40094d0 con 0x7f23f006c730 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23eeffd640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23f006cb10 0x7f23f0149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23ef7fe640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f006c730 0x7f23f00a84c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23e000d800 tx=0x7f23e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23d7fff640 1 -- 172.21.15.97:0/358493210 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000b6c0 con 0x7f23f006c730 2023-11-24T08:07:27.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.647+0000 7f23d7fff640 1 -- 172.21.15.97:0/358493210 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e000b820 con 0x7f23f006c730 2023-11-24T08:07:27.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.648+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f01f6fe0 con 0x7f23f006c730 2023-11-24T08:07:27.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.648+0000 7f23d7fff640 1 -- 172.21.15.97:0/358493210 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000bbb0 con 0x7f23f006c730 2023-11-24T08:07:27.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.648+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f01f7560 con 0x7f23f006c730 2023-11-24T08:07:27.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.649+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f00a8b90 con 0x7f23f006c730 2023-11-24T08:07:27.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.650+0000 7f23d7fff640 1 -- 172.21.15.97:0/358493210 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f23e000bd10 con 0x7f23f006c730 2023-11-24T08:07:27.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.651+0000 7f23d7fff640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f23dc06ae70 0x7f23dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.651+0000 7f23d7fff640 1 -- 172.21.15.97:0/358493210 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23e0089c10 con 0x7f23f006c730 2023-11-24T08:07:27.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.651+0000 7f23eeffd640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f23dc06ae70 0x7f23dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.652+0000 7f23eeffd640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f23dc06ae70 0x7f23dc06d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23e4036000 tx=0x7f23e403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.655+0000 7f23d7fff640 1 -- 172.21.15.97:0/358493210 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23f00a8b90 con 0x7f23f006c730 2023-11-24T08:07:27.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.847+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23f00a8b40 con 0x7f23f006c730 2023-11-24T08:07:27.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.847+0000 7f23d7fff640 1 -- 172.21.15.97:0/358493210 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23e0054c20 con 0x7f23f006c730 2023-11-24T08:07:27.850 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:27.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.850+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f23dc06ae70 msgr2=0x7f23dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.850+0000 7f23f497a640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f23dc06ae70 0x7f23dc06d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23e4036000 tx=0x7f23e403b040 comp rx=0 tx=0).stop 2023-11-24T08:07:27.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.850+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f006c730 msgr2=0x7f23f00a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.850+0000 7f23f497a640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f006c730 0x7f23f00a84c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23e000d800 tx=0x7f23e000dcc0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 shutdown_connections 2023-11-24T08:07:27.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f23dc06ae70 0x7f23dc06d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23f0070160 0x7f23f014a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23f006cb10 0x7f23f0149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 --2- 172.21.15.97:0/358493210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23f006c730 0x7f23f00a84c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 >> 172.21.15.97:0/358493210 conn(0x7f23f006a7d0 msgr2=0x7f23f00ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 shutdown_connections 2023-11-24T08:07:27.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:27.851+0000 7f23f497a640 1 -- 172.21.15.97:0/358493210 wait complete. 2023-11-24T08:07:27.870 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:28.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.076+0000 7f1bab59e640 1 Processor -- start 2023-11-24T08:07:28.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.076+0000 7f1bab59e640 1 -- start start 2023-11-24T08:07:28.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1bab59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1bac0ccb50 0x7f1bac070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1bab59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac15bf10 0x7f1bac143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1bab59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac15f4e0 con 0x7f1bac0adf20 2023-11-24T08:07:28.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1bab59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bac15f970 con 0x7f1bac0ccb50 2023-11-24T08:07:28.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1bab59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac15c3c0 con 0x7f1bac15bf10 2023-11-24T08:07:28.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1ba3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1bac0ccb50 0x7f1bac070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1baa59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1bac0adf20 0x7f1bac0cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34392/0 (socket says 172.21.15.97:34392) 2023-11-24T08:07:28.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1baa59c640 1 -- 172.21.15.97:0/3339980229 learned_addr learned my addr 172.21.15.97:0/3339980229 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:28.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1ba3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1bac0ccb50 0x7f1bac070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50770/0 (socket says 172.21.15.97:50770) 2023-11-24T08:07:28.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.078+0000 7f1baad9d640 1 --2- 172.21.15.97:0/3339980229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac15bf10 0x7f1bac143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.079+0000 7f1ba3fff640 1 -- 172.21.15.97:0/3339980229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac15bf10 msgr2=0x7f1bac143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.079+0000 7f1ba3fff640 1 --2- 172.21.15.97:0/3339980229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac15bf10 0x7f1bac143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.079+0000 7f1ba3fff640 1 -- 172.21.15.97:0/3339980229 >> v1:172.21.15.97:6789/0 conn(0x7f1bac0adf20 legacy=0x7f1bac0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.079+0000 7f1ba3fff640 1 -- 172.21.15.97:0/3339980229 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac071130 con 0x7f1bac0ccb50 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.079+0000 7f1ba9d9b640 1 -- 172.21.15.97:0/3339980229 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699733154 0 0) 0x7f1bac15f4e0 con 0x7f1bac0adf20 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.080+0000 7f1ba3fff640 1 --2- 172.21.15.97:0/3339980229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0ccb50 0x7f1bac070a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097a0 tx=0x7f1b9402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e9a6fd9201ca1b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.080+0000 7f1ba9d9b640 1 -- 172.21.15.97:0/3339980229 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94031780 con 0x7f1bac0ccb50 2023-11-24T08:07:28.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.080+0000 7f1ba9d9b640 1 -- 172.21.15.97:0/3339980229 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b940318e0 con 0x7f1bac0ccb50 2023-11-24T08:07:28.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.080+0000 7f1ba9d9b640 1 -- 172.21.15.97:0/3339980229 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94031c70 con 0x7f1bac0ccb50 2023-11-24T08:07:28.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 -- 172.21.15.97:0/3339980229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0ccb50 msgr2=0x7f1bac070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 --2- 172.21.15.97:0/3339980229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0ccb50 0x7f1bac070a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097a0 tx=0x7f1b9402b820 comp rx=0 tx=0).stop 2023-11-24T08:07:28.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 -- 172.21.15.97:0/3339980229 shutdown_connections 2023-11-24T08:07:28.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 --2- 172.21.15.97:0/3339980229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac15bf10 0x7f1bac143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 --2- 172.21.15.97:0/3339980229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0ccb50 0x7f1bac070a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 -- 172.21.15.97:0/3339980229 >> 172.21.15.97:0/3339980229 conn(0x7f1bac06a7d0 msgr2=0x7f1bac06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 -- 172.21.15.97:0/3339980229 shutdown_connections 2023-11-24T08:07:28.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.081+0000 7f1bab59e640 1 -- 172.21.15.97:0/3339980229 wait complete. 2023-11-24T08:07:28.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.083+0000 7f1bab59e640 1 Processor -- start 2023-11-24T08:07:28.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.083+0000 7f1bab59e640 1 -- start start 2023-11-24T08:07:28.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1bab59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0adf20 0x7f1bac06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1bab59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac0ccb50 0x7f1bac1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1bab59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bac15bf10 0x7f1bac0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1bab59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac141c30 con 0x7f1bac0adf20 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1bab59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0c3e30 con 0x7f1bac15bf10 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1bab59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac1f6370 con 0x7f1bac0ccb50 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1baa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0adf20 0x7f1bac06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1baa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0adf20 0x7f1bac06ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50774/0 (socket says 172.21.15.97:50774) 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1baa59c640 1 -- 172.21.15.97:0/1700312903 learned_addr learned my addr 172.21.15.97:0/1700312903 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1baad9d640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bac15bf10 0x7f1bac0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1ba3fff640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac0ccb50 0x7f1bac1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1baa59c640 1 -- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac0ccb50 msgr2=0x7f1bac1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.084+0000 7f1baa59c640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac0ccb50 0x7f1bac1416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1baa59c640 1 -- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bac15bf10 msgr2=0x7f1bac0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1baa59c640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bac15bf10 0x7f1bac0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1baa59c640 1 -- 172.21.15.97:0/1700312903 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94009400 con 0x7f1bac0adf20 2023-11-24T08:07:28.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1ba3fff640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac0ccb50 0x7f1bac1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:28.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1baa59c640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0adf20 0x7f1bac06ca90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c4d0 tx=0x7f1b9c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1ba2ffd640 1 -- 172.21.15.97:0/1700312903 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0074e0 con 0x7f1bac0adf20 2023-11-24T08:07:28.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1ba2ffd640 1 -- 172.21.15.97:0/1700312903 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c007660 con 0x7f1bac0adf20 2023-11-24T08:07:28.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac1f6650 con 0x7f1bac0adf20 2023-11-24T08:07:28.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1ba2ffd640 1 -- 172.21.15.97:0/1700312903 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c004a20 con 0x7f1bac0adf20 2023-11-24T08:07:28.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.085+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac1f6c10 con 0x7f1bac0adf20 2023-11-24T08:07:28.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.086+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bac067450 con 0x7f1bac0adf20 2023-11-24T08:07:28.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.087+0000 7f1ba2ffd640 1 -- 172.21.15.97:0/1700312903 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b9c004b80 con 0x7f1bac0adf20 2023-11-24T08:07:28.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.088+0000 7f1ba2ffd640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1b8c06ae40 0x7f1b8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.088+0000 7f1ba2ffd640 1 -- 172.21.15.97:0/1700312903 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b9c088b40 con 0x7f1bac0adf20 2023-11-24T08:07:28.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.088+0000 7f1ba3fff640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1b8c06ae40 0x7f1b8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.089+0000 7f1ba3fff640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1b8c06ae40 0x7f1b8c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1b94036000 tx=0x7f1b9403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.092+0000 7f1ba2ffd640 1 -- 172.21.15.97:0/1700312903 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b9c053bf0 con 0x7f1bac0adf20 2023-11-24T08:07:28.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.292+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bac06ace0 con 0x7f1bac0adf20 2023-11-24T08:07:28.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.292+0000 7f1ba2ffd640 1 -- 172.21.15.97:0/1700312903 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b9c0180a0 con 0x7f1bac0adf20 2023-11-24T08:07:28.295 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:28.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1b8c06ae40 msgr2=0x7f1b8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1b8c06ae40 0x7f1b8c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1b94036000 tx=0x7f1b9403d040 comp rx=0 tx=0).stop 2023-11-24T08:07:28.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0adf20 msgr2=0x7f1bac06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0adf20 0x7f1bac06ca90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c4d0 tx=0x7f1b9c00c990 comp rx=0 tx=0).stop 2023-11-24T08:07:28.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 shutdown_connections 2023-11-24T08:07:28.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1b8c06ae40 0x7f1b8c06d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bac15bf10 0x7f1bac0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bac0ccb50 0x7f1bac1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 --2- 172.21.15.97:0/1700312903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1bac0adf20 0x7f1bac06ca90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 >> 172.21.15.97:0/1700312903 conn(0x7f1bac06a7d0 msgr2=0x7f1bac143850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 shutdown_connections 2023-11-24T08:07:28.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.295+0000 7f1bab59e640 1 -- 172.21.15.97:0/1700312903 wait complete. 2023-11-24T08:07:28.317 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:28.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.519+0000 7f050631a640 1 Processor -- start 2023-11-24T08:07:28.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.519+0000 7f050631a640 1 -- start start 2023-11-24T08:07:28.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f050631a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f05000adf20 0x7f0500070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f050631a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f050015bf10 0x7f05000cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f050631a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000cc980 0x7f0500143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f050631a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050015f970 con 0x7f050015bf10 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f050631a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050015f4e0 con 0x7f05000adf20 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f050631a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000cce10 con 0x7f05000cc980 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f0504b17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f050015bf10 0x7f05000cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f0504b17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f050015bf10 0x7f05000cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50778/0 (socket says 172.21.15.97:50778) 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f0504b17640 1 -- 172.21.15.97:0/164837702 learned_addr learned my addr 172.21.15.97:0/164837702 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f0505318640 1 --2- 172.21.15.97:0/164837702 >> v2:172.21.15.183:3300/0 conn(0x7f05000adf20 0x7f0500070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.521+0000 7f0505b19640 1 --2- 172.21.15.97:0/164837702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000cc980 0x7f0500143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.522+0000 7f0504b17640 1 -- 172.21.15.97:0/164837702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000cc980 msgr2=0x7f0500143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.522+0000 7f0504b17640 1 --2- 172.21.15.97:0/164837702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000cc980 0x7f0500143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.522+0000 7f0504b17640 1 -- 172.21.15.97:0/164837702 >> v2:172.21.15.183:3300/0 conn(0x7f05000adf20 msgr2=0x7f0500070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.522+0000 7f0504b17640 1 --2- 172.21.15.97:0/164837702 >> v2:172.21.15.183:3300/0 conn(0x7f05000adf20 0x7f0500070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.522+0000 7f0504b17640 1 -- 172.21.15.97:0/164837702 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500071130 con 0x7f050015bf10 2023-11-24T08:07:28.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.522+0000 7f0505b19640 1 --2- 172.21.15.97:0/164837702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000cc980 0x7f0500143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.523+0000 7f0504b17640 1 --2- 172.21.15.97:0/164837702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f050015bf10 0x7f05000cc440 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f05000b4150 tx=0x7f04f002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2373b1a5f359f3a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.523+0000 7f04f7fff640 1 -- 172.21.15.97:0/164837702 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00317e0 con 0x7f050015bf10 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.523+0000 7f04f7fff640 1 -- 172.21.15.97:0/164837702 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0031940 con 0x7f050015bf10 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.523+0000 7f04f7fff640 1 -- 172.21.15.97:0/164837702 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0031cd0 con 0x7f050015bf10 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 -- 172.21.15.97:0/164837702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f050015bf10 msgr2=0x7f05000cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 --2- 172.21.15.97:0/164837702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f050015bf10 0x7f05000cc440 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f05000b4150 tx=0x7f04f002b880 comp rx=0 tx=0).stop 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 -- 172.21.15.97:0/164837702 shutdown_connections 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 --2- 172.21.15.97:0/164837702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000cc980 0x7f0500143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 --2- 172.21.15.97:0/164837702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f050015bf10 0x7f05000cc440 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 --2- 172.21.15.97:0/164837702 >> v2:172.21.15.183:3300/0 conn(0x7f05000adf20 0x7f0500070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 -- 172.21.15.97:0/164837702 >> 172.21.15.97:0/164837702 conn(0x7f050006a7d0 msgr2=0x7f050006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 -- 172.21.15.97:0/164837702 shutdown_connections 2023-11-24T08:07:28.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.524+0000 7f050631a640 1 -- 172.21.15.97:0/164837702 wait complete. 2023-11-24T08:07:28.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.526+0000 7f050631a640 1 Processor -- start 2023-11-24T08:07:28.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.526+0000 7f050631a640 1 -- start start 2023-11-24T08:07:28.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f050631a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000adf20 0x7f050015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f050631a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05000cc980 0x7f050013c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f050631a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050015bf10 0x7f050013c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f050631a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000a8530 con 0x7f05000cc980 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f050631a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050013ba70 con 0x7f050015bf10 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f050631a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050013ae60 con 0x7f05000adf20 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f0504b17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05000cc980 0x7f050013c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f0504b17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05000cc980 0x7f050013c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50790/0 (socket says 172.21.15.97:50790) 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f0504b17640 1 -- 172.21.15.97:0/802183191 learned_addr learned my addr 172.21.15.97:0/802183191 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.527+0000 7f0505b19640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050015bf10 0x7f050013c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.528+0000 7f0505318640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000adf20 0x7f050015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.528+0000 7f0504b17640 1 -- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000adf20 msgr2=0x7f050015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.528+0000 7f0504b17640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000adf20 0x7f050015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.528+0000 7f0504b17640 1 -- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050015bf10 msgr2=0x7f050013c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.528+0000 7f0504b17640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050015bf10 0x7f050013c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.528+0000 7f0504b17640 1 -- 172.21.15.97:0/802183191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00094d0 con 0x7f05000cc980 2023-11-24T08:07:28.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.528+0000 7f0504b17640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05000cc980 0x7f050013c130 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f04f00090b0 tx=0x7f04f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.529+0000 7f04f5ffb640 1 -- 172.21.15.97:0/802183191 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0032880 con 0x7f05000cc980 2023-11-24T08:07:28.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.529+0000 7f04f5ffb640 1 -- 172.21.15.97:0/802183191 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0032a20 con 0x7f05000cc980 2023-11-24T08:07:28.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.529+0000 7f04f5ffb640 1 -- 172.21.15.97:0/802183191 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0032dd0 con 0x7f05000cc980 2023-11-24T08:07:28.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.529+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050013b140 con 0x7f05000cc980 2023-11-24T08:07:28.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.529+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050013b700 con 0x7f05000cc980 2023-11-24T08:07:28.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.530+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050013b890 con 0x7f05000cc980 2023-11-24T08:07:28.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.531+0000 7f04f5ffb640 1 -- 172.21.15.97:0/802183191 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04f004e450 con 0x7f05000cc980 2023-11-24T08:07:28.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.532+0000 7f04f5ffb640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04e406ae40 0x7f04e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.532+0000 7f04f5ffb640 1 -- 172.21.15.97:0/802183191 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f04f00ab740 con 0x7f05000cc980 2023-11-24T08:07:28.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.532+0000 7f0505318640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04e406ae40 0x7f04e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.533+0000 7f0505318640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04e406ae40 0x7f04e406d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0099b0 tx=0x7f04fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.536+0000 7f04f5ffb640 1 -- 172.21.15.97:0/802183191 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04f0076760 con 0x7f05000cc980 2023-11-24T08:07:28.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.729+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05000ada60 con 0x7f05000cc980 2023-11-24T08:07:28.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.730+0000 7f04f5ffb640 1 -- 172.21.15.97:0/802183191 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04f0079d80 con 0x7f05000cc980 2023-11-24T08:07:28.733 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.732+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04e406ae40 msgr2=0x7f04e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.732+0000 7f050631a640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04e406ae40 0x7f04e406d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0099b0 tx=0x7f04fc008040 comp rx=0 tx=0).stop 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05000cc980 msgr2=0x7f050013c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05000cc980 0x7f050013c130 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f04f00090b0 tx=0x7f04f00046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 shutdown_connections 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f04e406ae40 0x7f04e406d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f050015bf10 0x7f050013c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05000cc980 0x7f050013c130 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 --2- 172.21.15.97:0/802183191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05000adf20 0x7f050015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 >> 172.21.15.97:0/802183191 conn(0x7f050006a7d0 msgr2=0x7f05000afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 shutdown_connections 2023-11-24T08:07:28.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.733+0000 7f050631a640 1 -- 172.21.15.97:0/802183191 wait complete. 2023-11-24T08:07:28.754 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:28.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.960+0000 7f3d9f01c640 1 Processor -- start 2023-11-24T08:07:28.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.960+0000 7f3d9f01c640 1 -- start start 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9f01c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d98143ae0 0x7f3d980cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9f01c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d9815e3b0 0x7f3d980702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9f01c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d980cfc30 con 0x7f3d980cf7d0 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9f01c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980b1ee0 con 0x7f3d9815e3b0 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9f01c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980b2780 con 0x7f3d98143ae0 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9d5b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d9815e3b0 0x7f3d980702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9d5b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d9815e3b0 0x7f3d980702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50798/0 (socket says 172.21.15.97:50798) 2023-11-24T08:07:28.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.962+0000 7f3d9d5b9640 1 -- 172.21.15.97:0/1588414608 learned_addr learned my addr 172.21.15.97:0/1588414608 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:28.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.963+0000 7f3d9cdb8640 1 --2- 172.21.15.97:0/1588414608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d98143ae0 0x7f3d980cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.963+0000 7f3d9d5b9640 1 -- 172.21.15.97:0/1588414608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d98143ae0 msgr2=0x7f3d980cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.963+0000 7f3d9d5b9640 1 --2- 172.21.15.97:0/1588414608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d98143ae0 0x7f3d980cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.963+0000 7f3d9d5b9640 1 -- 172.21.15.97:0/1588414608 >> v1:172.21.15.183:6789/0 conn(0x7f3d980cf7d0 legacy=0x7f3d9815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.963+0000 7f3d9d5b9640 1 -- 172.21.15.97:0/1588414608 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9815e990 con 0x7f3d9815e3b0 2023-11-24T08:07:28.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.964+0000 7f3d9d5b9640 1 --2- 172.21.15.97:0/1588414608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d9815e3b0 0x7f3d980702c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000d150 tx=0x7f3d9002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d88518f0b697f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.964+0000 7f3d977fe640 1 -- 172.21.15.97:0/1588414608 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9002ea80 con 0x7f3d9815e3b0 2023-11-24T08:07:28.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.964+0000 7f3d977fe640 1 -- 172.21.15.97:0/1588414608 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9002ebe0 con 0x7f3d9815e3b0 2023-11-24T08:07:28.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.964+0000 7f3d977fe640 1 -- 172.21.15.97:0/1588414608 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90009600 con 0x7f3d9815e3b0 2023-11-24T08:07:28.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 -- 172.21.15.97:0/1588414608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d9815e3b0 msgr2=0x7f3d980702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/1588414608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d9815e3b0 0x7f3d980702c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000d150 tx=0x7f3d9002e0e0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 -- 172.21.15.97:0/1588414608 shutdown_connections 2023-11-24T08:07:28.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/1588414608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d9815e3b0 0x7f3d980702c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/1588414608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d98143ae0 0x7f3d980cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 -- 172.21.15.97:0/1588414608 >> 172.21.15.97:0/1588414608 conn(0x7f3d9806a800 msgr2=0x7f3d9806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 -- 172.21.15.97:0/1588414608 shutdown_connections 2023-11-24T08:07:28.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.965+0000 7f3d9f01c640 1 -- 172.21.15.97:0/1588414608 wait complete. 2023-11-24T08:07:28.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.967+0000 7f3d9f01c640 1 Processor -- start 2023-11-24T08:07:28.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.967+0000 7f3d9f01c640 1 -- start start 2023-11-24T08:07:28.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d9f01c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d980cf7d0 0x7f3d9813fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d9f01c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d98143ae0 0x7f3d9813d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d9f01c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d9815e3b0 0x7f3d981f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d9f01c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9813e9b0 con 0x7f3d98143ae0 2023-11-24T08:07:28.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d9f01c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980cc610 con 0x7f3d980cf7d0 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d9f01c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d98152d00 con 0x7f3d9815e3b0 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d98143ae0 0x7f3d9813d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d98143ae0 0x7f3d9813d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50808/0 (socket says 172.21.15.97:50808) 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d97fff640 1 -- 172.21.15.97:0/2841244506 learned_addr learned my addr 172.21.15.97:0/2841244506 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.968+0000 7f3d9cdb8640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d980cf7d0 0x7f3d9813fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d9d5b9640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d9815e3b0 0x7f3d981f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d97fff640 1 -- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d9815e3b0 msgr2=0x7f3d981f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d97fff640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d9815e3b0 0x7f3d981f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d97fff640 1 -- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d980cf7d0 msgr2=0x7f3d9813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d97fff640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d980cf7d0 0x7f3d9813fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d97fff640 1 -- 172.21.15.97:0/2841244506 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9000bd40 con 0x7f3d98143ae0 2023-11-24T08:07:28.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d97fff640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d98143ae0 0x7f3d9813d1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c460 tx=0x7f3d8400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d957fa640 1 -- 172.21.15.97:0/2841244506 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84012830 con 0x7f3d98143ae0 2023-11-24T08:07:28.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d957fa640 1 -- 172.21.15.97:0/2841244506 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d840129d0 con 0x7f3d98143ae0 2023-11-24T08:07:28.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d957fa640 1 -- 172.21.15.97:0/2841244506 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84012d80 con 0x7f3d98143ae0 2023-11-24T08:07:28.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.969+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d98140320 con 0x7f3d98143ae0 2023-11-24T08:07:28.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.970+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9813e6d0 con 0x7f3d98143ae0 2023-11-24T08:07:28.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.971+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9813e170 con 0x7f3d98143ae0 2023-11-24T08:07:28.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.971+0000 7f3d957fa640 1 -- 172.21.15.97:0/2841244506 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d8401b400 con 0x7f3d98143ae0 2023-11-24T08:07:28.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.972+0000 7f3d957fa640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d7c06ae40 0x7f3d7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.973+0000 7f3d957fa640 1 -- 172.21.15.97:0/2841244506 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3d84089610 con 0x7f3d98143ae0 2023-11-24T08:07:28.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.973+0000 7f3d9cdb8640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d7c06ae40 0x7f3d7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.973+0000 7f3d9cdb8640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d7c06ae40 0x7f3d7c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c006fd0 tx=0x7f3d8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:28.977+0000 7f3d957fa640 1 -- 172.21.15.97:0/2841244506 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d84054630 con 0x7f3d98143ae0 2023-11-24T08:07:29.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.177+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3d980675d0 con 0x7f3d98143ae0 2023-11-24T08:07:29.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.180+0000 7f3d957fa640 1 -- 172.21.15.97:0/2841244506 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3d84057c50 con 0x7f3d98143ae0 2023-11-24T08:07:29.183 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:29.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d7c06ae40 msgr2=0x7f3d7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d7c06ae40 0x7f3d7c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c006fd0 tx=0x7f3d8c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:29.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d98143ae0 msgr2=0x7f3d9813d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d98143ae0 0x7f3d9813d1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c460 tx=0x7f3d8400c920 comp rx=0 tx=0).stop 2023-11-24T08:07:29.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 shutdown_connections 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d7c06ae40 0x7f3d7c06d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d9815e3b0 0x7f3d981f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d98143ae0 0x7f3d9813d1e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 --2- 172.21.15.97:0/2841244506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d980cf7d0 0x7f3d9813fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.183+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 >> 172.21.15.97:0/2841244506 conn(0x7f3d9806a800 msgr2=0x7f3d9806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.184+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 shutdown_connections 2023-11-24T08:07:29.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.184+0000 7f3d9f01c640 1 -- 172.21.15.97:0/2841244506 wait complete. 2023-11-24T08:07:29.206 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:07:29.206 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:29.256 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:29.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.491+0000 7ff3b503d640 1 Processor -- start 2023-11-24T08:07:29.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.491+0000 7ff3b503d640 1 -- start start 2023-11-24T08:07:29.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3b503d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff3b00cf9a0 0x7ff3b0166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3b503d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b015c5f0 con 0x7ff3b013df80 2023-11-24T08:07:29.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3b503d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b006c470 con 0x7ff3b013e360 2023-11-24T08:07:29.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3b503d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b006c750 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3aed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff3b013df80 0x7ff3b015bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34404/0 (socket says 172.21.15.97:34404) 2023-11-24T08:07:29.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3aed9d640 1 -- 172.21.15.97:0/3999595333 learned_addr learned my addr 172.21.15.97:0/3999595333 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:29.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3af59e640 1 --2- 172.21.15.97:0/3999595333 >> v2:172.21.15.97:3300/0 conn(0x7ff3b00cf9a0 0x7ff3b0166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3af59e640 1 -- 172.21.15.97:0/3999595333 >> v1:172.21.15.183:6789/0 conn(0x7ff3b013e360 legacy=0x7ff3b00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:29.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3af59e640 1 -- 172.21.15.97:0/3999595333 >> v1:172.21.15.97:6789/0 conn(0x7ff3b013df80 legacy=0x7ff3b015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3af59e640 1 -- 172.21.15.97:0/3999595333 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b006ca30 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.493+0000 7ff3ae59c640 1 -- 172.21.15.97:0/3999595333 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592385654 0 0) 0x7ff3b015c5f0 con 0x7ff3b013df80 2023-11-24T08:07:29.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.494+0000 7ff3af59e640 1 --2- 172.21.15.97:0/3999595333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0166030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009d90 tx=0x7ff3a802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f834b6c6ba521e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3ae59c640 1 -- 172.21.15.97:0/3999595333 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a802cc60 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3ae59c640 1 -- 172.21.15.97:0/3999595333 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a802cdc0 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3ae59c640 1 -- 172.21.15.97:0/3999595333 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8034660 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3b503d640 1 -- 172.21.15.97:0/3999595333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 msgr2=0x7ff3b0166030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3999595333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0166030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009d90 tx=0x7ff3a802beb0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3b503d640 1 -- 172.21.15.97:0/3999595333 shutdown_connections 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3999595333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0166030 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3b503d640 1 -- 172.21.15.97:0/3999595333 >> 172.21.15.97:0/3999595333 conn(0x7ff3b006a800 msgr2=0x7ff3b006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.495+0000 7ff3b503d640 1 -- 172.21.15.97:0/3999595333 shutdown_connections 2023-11-24T08:07:29.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.496+0000 7ff3b503d640 1 -- 172.21.15.97:0/3999595333 wait complete. 2023-11-24T08:07:29.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.498+0000 7ff3b503d640 1 Processor -- start 2023-11-24T08:07:29.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.498+0000 7ff3b503d640 1 -- start start 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3b503d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3b503d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b013df80 0x7ff3b0159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3b503d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3b013e360 0x7ff3b0071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3b503d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0071400 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3b503d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0070780 con 0x7ff3b013df80 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3b503d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0070a60 con 0x7ff3b013e360 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3aed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3aed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50832/0 (socket says 172.21.15.97:50832) 2023-11-24T08:07:29.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.499+0000 7ff3aed9d640 1 -- 172.21.15.97:0/3618859965 learned_addr learned my addr 172.21.15.97:0/3618859965 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3a7fff640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b013df80 0x7ff3b0159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3af59e640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3b013e360 0x7ff3b0071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3aed9d640 1 -- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3b013e360 msgr2=0x7ff3b0071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3aed9d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3b013e360 0x7ff3b0071820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3aed9d640 1 -- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b013df80 msgr2=0x7ff3b0159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3aed9d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b013df80 0x7ff3b0159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3aed9d640 1 -- 172.21.15.97:0/3618859965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a8009a70 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3a7fff640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b013df80 0x7ff3b0159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:29.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3aed9d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0159a30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c430 tx=0x7ff3a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3a77fe640 1 -- 172.21.15.97:0/3618859965 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00074e0 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3a77fe640 1 -- 172.21.15.97:0/3618859965 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0007660 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3a77fe640 1 -- 172.21.15.97:0/3618859965 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0004a20 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b0070d40 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.500+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b0071d60 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.501+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b00675d0 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.502+0000 7ff3a77fe640 1 -- 172.21.15.97:0/3618859965 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3a0004b80 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.503+0000 7ff3a77fe640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff39006ae40 0x7ff39006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.503+0000 7ff3a77fe640 1 -- 172.21.15.97:0/3618859965 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff3a0089520 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.503+0000 7ff3a7fff640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff39006ae40 0x7ff39006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.504+0000 7ff3a7fff640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff39006ae40 0x7ff39006d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff398007fd0 tx=0x7ff398009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.507+0000 7ff3a77fe640 1 -- 172.21.15.97:0/3618859965 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3a0054550 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.689+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3b006df00 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.691+0000 7ff3a77fe640 1 -- 172.21.15.97:0/3618859965 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7ff3a0057b70 con 0x7ff3b00cf9a0 2023-11-24T08:07:29.694 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:29.695 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff39006ae40 msgr2=0x7ff39006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff39006ae40 0x7ff39006d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff398007fd0 tx=0x7ff398009040 comp rx=0 tx=0).stop 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 msgr2=0x7ff3b0159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0159a30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c430 tx=0x7ff3a000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 shutdown_connections 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff39006ae40 0x7ff39006d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3b013e360 0x7ff3b0071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3b013df80 0x7ff3b0159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 --2- 172.21.15.97:0/3618859965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3b00cf9a0 0x7ff3b0159a30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 >> 172.21.15.97:0/3618859965 conn(0x7ff3b006a800 msgr2=0x7ff3b00cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:29.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 shutdown_connections 2023-11-24T08:07:29.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.694+0000 7ff3b503d640 1 -- 172.21.15.97:0/3618859965 wait complete. 2023-11-24T08:07:29.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:29.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:29.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.926+0000 7f46b8947640 1 Processor -- start 2023-11-24T08:07:29.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.927+0000 7f46b8947640 1 -- start start 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b8947640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46b415d4b0 0x7f46b40d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b8947640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40b41e0 0x7f46b40cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b8947640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b40d0320 con 0x7f46b40cf9a0 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b8947640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b40b2730 con 0x7f46b415d4b0 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b8947640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40d1ec0 con 0x7f46b40b41e0 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46b415d4b0 0x7f46b40d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46b415d4b0 0x7f46b40d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50834/0 (socket says 172.21.15.97:50834) 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b37fe640 1 -- 172.21.15.97:0/1371140476 learned_addr learned my addr 172.21.15.97:0/1371140476 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.928+0000 7f46b3fff640 1 --2- 172.21.15.97:0/1371140476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40b41e0 0x7f46b40cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.929+0000 7f46b37fe640 1 -- 172.21.15.97:0/1371140476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40b41e0 msgr2=0x7f46b40cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:29.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.929+0000 7f46b37fe640 1 --2- 172.21.15.97:0/1371140476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40b41e0 0x7f46b40cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.929+0000 7f46b37fe640 1 -- 172.21.15.97:0/1371140476 >> v1:172.21.15.183:6789/0 conn(0x7f46b40cf9a0 legacy=0x7f46b40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:29.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.929+0000 7f46b37fe640 1 -- 172.21.15.97:0/1371140476 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40b29d0 con 0x7f46b415d4b0 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.930+0000 7f46b37fe640 1 --2- 172.21.15.97:0/1371140476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b415d4b0 0x7f46b40d1550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009e50 tx=0x7f46a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb34b6a636b71ee9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.930+0000 7f46b27fc640 1 -- 172.21.15.97:0/1371140476 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a402ca70 con 0x7f46b415d4b0 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.930+0000 7f46b27fc640 1 -- 172.21.15.97:0/1371140476 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a402cbd0 con 0x7f46b415d4b0 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.930+0000 7f46b27fc640 1 -- 172.21.15.97:0/1371140476 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40343f0 con 0x7f46b415d4b0 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 -- 172.21.15.97:0/1371140476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b415d4b0 msgr2=0x7f46b40d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 --2- 172.21.15.97:0/1371140476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b415d4b0 0x7f46b40d1550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009e50 tx=0x7f46a402bed0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 -- 172.21.15.97:0/1371140476 shutdown_connections 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 --2- 172.21.15.97:0/1371140476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40b41e0 0x7f46b40cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 --2- 172.21.15.97:0/1371140476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b415d4b0 0x7f46b40d1550 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 -- 172.21.15.97:0/1371140476 >> 172.21.15.97:0/1371140476 conn(0x7f46b40d3000 msgr2=0x7f46b40d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:29.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 -- 172.21.15.97:0/1371140476 shutdown_connections 2023-11-24T08:07:29.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.931+0000 7f46b8947640 1 -- 172.21.15.97:0/1371140476 wait complete. 2023-11-24T08:07:29.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.933+0000 7f46b8947640 1 Processor -- start 2023-11-24T08:07:29.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.933+0000 7f46b8947640 1 -- start start 2023-11-24T08:07:29.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b8947640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b40b41e0 0x7f46b409d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b8947640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40cf9a0 0x7f46b415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b8947640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b415d4b0 0x7f46b409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b8947640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40ca550 con 0x7f46b40b41e0 2023-11-24T08:07:29.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b8947640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b415ab30 con 0x7f46b415d4b0 2023-11-24T08:07:29.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b8947640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40a0420 con 0x7f46b40cf9a0 2023-11-24T08:07:29.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b40b41e0 0x7f46b409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.934+0000 7f46b37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b40b41e0 0x7f46b409d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50838/0 (socket says 172.21.15.97:50838) 2023-11-24T08:07:29.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b37fe640 1 -- 172.21.15.97:0/3359000969 learned_addr learned my addr 172.21.15.97:0/3359000969 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:29.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b37fe640 1 -- 172.21.15.97:0/3359000969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40cf9a0 msgr2=0x7f46b415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b3fff640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b415d4b0 0x7f46b409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b37fe640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40cf9a0 0x7f46b415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b37fe640 1 -- 172.21.15.97:0/3359000969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b415d4b0 msgr2=0x7f46b409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b37fe640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b415d4b0 0x7f46b409fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b37fe640 1 -- 172.21.15.97:0/3359000969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009b30 con 0x7f46b40b41e0 2023-11-24T08:07:29.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.935+0000 7f46b37fe640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b40b41e0 0x7f46b409d820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46a4000f80 tx=0x7f46a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.936+0000 7f46abfff640 1 -- 172.21.15.97:0/3359000969 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4009510 con 0x7f46b40b41e0 2023-11-24T08:07:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.936+0000 7f46abfff640 1 -- 172.21.15.97:0/3359000969 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a403e450 con 0x7f46b40b41e0 2023-11-24T08:07:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.936+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b415da10 con 0x7f46b40b41e0 2023-11-24T08:07:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.936+0000 7f46abfff640 1 -- 172.21.15.97:0/3359000969 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a403e800 con 0x7f46b40b41e0 2023-11-24T08:07:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.936+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b40a09e0 con 0x7f46b40b41e0 2023-11-24T08:07:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.937+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4067450 con 0x7f46b40b41e0 2023-11-24T08:07:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.938+0000 7f46abfff640 1 -- 172.21.15.97:0/3359000969 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46a403e960 con 0x7f46b40b41e0 2023-11-24T08:07:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.938+0000 7f46abfff640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f469406ae40 0x7f469406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.939+0000 7f46abfff640 1 -- 172.21.15.97:0/3359000969 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f46a40ac420 con 0x7f46b40b41e0 2023-11-24T08:07:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.939+0000 7f46b2ffd640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f469406ae40 0x7f469406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.939+0000 7f46b2ffd640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f469406ae40 0x7f469406d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f46b408d120 tx=0x7f469c0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:29.943+0000 7f46abfff640 1 -- 172.21.15.97:0/3359000969 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46a4077440 con 0x7f46b40b41e0 2023-11-24T08:07:30.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.136+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46b406bd00 con 0x7f46b40b41e0 2023-11-24T08:07:30.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.136+0000 7f46abfff640 1 -- 172.21.15.97:0/3359000969 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46a407aa60 con 0x7f46b40b41e0 2023-11-24T08:07:30.139 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:30.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f469406ae40 msgr2=0x7f469406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f469406ae40 0x7f469406d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f46b408d120 tx=0x7f469c0079b0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b40b41e0 msgr2=0x7f46b409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b40b41e0 0x7f46b409d820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46a4000f80 tx=0x7f46a4004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 shutdown_connections 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f469406ae40 0x7f469406d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b415d4b0 0x7f46b409fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46b40cf9a0 0x7f46b415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 --2- 172.21.15.97:0/3359000969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46b40b41e0 0x7f46b409d820 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 >> 172.21.15.97:0/3359000969 conn(0x7f46b40d3000 msgr2=0x7f46b406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.139+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 shutdown_connections 2023-11-24T08:07:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.140+0000 7f46b8947640 1 -- 172.21.15.97:0/3359000969 wait complete. 2023-11-24T08:07:30.162 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:30.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.372+0000 7f796262e640 1 Processor -- start 2023-11-24T08:07:30.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.373+0000 7f796262e640 1 -- start start 2023-11-24T08:07:30.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.374+0000 7f796262e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f795c0cf9a0 0x7f795c0cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.374+0000 7f796262e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f795c0b31d0 0x7f795c0b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.374+0000 7f796262e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c0d0320 con 0x7f795c15d4b0 2023-11-24T08:07:30.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.374+0000 7f796262e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0d1c60 con 0x7f795c0b31d0 2023-11-24T08:07:30.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.374+0000 7f796262e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0b2730 con 0x7f795c0cf9a0 2023-11-24T08:07:30.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.374+0000 7f7961e2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f795c0b31d0 0x7f795c0b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.375+0000 7f7961e2d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f795c0b31d0 0x7f795c0b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50846/0 (socket says 172.21.15.97:50846) 2023-11-24T08:07:30.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.375+0000 7f7961e2d640 1 -- 172.21.15.97:0/2921709394 learned_addr learned my addr 172.21.15.97:0/2921709394 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:30.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.375+0000 7f7960e2b640 1 --2- 172.21.15.97:0/2921709394 >> v2:172.21.15.183:3300/0 conn(0x7f795c0cf9a0 0x7f795c0cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.375+0000 7f7961e2d640 1 -- 172.21.15.97:0/2921709394 >> v2:172.21.15.183:3300/0 conn(0x7f795c0cf9a0 msgr2=0x7f795c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.375+0000 7f7961e2d640 1 --2- 172.21.15.97:0/2921709394 >> v2:172.21.15.183:3300/0 conn(0x7f795c0cf9a0 0x7f795c0cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.375+0000 7f7961e2d640 1 -- 172.21.15.97:0/2921709394 >> v1:172.21.15.183:6789/0 conn(0x7f795c15d4b0 legacy=0x7f795c0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.375+0000 7f7961e2d640 1 -- 172.21.15.97:0/2921709394 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c0d1ec0 con 0x7f795c0b31d0 2023-11-24T08:07:30.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.376+0000 7f7961e2d640 1 --2- 172.21.15.97:0/2921709394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c0b31d0 0x7f795c0b3660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f795c08b580 tx=0x7f795402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720253e4259ba918 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.376+0000 7f795bfff640 1 -- 172.21.15.97:0/2921709394 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795402ca80 con 0x7f795c0b31d0 2023-11-24T08:07:30.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.376+0000 7f795bfff640 1 -- 172.21.15.97:0/2921709394 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795402cbe0 con 0x7f795c0b31d0 2023-11-24T08:07:30.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.376+0000 7f795bfff640 1 -- 172.21.15.97:0/2921709394 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540343f0 con 0x7f795c0b31d0 2023-11-24T08:07:30.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 -- 172.21.15.97:0/2921709394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c0b31d0 msgr2=0x7f795c0b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 --2- 172.21.15.97:0/2921709394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c0b31d0 0x7f795c0b3660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f795c08b580 tx=0x7f795402bee0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 -- 172.21.15.97:0/2921709394 shutdown_connections 2023-11-24T08:07:30.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 --2- 172.21.15.97:0/2921709394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c0b31d0 0x7f795c0b3660 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 --2- 172.21.15.97:0/2921709394 >> v2:172.21.15.183:3300/0 conn(0x7f795c0cf9a0 0x7f795c0cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 -- 172.21.15.97:0/2921709394 >> 172.21.15.97:0/2921709394 conn(0x7f795c0d3000 msgr2=0x7f795c0d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 -- 172.21.15.97:0/2921709394 shutdown_connections 2023-11-24T08:07:30.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.377+0000 7f796262e640 1 -- 172.21.15.97:0/2921709394 wait complete. 2023-11-24T08:07:30.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.379+0000 7f796262e640 1 Processor -- start 2023-11-24T08:07:30.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.379+0000 7f796262e640 1 -- start start 2023-11-24T08:07:30.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.380+0000 7f796262e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f795c0b31d0 0x7f795c0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.380+0000 7f796262e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f795c0cf9a0 0x7f795c09cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.380+0000 7f796262e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c15d4b0 0x7f795c09e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.380+0000 7f796262e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c09d220 con 0x7f795c15d4b0 2023-11-24T08:07:30.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.380+0000 7f796262e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c09d480 con 0x7f795c0cf9a0 2023-11-24T08:07:30.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.380+0000 7f796262e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c09d760 con 0x7f795c0b31d0 2023-11-24T08:07:30.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c15d4b0 0x7f795c09e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c15d4b0 0x7f795c09e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50856/0 (socket says 172.21.15.97:50856) 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 -- 172.21.15.97:0/3751244447 learned_addr learned my addr 172.21.15.97:0/3751244447 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7960e2b640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f795c0cf9a0 0x7f795c09cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f796162c640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f795c0b31d0 0x7f795c0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 -- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f795c0b31d0 msgr2=0x7f795c0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f795c0b31d0 0x7f795c0ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 -- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f795c0cf9a0 msgr2=0x7f795c09cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f795c0cf9a0 0x7f795c09cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 -- 172.21.15.97:0/3751244447 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009b30 con 0x7f795c15d4b0 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7960e2b640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f795c0cf9a0 0x7f795c09cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.381+0000 7f7961e2d640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c15d4b0 0x7f795c09e6e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7954036040 tx=0x7f7954004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.382+0000 7f7959ffb640 1 -- 172.21.15.97:0/3751244447 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795403e450 con 0x7f795c15d4b0 2023-11-24T08:07:30.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.382+0000 7f7959ffb640 1 -- 172.21.15.97:0/3751244447 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795403e5d0 con 0x7f795c15d4b0 2023-11-24T08:07:30.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.382+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c09da40 con 0x7f795c15d4b0 2023-11-24T08:07:30.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.382+0000 7f7959ffb640 1 -- 172.21.15.97:0/3751244447 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795403e980 con 0x7f795c15d4b0 2023-11-24T08:07:30.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.382+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c09ec20 con 0x7f795c15d4b0 2023-11-24T08:07:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.383+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c067450 con 0x7f795c15d4b0 2023-11-24T08:07:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.384+0000 7f7959ffb640 1 -- 172.21.15.97:0/3751244447 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f795402cd50 con 0x7f795c15d4b0 2023-11-24T08:07:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.385+0000 7f7959ffb640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f794806ae40 0x7f794806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.385+0000 7f7959ffb640 1 -- 172.21.15.97:0/3751244447 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f79540ac220 con 0x7f795c15d4b0 2023-11-24T08:07:30.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.385+0000 7f796162c640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f794806ae40 0x7f794806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.386+0000 7f796162c640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f794806ae40 0x7f794806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f794c0015d0 tx=0x7f794c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.390+0000 7f7959ffb640 1 -- 172.21.15.97:0/3751244447 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7954077390 con 0x7f795c15d4b0 2023-11-24T08:07:30.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.577+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f795c0ce8a0 con 0x7f795c15d4b0 2023-11-24T08:07:30.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.578+0000 7f7959ffb640 1 -- 172.21.15.97:0/3751244447 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f795407a9b0 con 0x7f795c15d4b0 2023-11-24T08:07:30.581 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:30.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f794806ae40 msgr2=0x7f794806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f794806ae40 0x7f794806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f794c0015d0 tx=0x7f794c009040 comp rx=0 tx=0).stop 2023-11-24T08:07:30.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c15d4b0 msgr2=0x7f795c09e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c15d4b0 0x7f795c09e6e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7954036040 tx=0x7f7954004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 shutdown_connections 2023-11-24T08:07:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f794806ae40 0x7f794806d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c15d4b0 0x7f795c09e6e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f795c0cf9a0 0x7f795c09cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 --2- 172.21.15.97:0/3751244447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f795c0b31d0 0x7f795c0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 >> 172.21.15.97:0/3751244447 conn(0x7f795c0d3000 msgr2=0x7f795c0b7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 shutdown_connections 2023-11-24T08:07:30.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.581+0000 7f796262e640 1 -- 172.21.15.97:0/3751244447 wait complete. 2023-11-24T08:07:30.601 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:30.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.807+0000 7f255446b640 1 Processor -- start 2023-11-24T08:07:30.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.807+0000 7f255446b640 1 -- start start 2023-11-24T08:07:30.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.809+0000 7f255446b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f254c15d610 0x7f254c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.809+0000 7f255446b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c0b3400 con 0x7f254c0d1ef0 2023-11-24T08:07:30.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.809+0000 7f255446b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c0b27f0 con 0x7f254c0ced60 2023-11-24T08:07:30.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.809+0000 7f255446b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c0d1390 con 0x7f254c15d610 2023-11-24T08:07:30.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.809+0000 7f2552a08640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f254c0d1ef0 0x7f254c0b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34418/0 (socket says 172.21.15.97:34418) 2023-11-24T08:07:30.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.809+0000 7f2552a08640 1 -- 172.21.15.97:0/1890591521 learned_addr learned my addr 172.21.15.97:0/1890591521 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:30.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.809+0000 7f2552207640 1 --2- 172.21.15.97:0/1890591521 >> v2:172.21.15.183:3300/0 conn(0x7f254c15d610 0x7f254c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549364622 0 0) 0x7f254c0b3400 con 0x7f254c0d1ef0 2023-11-24T08:07:30.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2534003520 con 0x7f254c0d1ef0 2023-11-24T08:07:30.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 463356639 0 0) 0x7f2534003520 con 0x7f254c0d1ef0 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 >> v2:172.21.15.183:3300/0 conn(0x7f254c15d610 msgr2=0x7f254c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 --2- 172.21.15.97:0/1890591521 >> v2:172.21.15.183:3300/0 conn(0x7f254c15d610 0x7f254c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 >> v1:172.21.15.183:6789/0 conn(0x7f254c0ced60 legacy=0x7f254c0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0b2ad0 con 0x7f254c0d1ef0 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f2544001670 con 0x7f254c0d1ef0 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 >> v1:172.21.15.97:6789/0 conn(0x7f254c0d1ef0 legacy=0x7f254c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534003970 0x7f2534003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340047c0 0x7f2534004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2534005180 0x7f253400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0d1390 con 0x7f2534005180 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253400c020 con 0x7f25340047c0 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.810+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253400c1e0 con 0x7f2534003970 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2552a08640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2534005180 0x7f253400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2552207640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534003970 0x7f2534003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2552a08640 1 -- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534003970 msgr2=0x7f2534003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2552a08640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534003970 0x7f2534003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2551a06640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340047c0 0x7f2534004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2552a08640 1 -- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340047c0 msgr2=0x7f2534004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2552a08640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340047c0 0x7f2534004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.811+0000 7f2552a08640 1 -- 172.21.15.97:0/1890591521 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534003520 con 0x7f2534005180 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.812+0000 7f2552a08640 1 -- 172.21.15.97:0/1890591521 reap_dead start 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.812+0000 7f2552a08640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2534005180 0x7f253400b980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f254400c210 tx=0x7f25340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e3d3041ed6623c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.812+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544005ad0 con 0x7f2534005180 2023-11-24T08:07:30.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.812+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544005c30 con 0x7f2534005180 2023-11-24T08:07:30.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.812+0000 7f2551205640 1 -- 172.21.15.97:0/1890591521 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254402c890 con 0x7f2534005180 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.813+0000 7f255446b640 1 -- 172.21.15.97:0/1890591521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2534005180 msgr2=0x7f253400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.813+0000 7f255446b640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2534005180 0x7f253400b980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f254400c210 tx=0x7f25340057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.813+0000 7f255446b640 1 -- 172.21.15.97:0/1890591521 shutdown_connections 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.813+0000 7f255446b640 1 --2- 172.21.15.97:0/1890591521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2534005180 0x7f253400b980 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.813+0000 7f255446b640 1 -- 172.21.15.97:0/1890591521 >> 172.21.15.97:0/1890591521 conn(0x7f254c09c540 msgr2=0x7f254c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.813+0000 7f255446b640 1 -- 172.21.15.97:0/1890591521 shutdown_connections 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.813+0000 7f255446b640 1 -- 172.21.15.97:0/1890591521 wait complete. 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.815+0000 7f255446b640 1 Processor -- start 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.815+0000 7f255446b640 1 -- start start 2023-11-24T08:07:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.816+0000 7f255446b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534005180 0x7f254c1f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.816+0000 7f255446b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c159300 0x7f254c1f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.816+0000 7f255446b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f254c1600a0 0x7f254c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.816+0000 7f255446b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c15fc10 con 0x7f254c1600a0 2023-11-24T08:07:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.816+0000 7f255446b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0ca020 con 0x7f2534005180 2023-11-24T08:07:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.816+0000 7f255446b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c15f2e0 con 0x7f254c159300 2023-11-24T08:07:30.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.816+0000 7f2552a08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f254c1600a0 0x7f254c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f254c1600a0 0x7f254c160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50876/0 (socket says 172.21.15.97:50876) 2023-11-24T08:07:30.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 -- 172.21.15.97:0/113267711 learned_addr learned my addr 172.21.15.97:0/113267711 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:30.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2551a06640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c159300 0x7f254c1f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552207640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534005180 0x7f254c1f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 -- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c159300 msgr2=0x7f254c1f00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c159300 0x7f254c1f00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 -- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534005180 msgr2=0x7f254c1f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534005180 0x7f254c1f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 -- 172.21.15.97:0/113267711 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c15f5c0 con 0x7f254c1600a0 2023-11-24T08:07:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.817+0000 7f2552a08640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f254c1600a0 0x7f254c160520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f254400c210 tx=0x7f2544001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.818+0000 7f2542ffd640 1 -- 172.21.15.97:0/113267711 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440049e0 con 0x7f254c1600a0 2023-11-24T08:07:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.818+0000 7f2542ffd640 1 -- 172.21.15.97:0/113267711 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544004b40 con 0x7f254c1600a0 2023-11-24T08:07:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.818+0000 7f2542ffd640 1 -- 172.21.15.97:0/113267711 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254402de40 con 0x7f254c1600a0 2023-11-24T08:07:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.818+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c15f8a0 con 0x7f254c1600a0 2023-11-24T08:07:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.818+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c15ef90 con 0x7f254c1600a0 2023-11-24T08:07:30.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.819+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c0675d0 con 0x7f254c1600a0 2023-11-24T08:07:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.820+0000 7f2542ffd640 1 -- 172.21.15.97:0/113267711 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2544032070 con 0x7f254c1600a0 2023-11-24T08:07:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.821+0000 7f2542ffd640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f253806ae40 0x7f253806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.821+0000 7f2542ffd640 1 -- 172.21.15.97:0/113267711 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f254403c070 con 0x7f254c1600a0 2023-11-24T08:07:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.821+0000 7f2552207640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f253806ae40 0x7f253806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.822+0000 7f2552207640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f253806ae40 0x7f253806d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f253c009910 tx=0x7f253c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:30.825+0000 7f2542ffd640 1 -- 172.21.15.97:0/113267711 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25440758c0 con 0x7f254c1600a0 2023-11-24T08:07:31.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.012+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f254c15fd50 con 0x7f254c1600a0 2023-11-24T08:07:31.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.013+0000 7f2542ffd640 1 -- 172.21.15.97:0/113267711 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2544045020 con 0x7f254c1600a0 2023-11-24T08:07:31.016 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.015+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f253806ae40 msgr2=0x7f253806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.015+0000 7f255446b640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f253806ae40 0x7f253806d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f253c009910 tx=0x7f253c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.015+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f254c1600a0 msgr2=0x7f254c160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.015+0000 7f255446b640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f254c1600a0 0x7f254c160520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f254400c210 tx=0x7f2544001a00 comp rx=0 tx=0).stop 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 shutdown_connections 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f253806ae40 0x7f253806d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f254c1600a0 0x7f254c160520 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f254c159300 0x7f254c1f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 --2- 172.21.15.97:0/113267711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534005180 0x7f254c1f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 >> 172.21.15.97:0/113267711 conn(0x7f254c09c540 msgr2=0x7f254c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 shutdown_connections 2023-11-24T08:07:31.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.016+0000 7f255446b640 1 -- 172.21.15.97:0/113267711 wait complete. 2023-11-24T08:07:31.037 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:31.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.236+0000 7f8e79101640 1 Processor -- start 2023-11-24T08:07:31.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.236+0000 7f8e79101640 1 -- start start 2023-11-24T08:07:31.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.238+0000 7f8e79101640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8e740d0b60 0x7f8e740ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.238+0000 7f8e79101640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e7406f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.238+0000 7f8e79101640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e74071de0 con 0x7f8e7406a3e0 2023-11-24T08:07:31.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.238+0000 7f8e79101640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e740af270 con 0x7f8e740d0b60 2023-11-24T08:07:31.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.238+0000 7f8e79101640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74072030 con 0x7f8e740aede0 2023-11-24T08:07:31.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.239+0000 7f8e7359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e7406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.239+0000 7f8e7259c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8e740d0b60 0x7f8e740ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.239+0000 7f8e7359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e7406f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:57154/0 (socket says 172.21.15.97:57154) 2023-11-24T08:07:31.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.239+0000 7f8e7359e640 1 -- 172.21.15.97:0/279535906 learned_addr learned my addr 172.21.15.97:0/279535906 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:31.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.239+0000 7f8e7259c640 1 -- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 msgr2=0x7f8e7406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.240+0000 7f8e7259c640 1 --2- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e7406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.240+0000 7f8e7259c640 1 -- 172.21.15.97:0/279535906 >> v1:172.21.15.183:6789/0 conn(0x7f8e7406a3e0 legacy=0x7f8e7406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.240+0000 7f8e7259c640 1 -- 172.21.15.97:0/279535906 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74072310 con 0x7f8e740d0b60 2023-11-24T08:07:31.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.240+0000 7f8e7359e640 1 --2- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e7406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:31.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.241+0000 7f8e7259c640 1 --2- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e740d0b60 0x7f8e740ac8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0097a0 tx=0x7f8e5c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=738ceb120307e7f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e71d9b640 1 -- 172.21.15.97:0/279535906 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c02d040 con 0x7f8e740d0b60 2023-11-24T08:07:31.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e71d9b640 1 -- 172.21.15.97:0/279535906 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c031810 con 0x7f8e740d0b60 2023-11-24T08:07:31.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e71d9b640 1 -- 172.21.15.97:0/279535906 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c031ba0 con 0x7f8e740d0b60 2023-11-24T08:07:31.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 -- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e740d0b60 msgr2=0x7f8e740ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 --2- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e740d0b60 0x7f8e740ac8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0097a0 tx=0x7f8e5c02b8b0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 -- 172.21.15.97:0/279535906 shutdown_connections 2023-11-24T08:07:31.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 --2- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e7406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 --2- 172.21.15.97:0/279535906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e740d0b60 0x7f8e740ac8d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 -- 172.21.15.97:0/279535906 >> 172.21.15.97:0/279535906 conn(0x7f8e740cfef0 msgr2=0x7f8e740d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 -- 172.21.15.97:0/279535906 shutdown_connections 2023-11-24T08:07:31.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.242+0000 7f8e79101640 1 -- 172.21.15.97:0/279535906 wait complete. 2023-11-24T08:07:31.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.244+0000 7f8e79101640 1 Processor -- start 2023-11-24T08:07:31.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.244+0000 7f8e79101640 1 -- start start 2023-11-24T08:07:31.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.245+0000 7f8e79101640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7406a3e0 0x7f8e74142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.245+0000 7f8e79101640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e74152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.245+0000 7f8e79101640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0b60 0x7f8e74152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.245+0000 7f8e79101640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740ce360 con 0x7f8e740d0b60 2023-11-24T08:07:31.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.245+0000 7f8e79101640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74142ed0 con 0x7f8e7406a3e0 2023-11-24T08:07:31.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.245+0000 7f8e79101640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740cded0 con 0x7f8e740aede0 2023-11-24T08:07:31.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0b60 0x7f8e74152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0b60 0x7f8e74152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50892/0 (socket says 172.21.15.97:50892) 2023-11-24T08:07:31.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 -- 172.21.15.97:0/3880502691 learned_addr learned my addr 172.21.15.97:0/3880502691 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:31.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e72d9d640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7406a3e0 0x7f8e74142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7259c640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e74152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 -- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 msgr2=0x7f8e74152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e74152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 -- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7406a3e0 msgr2=0x7f8e74142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7406a3e0 0x7f8e74142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 -- 172.21.15.97:0/3880502691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c0094d0 con 0x7f8e740d0b60 2023-11-24T08:07:31.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7259c640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e74152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e7359e640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0b60 0x7f8e74152ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e960 tx=0x7f8e6c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.246+0000 7f8e6b7fe640 1 -- 172.21.15.97:0/3880502691 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c004020 con 0x7f8e740d0b60 2023-11-24T08:07:31.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.247+0000 7f8e6b7fe640 1 -- 172.21.15.97:0/3880502691 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c004180 con 0x7f8e740d0b60 2023-11-24T08:07:31.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.247+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c009400 con 0x7f8e740d0b60 2023-11-24T08:07:31.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.247+0000 7f8e6b7fe640 1 -- 172.21.15.97:0/3880502691 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00ca00 con 0x7f8e740d0b60 2023-11-24T08:07:31.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.247+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e740cd5a0 con 0x7f8e740d0b60 2023-11-24T08:07:31.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.248+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e740675d0 con 0x7f8e740d0b60 2023-11-24T08:07:31.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.249+0000 7f8e6b7fe640 1 -- 172.21.15.97:0/3880502691 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e6c00cb60 con 0x7f8e740d0b60 2023-11-24T08:07:31.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.249+0000 7f8e6b7fe640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8e5406ae40 0x7f8e5406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.250+0000 7f8e6b7fe640 1 -- 172.21.15.97:0/3880502691 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8e6c089640 con 0x7f8e740d0b60 2023-11-24T08:07:31.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.250+0000 7f8e72d9d640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8e5406ae40 0x7f8e5406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.250+0000 7f8e72d9d640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8e5406ae40 0x7f8e5406d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e64001d40 tx=0x7f8e64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.254+0000 7f8e6b7fe640 1 -- 172.21.15.97:0/3880502691 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e6c0545d0 con 0x7f8e740d0b60 2023-11-24T08:07:31.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.459+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8e740ce010 con 0x7f8e740d0b60 2023-11-24T08:07:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.459+0000 7f8e6b7fe640 1 -- 172.21.15.97:0/3880502691 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8e6c057bf0 con 0x7f8e740d0b60 2023-11-24T08:07:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:31.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.461+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8e5406ae40 msgr2=0x7f8e5406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8e5406ae40 0x7f8e5406d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e64001d40 tx=0x7f8e64009040 comp rx=0 tx=0).stop 2023-11-24T08:07:31.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0b60 msgr2=0x7f8e74152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0b60 0x7f8e74152ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e960 tx=0x7f8e6c00ee20 comp rx=0 tx=0).stop 2023-11-24T08:07:31.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 shutdown_connections 2023-11-24T08:07:31.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8e5406ae40 0x7f8e5406d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8e740d0b60 0x7f8e74152ab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e740aede0 0x7f8e74152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 --2- 172.21.15.97:0/3880502691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7406a3e0 0x7f8e74142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 >> 172.21.15.97:0/3880502691 conn(0x7f8e740cfef0 msgr2=0x7f8e740b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 shutdown_connections 2023-11-24T08:07:31.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.462+0000 7f8e79101640 1 -- 172.21.15.97:0/3880502691 wait complete. 2023-11-24T08:07:31.482 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi097.front.sepia.ceph.com... 2023-11-24T08:07:31.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:31.482 DEBUG:teuthology.orchestra.run.smithi097:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:31.572 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:31.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:07:31.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:31.573 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:07:31.640 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:07:31.640 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:31.700 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:07:31.701 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:31.754 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:31.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.972+0000 7f1e688d1640 1 Processor -- start 2023-11-24T08:07:31.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.973+0000 7f1e688d1640 1 -- start start 2023-11-24T08:07:31.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.974+0000 7f1e688d1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1e64071410 0x7f1e64146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.974+0000 7f1e688d1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e640717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.974+0000 7f1e688d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1e64071d30 0x7f1e640b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.974+0000 7f1e688d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6406cc20 con 0x7f1e64071d30 2023-11-24T08:07:31.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.974+0000 7f1e688d1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6406cec0 con 0x7f1e64071410 2023-11-24T08:07:31.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.974+0000 7f1e688d1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6406d1a0 con 0x7f1e6406c7c0 2023-11-24T08:07:31.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1e64071d30 0x7f1e640b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1e64071d30 0x7f1e640b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50898/0 (socket says 172.21.15.97:50898) 2023-11-24T08:07:31.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 -- 172.21.15.97:0/1079845707 learned_addr learned my addr 172.21.15.97:0/1079845707 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:31.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e637fe640 1 --2- 172.21.15.97:0/1079845707 >> v2:172.21.15.183:3300/0 conn(0x7f1e64071410 0x7f1e64146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e5bfff640 1 --2- 172.21.15.97:0/1079845707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e640717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 -- 172.21.15.97:0/1079845707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 msgr2=0x7f1e640717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 --2- 172.21.15.97:0/1079845707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e640717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 -- 172.21.15.97:0/1079845707 >> v2:172.21.15.183:3300/0 conn(0x7f1e64071410 msgr2=0x7f1e64146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 --2- 172.21.15.97:0/1079845707 >> v2:172.21.15.183:3300/0 conn(0x7f1e64071410 0x7f1e64146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e63fff640 1 -- 172.21.15.97:0/1079845707 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6406d480 con 0x7f1e64071d30 2023-11-24T08:07:31.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.975+0000 7f1e5bfff640 1 --2- 172.21.15.97:0/1079845707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e640717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.976+0000 7f1e63fff640 1 --2- 172.21.15.97:0/1079845707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b1e00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1e640ad5f0 tx=0x7f1e5c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba8180762e62a0f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e62ffd640 1 -- 172.21.15.97:0/1079845707 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c02ca70 con 0x7f1e64071d30 2023-11-24T08:07:31.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e62ffd640 1 -- 172.21.15.97:0/1079845707 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c02cbd0 con 0x7f1e64071d30 2023-11-24T08:07:31.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e62ffd640 1 -- 172.21.15.97:0/1079845707 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0343f0 con 0x7f1e64071d30 2023-11-24T08:07:31.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e688d1640 1 -- 172.21.15.97:0/1079845707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 msgr2=0x7f1e640b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e688d1640 1 --2- 172.21.15.97:0/1079845707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b1e00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1e640ad5f0 tx=0x7f1e5c02bed0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e688d1640 1 -- 172.21.15.97:0/1079845707 shutdown_connections 2023-11-24T08:07:31.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e688d1640 1 --2- 172.21.15.97:0/1079845707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b1e00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e688d1640 1 --2- 172.21.15.97:0/1079845707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e640717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.977+0000 7f1e688d1640 1 --2- 172.21.15.97:0/1079845707 >> v2:172.21.15.183:3300/0 conn(0x7f1e64071410 0x7f1e64146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.978+0000 7f1e688d1640 1 -- 172.21.15.97:0/1079845707 >> 172.21.15.97:0/1079845707 conn(0x7f1e6406a800 msgr2=0x7f1e6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.978+0000 7f1e688d1640 1 -- 172.21.15.97:0/1079845707 shutdown_connections 2023-11-24T08:07:31.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.978+0000 7f1e688d1640 1 -- 172.21.15.97:0/1079845707 wait complete. 2023-11-24T08:07:31.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.980+0000 7f1e688d1640 1 Processor -- start 2023-11-24T08:07:31.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.980+0000 7f1e688d1640 1 -- start start 2023-11-24T08:07:31.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.981+0000 7f1e688d1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e6415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.981+0000 7f1e688d1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e64071410 0x7f1e640b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.981+0000 7f1e688d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.981+0000 7f1e688d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641e60d0 con 0x7f1e64071d30 2023-11-24T08:07:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.981+0000 7f1e688d1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641e5450 con 0x7f1e64071410 2023-11-24T08:07:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.981+0000 7f1e688d1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641e5730 con 0x7f1e6406c7c0 2023-11-24T08:07:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50912/0 (socket says 172.21.15.97:50912) 2023-11-24T08:07:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 -- 172.21.15.97:0/3919214602 learned_addr learned my addr 172.21.15.97:0/3919214602 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e637fe640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e6415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e5bfff640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e64071410 0x7f1e640b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 -- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 msgr2=0x7f1e6415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e6415c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 -- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e64071410 msgr2=0x7f1e640b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e64071410 0x7f1e640b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 -- 172.21.15.97:0/3919214602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c009b30 con 0x7f1e64071d30 2023-11-24T08:07:31.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e5bfff640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e64071410 0x7f1e640b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.982+0000 7f1e63fff640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b2a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c036040 tx=0x7f1e5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.983+0000 7f1e60ff9640 1 -- 172.21.15.97:0/3919214602 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c009510 con 0x7f1e64071d30 2023-11-24T08:07:31.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.983+0000 7f1e60ff9640 1 -- 172.21.15.97:0/3919214602 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c03e450 con 0x7f1e64071d30 2023-11-24T08:07:31.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.983+0000 7f1e60ff9640 1 -- 172.21.15.97:0/3919214602 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c03e800 con 0x7f1e64071d30 2023-11-24T08:07:31.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.983+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e641e5a10 con 0x7f1e64071d30 2023-11-24T08:07:31.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.983+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6415c8a0 con 0x7f1e64071d30 2023-11-24T08:07:31.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.984+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6415ca30 con 0x7f1e64071d30 2023-11-24T08:07:31.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.985+0000 7f1e60ff9640 1 -- 172.21.15.97:0/3919214602 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e5c03e960 con 0x7f1e64071d30 2023-11-24T08:07:31.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.986+0000 7f1e60ff9640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1e4406ae40 0x7f1e4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.986+0000 7f1e60ff9640 1 -- 172.21.15.97:0/3919214602 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1e5c0ac3a0 con 0x7f1e64071d30 2023-11-24T08:07:31.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.986+0000 7f1e637fe640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1e4406ae40 0x7f1e4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.987+0000 7f1e637fe640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1e4406ae40 0x7f1e4406d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e54006fd0 tx=0x7f1e54008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:31.990+0000 7f1e60ff9640 1 -- 172.21.15.97:0/3919214602 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e5c077580 con 0x7f1e64071d30 2023-11-24T08:07:32.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.183+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e641e6210 con 0x7f1e64071d30 2023-11-24T08:07:32.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.186+0000 7f1e60ff9640 1 -- 172.21.15.97:0/3919214602 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f1e5c07aba0 con 0x7f1e64071d30 2023-11-24T08:07:32.190 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:32.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1e4406ae40 msgr2=0x7f1e4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1e4406ae40 0x7f1e4406d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e54006fd0 tx=0x7f1e54008040 comp rx=0 tx=0).stop 2023-11-24T08:07:32.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 msgr2=0x7f1e640b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b2a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c036040 tx=0x7f1e5c004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:32.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 shutdown_connections 2023-11-24T08:07:32.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1e4406ae40 0x7f1e4406d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e64071d30 0x7f1e640b2a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e64071410 0x7f1e640b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 --2- 172.21.15.97:0/3919214602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e6406c7c0 0x7f1e6415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 >> 172.21.15.97:0/3919214602 conn(0x7f1e6406a800 msgr2=0x7f1e640b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 shutdown_connections 2023-11-24T08:07:32.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.189+0000 7f1e688d1640 1 -- 172.21.15.97:0/3919214602 wait complete. 2023-11-24T08:07:32.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:32.212 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:32.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.422+0000 7faa3994e640 1 Processor -- start 2023-11-24T08:07:32.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.422+0000 7faa3994e640 1 -- start start 2023-11-24T08:07:32.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.424+0000 7faa3994e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faa340adf20 0x7faa34070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.424+0000 7faa3994e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.424+0000 7faa3994e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3415f4e0 con 0x7faa340cc980 2023-11-24T08:07:32.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.424+0000 7faa3994e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3415f970 con 0x7faa340adf20 2023-11-24T08:07:32.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.424+0000 7faa3994e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa340cce10 con 0x7faa3415bf10 2023-11-24T08:07:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.425+0000 7faa3894c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faa340adf20 0x7faa34070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.425+0000 7faa33fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.425+0000 7faa3894c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faa340adf20 0x7faa34070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:38606/0 (socket says 172.21.15.97:38606) 2023-11-24T08:07:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.425+0000 7faa3894c640 1 -- 172.21.15.97:0/3670626621 learned_addr learned my addr 172.21.15.97:0/3670626621 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:32.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.426+0000 7faa3894c640 1 -- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 msgr2=0x7faa340cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.426+0000 7faa3894c640 1 --2- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.426+0000 7faa3894c640 1 -- 172.21.15.97:0/3670626621 >> v1:172.21.15.183:6789/0 conn(0x7faa340cc980 legacy=0x7faa34143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.426+0000 7faa3894c640 1 -- 172.21.15.97:0/3670626621 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34071130 con 0x7faa340adf20 2023-11-24T08:07:32.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.426+0000 7faa33fff640 1 --2- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:32.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.427+0000 7faa3894c640 1 --2- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340adf20 0x7faa34070a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa28009870 tx=0x7faa2802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e3ca47ce5b53c74 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.427+0000 7faa337fe640 1 -- 172.21.15.97:0/3670626621 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28031640 con 0x7faa340adf20 2023-11-24T08:07:32.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.427+0000 7faa337fe640 1 -- 172.21.15.97:0/3670626621 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280317a0 con 0x7faa340adf20 2023-11-24T08:07:32.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.427+0000 7faa337fe640 1 -- 172.21.15.97:0/3670626621 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28031b30 con 0x7faa340adf20 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 -- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340adf20 msgr2=0x7faa34070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 --2- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340adf20 0x7faa34070a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa28009870 tx=0x7faa2802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 -- 172.21.15.97:0/3670626621 shutdown_connections 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 --2- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 --2- 172.21.15.97:0/3670626621 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340adf20 0x7faa34070a30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 -- 172.21.15.97:0/3670626621 >> 172.21.15.97:0/3670626621 conn(0x7faa3406a7d0 msgr2=0x7faa3406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 -- 172.21.15.97:0/3670626621 shutdown_connections 2023-11-24T08:07:32.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.428+0000 7faa3994e640 1 -- 172.21.15.97:0/3670626621 wait complete. 2023-11-24T08:07:32.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.430+0000 7faa3994e640 1 Processor -- start 2023-11-24T08:07:32.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.430+0000 7faa3994e640 1 -- start start 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3994e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa340adf20 0x7faa34139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3994e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340cc980 0x7faa3415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3994e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3994e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa34139560 con 0x7faa340adf20 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3994e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa340c67f0 con 0x7faa340cc980 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3994e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa340c6ad0 con 0x7faa3415bf10 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3894c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa340adf20 0x7faa34139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3894c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa340adf20 0x7faa34139020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50920/0 (socket says 172.21.15.97:50920) 2023-11-24T08:07:32.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.431+0000 7faa3894c640 1 -- 172.21.15.97:0/2738608794 learned_addr learned my addr 172.21.15.97:0/2738608794 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa33fff640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340cc980 0x7faa3415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa3914d640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa3894c640 1 -- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 msgr2=0x7faa340c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa3894c640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa3894c640 1 -- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340cc980 msgr2=0x7faa3415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa3894c640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340cc980 0x7faa3415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa3894c640 1 -- 172.21.15.97:0/2738608794 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20009400 con 0x7faa340adf20 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.432+0000 7faa3894c640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa340adf20 0x7faa34139020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faa28009870 tx=0x7faa280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.433+0000 7faa317fa640 1 -- 172.21.15.97:0/2738608794 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2803a930 con 0x7faa340adf20 2023-11-24T08:07:32.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.433+0000 7faa317fa640 1 -- 172.21.15.97:0/2738608794 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2803aa90 con 0x7faa340adf20 2023-11-24T08:07:32.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.433+0000 7faa317fa640 1 -- 172.21.15.97:0/2738608794 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2803ae40 con 0x7faa340adf20 2023-11-24T08:07:32.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.433+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa280094d0 con 0x7faa340adf20 2023-11-24T08:07:32.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.433+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa340c7090 con 0x7faa340adf20 2023-11-24T08:07:32.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.434+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa34067450 con 0x7faa340adf20 2023-11-24T08:07:32.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.435+0000 7faa317fa640 1 -- 172.21.15.97:0/2738608794 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa2802f050 con 0x7faa340adf20 2023-11-24T08:07:32.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.436+0000 7faa317fa640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa1806ae40 0x7faa1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.437+0000 7faa317fa640 1 -- 172.21.15.97:0/2738608794 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7faa280ab7a0 con 0x7faa340adf20 2023-11-24T08:07:32.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.437+0000 7faa33fff640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa1806ae40 0x7faa1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.437+0000 7faa33fff640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa1806ae40 0x7faa1806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa20009c60 tx=0x7faa20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.441+0000 7faa317fa640 1 -- 172.21.15.97:0/2738608794 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa280766a0 con 0x7faa340adf20 2023-11-24T08:07:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.630+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa340b1c10 con 0x7faa340adf20 2023-11-24T08:07:32.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.631+0000 7faa317fa640 1 -- 172.21.15.97:0/2738608794 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa28079cc0 con 0x7faa340adf20 2023-11-24T08:07:32.633 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa1806ae40 msgr2=0x7faa1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa1806ae40 0x7faa1806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa20009c60 tx=0x7faa20008040 comp rx=0 tx=0).stop 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa340adf20 msgr2=0x7faa34139020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa340adf20 0x7faa34139020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faa28009870 tx=0x7faa280046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 shutdown_connections 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faa1806ae40 0x7faa1806d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa3415bf10 0x7faa340c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa340cc980 0x7faa3415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 --2- 172.21.15.97:0/2738608794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa340adf20 0x7faa34139020 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 >> 172.21.15.97:0/2738608794 conn(0x7faa3406a7d0 msgr2=0x7faa340cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.633+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 shutdown_connections 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.634+0000 7faa3994e640 1 -- 172.21.15.97:0/2738608794 wait complete. 2023-11-24T08:07:32.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:32.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.862+0000 7f33e60d4640 1 Processor -- start 2023-11-24T08:07:32.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.862+0000 7f33e60d4640 1 -- start start 2023-11-24T08:07:32.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33e60d4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f33e0143ae0 0x7f33e00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33e60d4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e00cf7d0 0x7f33e015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33e60d4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f33e015e1e0 0x7f33e015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33e60d4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00cfc30 con 0x7f33e0143ae0 2023-11-24T08:07:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33e60d4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00b1ee0 con 0x7f33e015e1e0 2023-11-24T08:07:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33e60d4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00b2780 con 0x7f33e00cf7d0 2023-11-24T08:07:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f33e0143ae0 0x7f33e00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f33e0143ae0 0x7f33e00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50932/0 (socket says 172.21.15.97:50932) 2023-11-24T08:07:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 -- 172.21.15.97:0/1117088012 learned_addr learned my addr 172.21.15.97:0/1117088012 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 -- 172.21.15.97:0/1117088012 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e00cf7d0 msgr2=0x7f33e015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 --2- 172.21.15.97:0/1117088012 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e00cf7d0 0x7f33e015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 -- 172.21.15.97:0/1117088012 >> v2:172.21.15.183:3300/0 conn(0x7f33e015e1e0 msgr2=0x7f33e015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33dffff640 1 --2- 172.21.15.97:0/1117088012 >> v2:172.21.15.183:3300/0 conn(0x7f33e015e1e0 0x7f33e015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 --2- 172.21.15.97:0/1117088012 >> v2:172.21.15.183:3300/0 conn(0x7f33e015e1e0 0x7f33e015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.864+0000 7f33df7fe640 1 -- 172.21.15.97:0/1117088012 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e015e990 con 0x7f33e0143ae0 2023-11-24T08:07:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.865+0000 7f33df7fe640 1 --2- 172.21.15.97:0/1117088012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e0143ae0 0x7f33e00cf290 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33e0072160 tx=0x7f33d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0de1f00ca2d56e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.866+0000 7f33deffd640 1 -- 172.21.15.97:0/1117088012 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0031870 con 0x7f33e0143ae0 2023-11-24T08:07:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.866+0000 7f33deffd640 1 -- 172.21.15.97:0/1117088012 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00319d0 con 0x7f33e0143ae0 2023-11-24T08:07:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.866+0000 7f33deffd640 1 -- 172.21.15.97:0/1117088012 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0031d60 con 0x7f33e0143ae0 2023-11-24T08:07:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.866+0000 7f33e60d4640 1 -- 172.21.15.97:0/1117088012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e0143ae0 msgr2=0x7f33e00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.866+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1117088012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e0143ae0 0x7f33e00cf290 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33e0072160 tx=0x7f33d002b910 comp rx=0 tx=0).stop 2023-11-24T08:07:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.867+0000 7f33e60d4640 1 -- 172.21.15.97:0/1117088012 shutdown_connections 2023-11-24T08:07:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.867+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1117088012 >> v2:172.21.15.183:3300/0 conn(0x7f33e015e1e0 0x7f33e015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.867+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1117088012 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e00cf7d0 0x7f33e015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.867+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1117088012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e0143ae0 0x7f33e00cf290 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.867+0000 7f33e60d4640 1 -- 172.21.15.97:0/1117088012 >> 172.21.15.97:0/1117088012 conn(0x7f33e006a800 msgr2=0x7f33e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.867+0000 7f33e60d4640 1 -- 172.21.15.97:0/1117088012 shutdown_connections 2023-11-24T08:07:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.867+0000 7f33e60d4640 1 -- 172.21.15.97:0/1117088012 wait complete. 2023-11-24T08:07:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.868+0000 7f33e60d4640 1 Processor -- start 2023-11-24T08:07:32.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.868+0000 7f33e60d4640 1 -- start start 2023-11-24T08:07:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.869+0000 7f33e60d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e00cf7d0 0x7f33e00af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.869+0000 7f33e60d4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33e0143ae0 0x7f33e01ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.869+0000 7f33e60d4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e015e1e0 0x7f33e00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.869+0000 7f33e60d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00afe80 con 0x7f33e00cf7d0 2023-11-24T08:07:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.869+0000 7f33e60d4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00cc610 con 0x7f33e0143ae0 2023-11-24T08:07:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.869+0000 7f33e60d4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00cd190 con 0x7f33e015e1e0 2023-11-24T08:07:32.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e00cf7d0 0x7f33e00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e00cf7d0 0x7f33e00af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50936/0 (socket says 172.21.15.97:50936) 2023-11-24T08:07:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 -- 172.21.15.97:0/1393705367 learned_addr learned my addr 172.21.15.97:0/1393705367 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33d7fff640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33e0143ae0 0x7f33e01ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33dffff640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e015e1e0 0x7f33e00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 -- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e015e1e0 msgr2=0x7f33e00aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e015e1e0 0x7f33e00aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 -- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33e0143ae0 msgr2=0x7f33e01ee1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33e0143ae0 0x7f33e01ee1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33df7fe640 1 -- 172.21.15.97:0/1393705367 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00094d0 con 0x7f33e00cf7d0 2023-11-24T08:07:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.870+0000 7f33d7fff640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33e0143ae0 0x7f33e01ee1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.871+0000 7f33df7fe640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e00cf7d0 0x7f33e00af940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f33d0000c00 tx=0x7f33d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.871+0000 7f33dcff9640 1 -- 172.21.15.97:0/1393705367 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0031840 con 0x7f33e00cf7d0 2023-11-24T08:07:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.871+0000 7f33dcff9640 1 -- 172.21.15.97:0/1393705367 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00443f0 con 0x7f33e00cf7d0 2023-11-24T08:07:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.871+0000 7f33dcff9640 1 -- 172.21.15.97:0/1393705367 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00447a0 con 0x7f33e00cf7d0 2023-11-24T08:07:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.871+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e00cc860 con 0x7f33e00cf7d0 2023-11-24T08:07:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.871+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e00cce20 con 0x7f33e00cf7d0 2023-11-24T08:07:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.872+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00675d0 con 0x7f33e00cf7d0 2023-11-24T08:07:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.873+0000 7f33dcff9640 1 -- 172.21.15.97:0/1393705367 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33d004d450 con 0x7f33e00cf7d0 2023-11-24T08:07:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.874+0000 7f33dcff9640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f33c006ae40 0x7f33c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.875+0000 7f33dcff9640 1 -- 172.21.15.97:0/1393705367 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f33d002d040 con 0x7f33e00cf7d0 2023-11-24T08:07:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.875+0000 7f33d7fff640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f33c006ae40 0x7f33c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.875+0000 7f33d7fff640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f33c006ae40 0x7f33c006d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006fd0 tx=0x7f33c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:32.879+0000 7f33dcff9640 1 -- 172.21.15.97:0/1393705367 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33d0076e80 con 0x7f33e00cf7d0 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.053+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33e015c950 con 0x7f33e00cf7d0 2023-11-24T08:07:33.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.055+0000 7f33dcff9640 1 -- 172.21.15.97:0/1393705367 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33d0035020 con 0x7f33e00cf7d0 2023-11-24T08:07:33.058 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:33.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f33c006ae40 msgr2=0x7f33c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f33c006ae40 0x7f33c006d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006fd0 tx=0x7f33c8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e00cf7d0 msgr2=0x7f33e00af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e00cf7d0 0x7f33e00af940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f33d0000c00 tx=0x7f33d00046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 shutdown_connections 2023-11-24T08:07:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f33c006ae40 0x7f33c006d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33e015e1e0 0x7f33e00aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33e0143ae0 0x7f33e01ee1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 --2- 172.21.15.97:0/1393705367 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33e00cf7d0 0x7f33e00af940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 >> 172.21.15.97:0/1393705367 conn(0x7f33e006a800 msgr2=0x7f33e015bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 shutdown_connections 2023-11-24T08:07:33.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.057+0000 7f33e60d4640 1 -- 172.21.15.97:0/1393705367 wait complete. 2023-11-24T08:07:33.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:33.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.276+0000 7f5ddc9be640 1 Processor -- start 2023-11-24T08:07:33.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.276+0000 7f5ddc9be640 1 -- start start 2023-11-24T08:07:33.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5ddc9be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5ddc9be640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5dd815f9c0 0x7f5dd80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5ddc9be640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd815c5f0 con 0x7f5dd813df80 2023-11-24T08:07:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5ddc9be640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd806c470 con 0x7f5dd815f9c0 2023-11-24T08:07:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5ddc9be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd806c750 con 0x7f5dd813e360 2023-11-24T08:07:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5dd6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5dd815f9c0 0x7f5dd80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5dcffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5dd6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5dd815f9c0 0x7f5dd80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:38636/0 (socket says 172.21.15.97:38636) 2023-11-24T08:07:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.278+0000 7f5dcffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:57246/0 (socket says 172.21.15.97:57246) 2023-11-24T08:07:33.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.279+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/419866000 learned_addr learned my addr 172.21.15.97:0/419866000 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:33.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.279+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/419866000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 msgr2=0x7f5dd80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:33.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.279+0000 7f5dd6d9d640 1 --2- 172.21.15.97:0/419866000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.279+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/419866000 >> v1:172.21.15.183:6789/0 conn(0x7f5dd813df80 legacy=0x7f5dd815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.279+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/419866000 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd806ca30 con 0x7f5dd815f9c0 2023-11-24T08:07:33.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.280+0000 7f5dd6d9d640 1 --2- 172.21.15.97:0/419866000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80cf7d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009e50 tx=0x7f5dd002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82abc1a5a9bffbeb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.281+0000 7f5dd5d9b640 1 -- 172.21.15.97:0/419866000 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd002cb00 con 0x7f5dd815f9c0 2023-11-24T08:07:33.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.281+0000 7f5dd5d9b640 1 -- 172.21.15.97:0/419866000 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd002cc60 con 0x7f5dd815f9c0 2023-11-24T08:07:33.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.281+0000 7f5dd5d9b640 1 -- 172.21.15.97:0/419866000 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00343f0 con 0x7f5dd815f9c0 2023-11-24T08:07:33.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.281+0000 7f5ddc9be640 1 -- 172.21.15.97:0/419866000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd815f9c0 msgr2=0x7f5dd80cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.281+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/419866000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80cf7d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009e50 tx=0x7f5dd002bf60 comp rx=0 tx=0).stop 2023-11-24T08:07:33.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.282+0000 7f5ddc9be640 1 -- 172.21.15.97:0/419866000 shutdown_connections 2023-11-24T08:07:33.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.282+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/419866000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80cf7d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.282+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/419866000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.282+0000 7f5ddc9be640 1 -- 172.21.15.97:0/419866000 >> 172.21.15.97:0/419866000 conn(0x7f5dd806a800 msgr2=0x7f5dd806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.282+0000 7f5ddc9be640 1 -- 172.21.15.97:0/419866000 shutdown_connections 2023-11-24T08:07:33.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.282+0000 7f5ddc9be640 1 -- 172.21.15.97:0/419866000 wait complete. 2023-11-24T08:07:33.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.284+0000 7f5ddc9be640 1 Processor -- start 2023-11-24T08:07:33.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.284+0000 7f5ddc9be640 1 -- start start 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5ddc9be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd813df80 0x7f5dd813d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5ddc9be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5ddc9be640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5ddc9be640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd81f0f90 con 0x7f5dd815f9c0 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5ddc9be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd81f1270 con 0x7f5dd813df80 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5ddc9be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd81f1550 con 0x7f5dd813e360 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5dd6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50950/0 (socket says 172.21.15.97:50950) 2023-11-24T08:07:33.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.285+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/1353484454 learned_addr learned my addr 172.21.15.97:0/1353484454 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dd659c640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd813df80 0x7f5dd813d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dcffff640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 msgr2=0x7f5dd80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dd6d9d640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd813df80 msgr2=0x7f5dd813d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dd6d9d640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd813df80 0x7f5dd813d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dd6d9d640 1 -- 172.21.15.97:0/1353484454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009b30 con 0x7f5dd815f9c0 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dcffff640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dd6d9d640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80b3230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009e50 tx=0x7f5dd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dceffd640 1 -- 172.21.15.97:0/1353484454 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd003e450 con 0x7f5dd815f9c0 2023-11-24T08:07:33.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dceffd640 1 -- 172.21.15.97:0/1353484454 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd003e5b0 con 0x7f5dd815f9c0 2023-11-24T08:07:33.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5dceffd640 1 -- 172.21.15.97:0/1353484454 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd003e960 con 0x7f5dd815f9c0 2023-11-24T08:07:33.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.286+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd81f1830 con 0x7f5dd815f9c0 2023-11-24T08:07:33.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.287+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd813dc70 con 0x7f5dd815f9c0 2023-11-24T08:07:33.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.288+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd81f1d50 con 0x7f5dd815f9c0 2023-11-24T08:07:33.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.288+0000 7f5dceffd640 1 -- 172.21.15.97:0/1353484454 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5dd003eac0 con 0x7f5dd815f9c0 2023-11-24T08:07:33.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.289+0000 7f5dceffd640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5db806ae40 0x7f5db806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.289+0000 7f5dceffd640 1 -- 172.21.15.97:0/1353484454 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5dd00ac3a0 con 0x7f5dd815f9c0 2023-11-24T08:07:33.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.290+0000 7f5dd659c640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5db806ae40 0x7f5db806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.290+0000 7f5dd659c640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5db806ae40 0x7f5db806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5dd815a980 tx=0x7f5dc8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.294+0000 7f5dceffd640 1 -- 172.21.15.97:0/1353484454 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5dd81f1d50 con 0x7f5dd815f9c0 2023-11-24T08:07:33.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.471+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5dd81f1d50 con 0x7f5dd815f9c0 2023-11-24T08:07:33.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.472+0000 7f5dceffd640 1 -- 172.21.15.97:0/1353484454 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5dd81f1d50 con 0x7f5dd815f9c0 2023-11-24T08:07:33.474 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5db806ae40 msgr2=0x7f5db806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5db806ae40 0x7f5db806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5dd815a980 tx=0x7f5dc8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dd815f9c0 msgr2=0x7f5dd80b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80b3230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009e50 tx=0x7f5dd0004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 shutdown_connections 2023-11-24T08:07:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5db806ae40 0x7f5db806d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dd815f9c0 0x7f5dd80b3230 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dd813e360 0x7f5dd80b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 --2- 172.21.15.97:0/1353484454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dd813df80 0x7f5dd813d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.474+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 >> 172.21.15.97:0/1353484454 conn(0x7f5dd806a800 msgr2=0x7f5dd815cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.475+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 shutdown_connections 2023-11-24T08:07:33.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.475+0000 7f5ddc9be640 1 -- 172.21.15.97:0/1353484454 wait complete. 2023-11-24T08:07:33.494 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:33.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.692+0000 7f8d67dce640 1 Processor -- start 2023-11-24T08:07:33.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.692+0000 7f8d67dce640 1 -- start start 2023-11-24T08:07:33.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.693+0000 7f8d67dce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6013df80 0x7f8d6015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.693+0000 7f8d67dce640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8d6013e360 0x7f8d600cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d67dce640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6006c470 con 0x7f8d6015f9c0 2023-11-24T08:07:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d67dce640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6006c750 con 0x7f8d6013e360 2023-11-24T08:07:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d67dce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6006ca30 con 0x7f8d6013df80 2023-11-24T08:07:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d65369640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8d6013e360 0x7f8d600cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d65369640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8d6013e360 0x7f8d600cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50956/0 (socket says 172.21.15.97:50956) 2023-11-24T08:07:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d65369640 1 -- 172.21.15.97:0/1125384577 learned_addr learned my addr 172.21.15.97:0/1125384577 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:33.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d65369640 1 -- 172.21.15.97:0/1125384577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6013df80 msgr2=0x7f8d6015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:33.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d65369640 1 --2- 172.21.15.97:0/1125384577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6013df80 0x7f8d6015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d65369640 1 -- 172.21.15.97:0/1125384577 >> v1:172.21.15.183:6789/0 conn(0x7f8d6015f9c0 legacy=0x7f8d601408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:33.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.694+0000 7f8d65369640 1 -- 172.21.15.97:0/1125384577 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6006cd10 con 0x7f8d6013e360 2023-11-24T08:07:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.695+0000 7f8d65369640 1 --2- 172.21.15.97:0/1125384577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013e360 0x7f8d600cf290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009870 tx=0x7f8d5002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac224392ca7e3d9a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d64b68640 1 -- 172.21.15.97:0/1125384577 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50031640 con 0x7f8d6013e360 2023-11-24T08:07:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d64b68640 1 -- 172.21.15.97:0/1125384577 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d500317a0 con 0x7f8d6013e360 2023-11-24T08:07:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d64b68640 1 -- 172.21.15.97:0/1125384577 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50031b30 con 0x7f8d6013e360 2023-11-24T08:07:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 -- 172.21.15.97:0/1125384577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013e360 msgr2=0x7f8d600cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 --2- 172.21.15.97:0/1125384577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013e360 0x7f8d600cf290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009870 tx=0x7f8d5002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 -- 172.21.15.97:0/1125384577 shutdown_connections 2023-11-24T08:07:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 --2- 172.21.15.97:0/1125384577 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013e360 0x7f8d600cf290 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 --2- 172.21.15.97:0/1125384577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6013df80 0x7f8d6015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 -- 172.21.15.97:0/1125384577 >> 172.21.15.97:0/1125384577 conn(0x7f8d6006a800 msgr2=0x7f8d6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 -- 172.21.15.97:0/1125384577 shutdown_connections 2023-11-24T08:07:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.696+0000 7f8d67dce640 1 -- 172.21.15.97:0/1125384577 wait complete. 2023-11-24T08:07:33.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.698+0000 7f8d67dce640 1 Processor -- start 2023-11-24T08:07:33.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.698+0000 7f8d67dce640 1 -- start start 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d67dce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013df80 0x7f8d6013d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d67dce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6013e360 0x7f8d60150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d67dce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6015f9c0 0x7f8d6014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d67dce640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6014c5e0 con 0x7f8d6013df80 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d67dce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6013de10 con 0x7f8d6013e360 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d67dce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6014c7f0 con 0x7f8d6015f9c0 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d65b6a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013df80 0x7f8d6013d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d65b6a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013df80 0x7f8d6013d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50970/0 (socket says 172.21.15.97:50970) 2023-11-24T08:07:33.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.699+0000 7f8d65b6a640 1 -- 172.21.15.97:0/2307550632 learned_addr learned my addr 172.21.15.97:0/2307550632 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:33.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65369640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6013e360 0x7f8d60150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65b6a640 1 -- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6015f9c0 msgr2=0x7f8d6014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d6636b640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6015f9c0 0x7f8d6014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65b6a640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6015f9c0 0x7f8d6014ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65b6a640 1 -- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6013e360 msgr2=0x7f8d60150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65b6a640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6013e360 0x7f8d60150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65b6a640 1 -- 172.21.15.97:0/2307550632 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500094d0 con 0x7f8d6013df80 2023-11-24T08:07:33.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65369640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6013e360 0x7f8d60150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:33.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d65b6a640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013df80 0x7f8d6013d8d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b410 tx=0x7f8d5c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d567fc640 1 -- 172.21.15.97:0/2307550632 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c011830 con 0x7f8d6013df80 2023-11-24T08:07:33.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d567fc640 1 -- 172.21.15.97:0/2307550632 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c0119b0 con 0x7f8d6013df80 2023-11-24T08:07:33.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6014cad0 con 0x7f8d6013df80 2023-11-24T08:07:33.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.700+0000 7f8d567fc640 1 -- 172.21.15.97:0/2307550632 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c011d60 con 0x7f8d6013df80 2023-11-24T08:07:33.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.701+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6014d090 con 0x7f8d6013df80 2023-11-24T08:07:33.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.702+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d600675d0 con 0x7f8d6013df80 2023-11-24T08:07:33.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.702+0000 7f8d567fc640 1 -- 172.21.15.97:0/2307550632 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d5c01a400 con 0x7f8d6013df80 2023-11-24T08:07:33.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.703+0000 7f8d567fc640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8d4406ae40 0x7f8d4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.703+0000 7f8d567fc640 1 -- 172.21.15.97:0/2307550632 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8d5c089780 con 0x7f8d6013df80 2023-11-24T08:07:33.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.704+0000 7f8d65369640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8d4406ae40 0x7f8d4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.704+0000 7f8d65369640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8d4406ae40 0x7f8d4406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d50036000 tx=0x7f8d5003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.708+0000 7f8d567fc640 1 -- 172.21.15.97:0/2307550632 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d5c054840 con 0x7f8d6013df80 2023-11-24T08:07:33.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.911+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d6006df00 con 0x7f8d6013df80 2023-11-24T08:07:33.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.912+0000 7f8d567fc640 1 -- 172.21.15.97:0/2307550632 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8d5c015080 con 0x7f8d6013df80 2023-11-24T08:07:33.915 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:33.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.914+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8d4406ae40 msgr2=0x7f8d4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.914+0000 7f8d67dce640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8d4406ae40 0x7f8d4406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d50036000 tx=0x7f8d5003c040 comp rx=0 tx=0).stop 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013df80 msgr2=0x7f8d6013d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013df80 0x7f8d6013d8d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b410 tx=0x7f8d5c00b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 shutdown_connections 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8d4406ae40 0x7f8d4406d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6015f9c0 0x7f8d6014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6013e360 0x7f8d60150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 --2- 172.21.15.97:0/2307550632 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d6013df80 0x7f8d6013d8d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 >> 172.21.15.97:0/2307550632 conn(0x7f8d6006a800 msgr2=0x7f8d6015d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 shutdown_connections 2023-11-24T08:07:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:33.915+0000 7f8d67dce640 1 -- 172.21.15.97:0/2307550632 wait complete. 2023-11-24T08:07:33.936 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:07:33.936 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:33.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:34.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.218+0000 7f992c0ec640 1 Processor -- start 2023-11-24T08:07:34.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.218+0000 7f992c0ec640 1 -- start start 2023-11-24T08:07:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.220+0000 7f992c0ec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99240ad880 0x7f99240717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.220+0000 7f992c0ec640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992415e680 con 0x7f992406bb00 2023-11-24T08:07:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.220+0000 7f992c0ec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9924071cf0 con 0x7f99240ac8d0 2023-11-24T08:07:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.220+0000 7f992c0ec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992415dd50 con 0x7f99240ad880 2023-11-24T08:07:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.220+0000 7f992a689640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f992406bb00 0x7f99240b26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34426/0 (socket says 172.21.15.97:34426) 2023-11-24T08:07:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.220+0000 7f992a689640 1 -- 172.21.15.97:0/610777410 learned_addr learned my addr 172.21.15.97:0/610777410 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:34.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9929e88640 1 --2- 172.21.15.97:0/610777410 >> v2:172.21.15.183:3300/0 conn(0x7f99240ad880 0x7f99240717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590862231 0 0) 0x7f992415e680 con 0x7f992406bb00 2023-11-24T08:07:34.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9910003520 con 0x7f992406bb00 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423956617 0 0) 0x7f9910003520 con 0x7f992406bb00 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 >> v2:172.21.15.183:3300/0 conn(0x7f99240ad880 msgr2=0x7f99240717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 --2- 172.21.15.97:0/610777410 >> v2:172.21.15.183:3300/0 conn(0x7f99240ad880 0x7f99240717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 >> v1:172.21.15.183:6789/0 conn(0x7f99240ac8d0 legacy=0x7f992406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992415e030 con 0x7f992406bb00 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.221+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f991c0019f0 con 0x7f992406bb00 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 >> v1:172.21.15.97:6789/0 conn(0x7f992406bb00 legacy=0x7f99240b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f9928e86640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99100039c0 0x7f9910003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f9928e86640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99100047c0 0x7f9910004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f9928e86640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f991000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992415dd50 con 0x7f9910005180 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991000c060 con 0x7f99100047c0 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991000c220 con 0x7f99100039c0 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f992a689640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f991000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f992a689640 1 -- 172.21.15.97:0/610777410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99100039c0 msgr2=0x7f9910003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f992a689640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99100039c0 0x7f9910003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f992a689640 1 -- 172.21.15.97:0/610777410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99100047c0 msgr2=0x7f9910004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f992a689640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99100047c0 0x7f9910004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.222+0000 7f992a689640 1 -- 172.21.15.97:0/610777410 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910003520 con 0x7f9910005180 2023-11-24T08:07:34.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.223+0000 7f992a689640 1 -- 172.21.15.97:0/610777410 reap_dead start 2023-11-24T08:07:34.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.223+0000 7f992a689640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f991000b980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f991c00a720 tx=0x7f99100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8464d841dffadf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c034630 con 0x7f9910005180 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c02f070 con 0x7f9910005180 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f9928e86640 1 -- 172.21.15.97:0/610777410 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0349f0 con 0x7f9910005180 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f992c0ec640 1 -- 172.21.15.97:0/610777410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 msgr2=0x7f991000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f992c0ec640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f991000b980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f991c00a720 tx=0x7f99100057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f992c0ec640 1 -- 172.21.15.97:0/610777410 shutdown_connections 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f992c0ec640 1 --2- 172.21.15.97:0/610777410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f991000b980 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f992c0ec640 1 -- 172.21.15.97:0/610777410 >> 172.21.15.97:0/610777410 conn(0x7f9924070a80 msgr2=0x7f9924070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.224+0000 7f992c0ec640 1 -- 172.21.15.97:0/610777410 shutdown_connections 2023-11-24T08:07:34.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.225+0000 7f992c0ec640 1 -- 172.21.15.97:0/610777410 wait complete. 2023-11-24T08:07:34.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.226+0000 7f992c0ec640 1 Processor -- start 2023-11-24T08:07:34.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.226+0000 7f992c0ec640 1 -- start start 2023-11-24T08:07:34.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.227+0000 7f992c0ec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f99240cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.227+0000 7f992c0ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99240b2490 0x7f99240cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.227+0000 7f992c0ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99240cd1f0 0x7f9924153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.227+0000 7f992c0ec640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99240cd670 con 0x7f9910005180 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.227+0000 7f992c0ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99240b2910 con 0x7f99240cd1f0 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.227+0000 7f992c0ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99240b2be0 con 0x7f99240b2490 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f99240cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f99240cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50982/0 (socket says 172.21.15.97:50982) 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 -- 172.21.15.97:0/201913721 learned_addr learned my addr 172.21.15.97:0/201913721 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 -- 172.21.15.97:0/201913721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99240b2490 msgr2=0x7f99240cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99240b2490 0x7f99240cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 -- 172.21.15.97:0/201913721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99240cd1f0 msgr2=0x7f9924153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99240cd1f0 0x7f9924153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 -- 172.21.15.97:0/201913721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99240b2ec0 con 0x7f9910005180 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f9929e88640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f99240cc110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f992000e7a0 tx=0x7f992000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.228+0000 7f991a7fc640 1 -- 172.21.15.97:0/201913721 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000eeb0 con 0x7f9910005180 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.229+0000 7f991a7fc640 1 -- 172.21.15.97:0/201913721 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992000c940 con 0x7f9910005180 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.229+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99240b31a0 con 0x7f9910005180 2023-11-24T08:07:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.229+0000 7f991a7fc640 1 -- 172.21.15.97:0/201913721 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000cd10 con 0x7f9910005180 2023-11-24T08:07:34.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.229+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99240b3760 con 0x7f9910005180 2023-11-24T08:07:34.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.230+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99240675d0 con 0x7f9910005180 2023-11-24T08:07:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.231+0000 7f991a7fc640 1 -- 172.21.15.97:0/201913721 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9920013470 con 0x7f9910005180 2023-11-24T08:07:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.231+0000 7f991a7fc640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f990806ae70 0x7f990806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.232+0000 7f991a7fc640 1 -- 172.21.15.97:0/201913721 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9920089740 con 0x7f9910005180 2023-11-24T08:07:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.232+0000 7f9929687640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f990806ae70 0x7f990806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.232+0000 7f9929687640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f990806ae70 0x7f990806d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f992414c020 tx=0x7f99140079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.236+0000 7f991a7fc640 1 -- 172.21.15.97:0/201913721 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9920054760 con 0x7f9910005180 2023-11-24T08:07:34.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.426+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99240b58e0 con 0x7f9910005180 2023-11-24T08:07:34.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.430+0000 7f991a7fc640 1 -- 172.21.15.97:0/201913721 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f9920057d80 con 0x7f9910005180 2023-11-24T08:07:34.433 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:34.433 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:34.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.432+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f990806ae70 msgr2=0x7f990806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.432+0000 7f992c0ec640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f990806ae70 0x7f990806d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f992414c020 tx=0x7f99140079b0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.432+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 msgr2=0x7f99240cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.432+0000 7f992c0ec640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f99240cc110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f992000e7a0 tx=0x7f992000ec60 comp rx=0 tx=0).stop 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 shutdown_connections 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f990806ae70 0x7f990806d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99240cd1f0 0x7f9924153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99240b2490 0x7f99240cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 --2- 172.21.15.97:0/201913721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9910005180 0x7f99240cc110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 >> 172.21.15.97:0/201913721 conn(0x7f9924070a80 msgr2=0x7f9924157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 shutdown_connections 2023-11-24T08:07:34.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.433+0000 7f992c0ec640 1 -- 172.21.15.97:0/201913721 wait complete. 2023-11-24T08:07:34.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:34.453 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:34.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.660+0000 7f3568fff640 1 Processor -- start 2023-11-24T08:07:34.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.660+0000 7f3568fff640 1 -- start start 2023-11-24T08:07:34.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3568fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35640ccb50 0x7f3564070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3568fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356415bf10 0x7f3564143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3568fff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356415f4e0 con 0x7f35640adf20 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3568fff640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356415f970 con 0x7f35640ccb50 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3568fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356415c3c0 con 0x7f356415bf10 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3562ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35640ccb50 0x7f3564070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3562ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35640ccb50 0x7f3564070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50998/0 (socket says 172.21.15.97:50998) 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3562ffd640 1 -- 172.21.15.97:0/869966421 learned_addr learned my addr 172.21.15.97:0/869966421 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3562ffd640 1 -- 172.21.15.97:0/869966421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356415bf10 msgr2=0x7f3564143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.662+0000 7f3563fff640 1 --2- 172.21.15.97:0/869966421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356415bf10 0x7f3564143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.663+0000 7f3562ffd640 1 --2- 172.21.15.97:0/869966421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356415bf10 0x7f3564143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.663+0000 7f3562ffd640 1 -- 172.21.15.97:0/869966421 >> v1:172.21.15.183:6789/0 conn(0x7f35640adf20 legacy=0x7f35640cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.663+0000 7f3562ffd640 1 -- 172.21.15.97:0/869966421 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564071130 con 0x7f35640ccb50 2023-11-24T08:07:34.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.663+0000 7f3563fff640 1 --2- 172.21.15.97:0/869966421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356415bf10 0x7f3564143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.664+0000 7f3562ffd640 1 --2- 172.21.15.97:0/869966421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f3564070a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f355802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172b685668f0c5ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.664+0000 7f35627fc640 1 -- 172.21.15.97:0/869966421 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580317c0 con 0x7f35640ccb50 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.664+0000 7f35627fc640 1 -- 172.21.15.97:0/869966421 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558031920 con 0x7f35640ccb50 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.664+0000 7f35627fc640 1 -- 172.21.15.97:0/869966421 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558031cb0 con 0x7f35640ccb50 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 -- 172.21.15.97:0/869966421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 msgr2=0x7f3564070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 --2- 172.21.15.97:0/869966421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f3564070a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f355802b860 comp rx=0 tx=0).stop 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 -- 172.21.15.97:0/869966421 shutdown_connections 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 --2- 172.21.15.97:0/869966421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356415bf10 0x7f3564143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 --2- 172.21.15.97:0/869966421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f3564070a30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 -- 172.21.15.97:0/869966421 >> 172.21.15.97:0/869966421 conn(0x7f356406a7d0 msgr2=0x7f356406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 -- 172.21.15.97:0/869966421 shutdown_connections 2023-11-24T08:07:34.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.665+0000 7f3568fff640 1 -- 172.21.15.97:0/869966421 wait complete. 2023-11-24T08:07:34.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.667+0000 7f3568fff640 1 Processor -- start 2023-11-24T08:07:34.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.667+0000 7f3568fff640 1 -- start start 2023-11-24T08:07:34.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3568fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35640adf20 0x7f356413e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3568fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f356413b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3568fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f356415bf10 0x7f356413b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3568fff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356415ab40 con 0x7f35640ccb50 2023-11-24T08:07:34.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3568fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356413c950 con 0x7f356415bf10 2023-11-24T08:07:34.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3568fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356413cc30 con 0x7f35640adf20 2023-11-24T08:07:34.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3562ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f356413b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3562ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f356413b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51006/0 (socket says 172.21.15.97:51006) 2023-11-24T08:07:34.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.668+0000 7f3562ffd640 1 -- 172.21.15.97:0/3230857130 learned_addr learned my addr 172.21.15.97:0/3230857130 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:34.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.669+0000 7f3562ffd640 1 -- 172.21.15.97:0/3230857130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35640adf20 msgr2=0x7f356413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.669+0000 7f3562ffd640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35640adf20 0x7f356413e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.669+0000 7f3562ffd640 1 -- 172.21.15.97:0/3230857130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f356415bf10 msgr2=0x7f356413b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.669+0000 7f3562ffd640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f356415bf10 0x7f356413b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.669+0000 7f3562ffd640 1 -- 172.21.15.97:0/3230857130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580094d0 con 0x7f35640ccb50 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.669+0000 7f3562ffd640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f356413b1d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f35580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.669+0000 7f354bfff640 1 -- 172.21.15.97:0/3230857130 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558032920 con 0x7f35640ccb50 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.670+0000 7f354bfff640 1 -- 172.21.15.97:0/3230857130 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558032a80 con 0x7f35640ccb50 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.670+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356413cf10 con 0x7f35640ccb50 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.670+0000 7f354bfff640 1 -- 172.21.15.97:0/3230857130 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558032df0 con 0x7f35640ccb50 2023-11-24T08:07:34.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.670+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356413d4d0 con 0x7f35640ccb50 2023-11-24T08:07:34.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.671+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3564067450 con 0x7f35640ccb50 2023-11-24T08:07:34.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.672+0000 7f354bfff640 1 -- 172.21.15.97:0/3230857130 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f355804e450 con 0x7f35640ccb50 2023-11-24T08:07:34.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.673+0000 7f354bfff640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f355006ae40 0x7f355006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.673+0000 7f354bfff640 1 -- 172.21.15.97:0/3230857130 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f35580abb70 con 0x7f35640ccb50 2023-11-24T08:07:34.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.673+0000 7f35637fe640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f355006ae40 0x7f355006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.674+0000 7f35637fe640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f355006ae40 0x7f355006d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3554003cc0 tx=0x7f35540079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.677+0000 7f354bfff640 1 -- 172.21.15.97:0/3230857130 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3558076c20 con 0x7f35640ccb50 2023-11-24T08:07:34.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.862+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35640ad740 con 0x7f35640ccb50 2023-11-24T08:07:34.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.862+0000 7f354bfff640 1 -- 172.21.15.97:0/3230857130 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f355807a240 con 0x7f35640ccb50 2023-11-24T08:07:34.865 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f355006ae40 msgr2=0x7f355006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f355006ae40 0x7f355006d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3554003cc0 tx=0x7f35540079b0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 msgr2=0x7f356413b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f356413b1d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f35580046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 shutdown_connections 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f355006ae40 0x7f355006d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f356415bf10 0x7f356413b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35640ccb50 0x7f356413b1d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 --2- 172.21.15.97:0/3230857130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35640adf20 0x7f356413e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 >> 172.21.15.97:0/3230857130 conn(0x7f356406a7d0 msgr2=0x7f35640cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 shutdown_connections 2023-11-24T08:07:34.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:34.865+0000 7f3568fff640 1 -- 172.21.15.97:0/3230857130 wait complete. 2023-11-24T08:07:34.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:35.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.090+0000 7f0ac19a9640 1 Processor -- start 2023-11-24T08:07:35.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.090+0000 7f0ac19a9640 1 -- start start 2023-11-24T08:07:35.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.092+0000 7f0ac19a9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0abc157c30 0x7f0abc0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.092+0000 7f0ac19a9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc15deb0 con 0x7f0abc1618f0 2023-11-24T08:07:35.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.092+0000 7f0ac19a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc15e190 con 0x7f0abc071200 2023-11-24T08:07:35.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.092+0000 7f0ac19a9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc15ea30 con 0x7f0abc157c30 2023-11-24T08:07:35.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.092+0000 7f0aba7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0abc1618f0 0x7f0abc070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34436/0 (socket says 172.21.15.97:34436) 2023-11-24T08:07:35.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.092+0000 7f0aba7fc640 1 -- 172.21.15.97:0/4147056653 learned_addr learned my addr 172.21.15.97:0/4147056653 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:35.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.092+0000 7f0abaffd640 1 --2- 172.21.15.97:0/4147056653 >> v2:172.21.15.183:3300/0 conn(0x7f0abc157c30 0x7f0abc0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188800518 0 0) 0x7f0abc15deb0 con 0x7f0abc1618f0 2023-11-24T08:07:35.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa4003520 con 0x7f0abc1618f0 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2312540480 0 0) 0x7f0aa4003520 con 0x7f0abc1618f0 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 >> v2:172.21.15.183:3300/0 conn(0x7f0abc157c30 msgr2=0x7f0abc0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 --2- 172.21.15.97:0/4147056653 >> v2:172.21.15.183:3300/0 conn(0x7f0abc157c30 0x7f0abc0cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 >> v1:172.21.15.183:6789/0 conn(0x7f0abc071200 legacy=0x7f0abc06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc15e470 con 0x7f0abc1618f0 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f0ab0001670 con 0x7f0abc1618f0 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 >> v1:172.21.15.97:6789/0 conn(0x7f0abc1618f0 legacy=0x7f0abc070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0aa4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa40047c0 0x7f0aa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0aa4005180 0x7f0aa400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc15ea30 con 0x7f0aa4003970 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa400c020 con 0x7f0aa40047c0 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa400c1e0 con 0x7f0aa4005180 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.093+0000 7f0abaffd640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0aa4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.094+0000 7f0abaffd640 1 -- 172.21.15.97:0/4147056653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0aa4005180 msgr2=0x7f0aa400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.094+0000 7f0abaffd640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0aa4005180 0x7f0aa400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.094+0000 7f0abaffd640 1 -- 172.21.15.97:0/4147056653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa40047c0 msgr2=0x7f0aa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.094+0000 7f0abaffd640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa40047c0 0x7f0aa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.094+0000 7f0abaffd640 1 -- 172.21.15.97:0/4147056653 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4003520 con 0x7f0aa4003970 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.094+0000 7f0abb7fe640 1 -- 172.21.15.97:0/4147056653 reap_dead start 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0abaffd640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0aa4003d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009ac0 tx=0x7f0aa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa922e381bf3fbb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac02c6b0 con 0x7f0aa4003970 2023-11-24T08:07:35.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac02c810 con 0x7f0aa4003970 2023-11-24T08:07:35.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ab9ffb640 1 -- 172.21.15.97:0/4147056653 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac02cba0 con 0x7f0aa4003970 2023-11-24T08:07:35.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ac19a9640 1 -- 172.21.15.97:0/4147056653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 msgr2=0x7f0aa4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0aa4003d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009ac0 tx=0x7f0aa40057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ac19a9640 1 -- 172.21.15.97:0/4147056653 shutdown_connections 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/4147056653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0aa4003d90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.095+0000 7f0ac19a9640 1 -- 172.21.15.97:0/4147056653 >> 172.21.15.97:0/4147056653 conn(0x7f0abc0cf700 msgr2=0x7f0abc0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.096+0000 7f0ac19a9640 1 -- 172.21.15.97:0/4147056653 shutdown_connections 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.096+0000 7f0ac19a9640 1 -- 172.21.15.97:0/4147056653 wait complete. 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.097+0000 7f0ac19a9640 1 Processor -- start 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.097+0000 7f0ac19a9640 1 -- start start 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.098+0000 7f0ac19a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0abc1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.098+0000 7f0ac19a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0abc0aee30 0x7f0abc14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.098+0000 7f0ac19a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0abc0ad920 0x7f0abc0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.098+0000 7f0ac19a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0ae2f0 con 0x7f0aa4003970 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.098+0000 7f0ac19a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc1e8630 con 0x7f0abc0aee30 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.098+0000 7f0ac19a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc1e8910 con 0x7f0abc0ad920 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0abc1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0abc1570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51032/0 (socket says 172.21.15.97:51032) 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 -- 172.21.15.97:0/3019960164 learned_addr learned my addr 172.21.15.97:0/3019960164 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 -- 172.21.15.97:0/3019960164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0abc0ad920 msgr2=0x7f0abc0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0abc0ad920 0x7f0abc0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 -- 172.21.15.97:0/3019960164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0abc0aee30 msgr2=0x7f0abc14a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0abc0aee30 0x7f0abc14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 -- 172.21.15.97:0/3019960164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc1e8bf0 con 0x7f0aa4003970 2023-11-24T08:07:35.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0abaffd640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0abc1570f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0aac02c250 tx=0x7f0aac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0aa3fff640 1 -- 172.21.15.97:0/3019960164 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac003810 con 0x7f0aa4003970 2023-11-24T08:07:35.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.099+0000 7f0aa3fff640 1 -- 172.21.15.97:0/3019960164 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac003970 con 0x7f0aa4003970 2023-11-24T08:07:35.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.100+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc1e8ed0 con 0x7f0aa4003970 2023-11-24T08:07:35.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.100+0000 7f0aa3fff640 1 -- 172.21.15.97:0/3019960164 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac003d00 con 0x7f0aa4003970 2023-11-24T08:07:35.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.100+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc14a6a0 con 0x7f0aa4003970 2023-11-24T08:07:35.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.101+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc06d3d0 con 0x7f0aa4003970 2023-11-24T08:07:35.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.102+0000 7f0aa3fff640 1 -- 172.21.15.97:0/3019960164 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0aac047450 con 0x7f0aa4003970 2023-11-24T08:07:35.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.102+0000 7f0aa3fff640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0aa806ae40 0x7f0aa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.103+0000 7f0aa3fff640 1 -- 172.21.15.97:0/3019960164 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0aac0ab8e0 con 0x7f0aa4003970 2023-11-24T08:07:35.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.103+0000 7f0aba7fc640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0aa806ae40 0x7f0aa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.103+0000 7f0aba7fc640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0aa806ae40 0x7f0aa806d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00011e0 tx=0x7f0ab0001590 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.107+0000 7f0aa3fff640 1 -- 172.21.15.97:0/3019960164 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0aac0769c0 con 0x7f0aa4003970 2023-11-24T08:07:35.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.283+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0abc0675d0 con 0x7f0aa4003970 2023-11-24T08:07:35.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.283+0000 7f0aa3fff640 1 -- 172.21.15.97:0/3019960164 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0aac003e60 con 0x7f0aa4003970 2023-11-24T08:07:35.286 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:35.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0aa806ae40 msgr2=0x7f0aa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0aa806ae40 0x7f0aa806d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00011e0 tx=0x7f0ab0001590 comp rx=0 tx=0).stop 2023-11-24T08:07:35.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 msgr2=0x7f0abc1570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0abc1570f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0aac02c250 tx=0x7f0aac004730 comp rx=0 tx=0).stop 2023-11-24T08:07:35.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 shutdown_connections 2023-11-24T08:07:35.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0aa806ae40 0x7f0aa806d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0abc0ad920 0x7f0abc0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0abc0aee30 0x7f0abc14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 --2- 172.21.15.97:0/3019960164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003970 0x7f0abc1570f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 >> 172.21.15.97:0/3019960164 conn(0x7f0abc0cf700 msgr2=0x7f0abc0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 shutdown_connections 2023-11-24T08:07:35.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.286+0000 7f0ac19a9640 1 -- 172.21.15.97:0/3019960164 wait complete. 2023-11-24T08:07:35.307 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:35.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.507+0000 7fdf4139e640 1 Processor -- start 2023-11-24T08:07:35.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.507+0000 7fdf4139e640 1 -- start start 2023-11-24T08:07:35.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.509+0000 7fdf4139e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdf3c0cf9a0 0x7fdf3c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.509+0000 7fdf4139e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c071690 con 0x7fdf3c14b2c0 2023-11-24T08:07:35.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.509+0000 7fdf4139e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c071970 con 0x7fdf3c070ea0 2023-11-24T08:07:35.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.509+0000 7fdf4139e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c14b6a0 con 0x7fdf3c0cf9a0 2023-11-24T08:07:35.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.509+0000 7fdf3affd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdf3c14b2c0 0x7fdf3c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34452/0 (socket says 172.21.15.97:34452) 2023-11-24T08:07:35.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.509+0000 7fdf3affd640 1 -- 172.21.15.97:0/2860414460 learned_addr learned my addr 172.21.15.97:0/2860414460 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:35.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.509+0000 7fdf3a7fc640 1 --2- 172.21.15.97:0/2860414460 >> v2:172.21.15.183:3300/0 conn(0x7fdf3c0cf9a0 0x7fdf3c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728746577 0 0) 0x7fdf3c071690 con 0x7fdf3c14b2c0 2023-11-24T08:07:35.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf24003520 con 0x7fdf3c14b2c0 2023-11-24T08:07:35.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2140231511 0 0) 0x7fdf24003520 con 0x7fdf3c14b2c0 2023-11-24T08:07:35.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 >> v2:172.21.15.183:3300/0 conn(0x7fdf3c0cf9a0 msgr2=0x7fdf3c070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 --2- 172.21.15.97:0/2860414460 >> v2:172.21.15.183:3300/0 conn(0x7fdf3c0cf9a0 0x7fdf3c070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 >> v1:172.21.15.183:6789/0 conn(0x7fdf3c070ea0 legacy=0x7fdf3c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c071c50 con 0x7fdf3c14b2c0 2023-11-24T08:07:35.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fdf2c001670 con 0x7fdf3c14b2c0 2023-11-24T08:07:35.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 >> v1:172.21.15.97:6789/0 conn(0x7fdf3c14b2c0 legacy=0x7fdf3c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf240039c0 0x7fdf24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240047c0 0x7fdf24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf24005180 0x7fdf2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c14b6a0 con 0x7fdf240039c0 2023-11-24T08:07:35.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2400c080 con 0x7fdf240047c0 2023-11-24T08:07:35.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2400c240 con 0x7fdf24005180 2023-11-24T08:07:35.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.510+0000 7fdf3affd640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf240039c0 0x7fdf24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.511+0000 7fdf3a7fc640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240047c0 0x7fdf24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.511+0000 7fdf3affd640 1 -- 172.21.15.97:0/2860414460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf24005180 msgr2=0x7fdf2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.511+0000 7fdf3affd640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf24005180 0x7fdf2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.511+0000 7fdf3affd640 1 -- 172.21.15.97:0/2860414460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240047c0 msgr2=0x7fdf24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.511+0000 7fdf3affd640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240047c0 0x7fdf24004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.511+0000 7fdf3affd640 1 -- 172.21.15.97:0/2860414460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24003520 con 0x7fdf240039c0 2023-11-24T08:07:35.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.511+0000 7fdf3b7fe640 1 -- 172.21.15.97:0/2860414460 reap_dead start 2023-11-24T08:07:35.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.512+0000 7fdf3affd640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf240039c0 0x7fdf24003de0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c0e0 tx=0x7fdf240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278130aa873ffc9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.512+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c005ad0 con 0x7fdf240039c0 2023-11-24T08:07:35.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.512+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c005c50 con 0x7fdf240039c0 2023-11-24T08:07:35.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.512+0000 7fdf39ffb640 1 -- 172.21.15.97:0/2860414460 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c02c810 con 0x7fdf240039c0 2023-11-24T08:07:35.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.512+0000 7fdf4139e640 1 -- 172.21.15.97:0/2860414460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf240039c0 msgr2=0x7fdf24003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.512+0000 7fdf4139e640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf240039c0 0x7fdf24003de0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c0e0 tx=0x7fdf240057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.513+0000 7fdf4139e640 1 -- 172.21.15.97:0/2860414460 shutdown_connections 2023-11-24T08:07:35.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.513+0000 7fdf4139e640 1 --2- 172.21.15.97:0/2860414460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf240039c0 0x7fdf24003de0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.513+0000 7fdf4139e640 1 -- 172.21.15.97:0/2860414460 >> 172.21.15.97:0/2860414460 conn(0x7fdf3c06a800 msgr2=0x7fdf3c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.513+0000 7fdf4139e640 1 -- 172.21.15.97:0/2860414460 shutdown_connections 2023-11-24T08:07:35.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.513+0000 7fdf4139e640 1 -- 172.21.15.97:0/2860414460 wait complete. 2023-11-24T08:07:35.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.514+0000 7fdf4139e640 1 Processor -- start 2023-11-24T08:07:35.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.515+0000 7fdf4139e640 1 -- start start 2023-11-24T08:07:35.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.515+0000 7fdf4139e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240039c0 0x7fdf3c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.515+0000 7fdf4139e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c1640a0 0x7fdf3c164500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf4139e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf3c141b00 0x7fdf3c141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf4139e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c1fb570 con 0x7fdf3c1640a0 2023-11-24T08:07:35.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf4139e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c164d40 con 0x7fdf240039c0 2023-11-24T08:07:35.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf4139e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c1fb990 con 0x7fdf3c141b00 2023-11-24T08:07:35.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c1640a0 0x7fdf3c164500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c1640a0 0x7fdf3c164500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51062/0 (socket says 172.21.15.97:51062) 2023-11-24T08:07:35.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 -- 172.21.15.97:0/747267281 learned_addr learned my addr 172.21.15.97:0/747267281 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:35.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3b7fe640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf3c141b00 0x7fdf3c141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3affd640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240039c0 0x7fdf3c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 -- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf3c141b00 msgr2=0x7fdf3c141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf3c141b00 0x7fdf3c141f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 -- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240039c0 msgr2=0x7fdf3c06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240039c0 0x7fdf3c06c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.516+0000 7fdf3a7fc640 1 -- 172.21.15.97:0/747267281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c1fabd0 con 0x7fdf3c1640a0 2023-11-24T08:07:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.517+0000 7fdf3a7fc640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c1640a0 0x7fdf3c164500 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf300108d0 tx=0x7fdf30010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.517+0000 7fdf237fe640 1 -- 172.21.15.97:0/747267281 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000eb60 con 0x7fdf3c1640a0 2023-11-24T08:07:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.517+0000 7fdf237fe640 1 -- 172.21.15.97:0/747267281 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3000ecc0 con 0x7fdf3c1640a0 2023-11-24T08:07:35.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.517+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c1faeb0 con 0x7fdf3c1640a0 2023-11-24T08:07:35.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.517+0000 7fdf237fe640 1 -- 172.21.15.97:0/747267281 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3001c400 con 0x7fdf3c1640a0 2023-11-24T08:07:35.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.517+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c164a40 con 0x7fdf3c1640a0 2023-11-24T08:07:35.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.518+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c072610 con 0x7fdf3c1640a0 2023-11-24T08:07:35.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.519+0000 7fdf237fe640 1 -- 172.21.15.97:0/747267281 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf3001c560 con 0x7fdf3c1640a0 2023-11-24T08:07:35.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.520+0000 7fdf237fe640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdf2806ae40 0x7fdf2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.520+0000 7fdf237fe640 1 -- 172.21.15.97:0/747267281 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdf30089c30 con 0x7fdf3c1640a0 2023-11-24T08:07:35.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.520+0000 7fdf3affd640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdf2806ae40 0x7fdf2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.521+0000 7fdf3affd640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdf2806ae40 0x7fdf2806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c034000 tx=0x7fdf2c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.524+0000 7fdf237fe640 1 -- 172.21.15.97:0/747267281 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf30054c70 con 0x7fdf3c1640a0 2023-11-24T08:07:35.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.714+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf3c1fb6b0 con 0x7fdf3c1640a0 2023-11-24T08:07:35.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.715+0000 7fdf237fe640 1 -- 172.21.15.97:0/747267281 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf3c1fb6b0 con 0x7fdf3c1640a0 2023-11-24T08:07:35.717 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdf2806ae40 msgr2=0x7fdf2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdf2806ae40 0x7fdf2806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c034000 tx=0x7fdf2c009030 comp rx=0 tx=0).stop 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c1640a0 msgr2=0x7fdf3c164500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c1640a0 0x7fdf3c164500 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf300108d0 tx=0x7fdf30010d90 comp rx=0 tx=0).stop 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 shutdown_connections 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdf2806ae40 0x7fdf2806d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf3c141b00 0x7fdf3c141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdf3c1640a0 0x7fdf3c164500 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 --2- 172.21.15.97:0/747267281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf240039c0 0x7fdf3c06c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 >> 172.21.15.97:0/747267281 conn(0x7fdf3c06a800 msgr2=0x7fdf3c0cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.717+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 shutdown_connections 2023-11-24T08:07:35.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.718+0000 7fdf4139e640 1 -- 172.21.15.97:0/747267281 wait complete. 2023-11-24T08:07:35.739 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:35.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.949+0000 7f1dd1555640 1 Processor -- start 2023-11-24T08:07:35.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.950+0000 7f1dd1555640 1 -- start start 2023-11-24T08:07:35.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.951+0000 7f1dd1555640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc15d1c0 0x7f1dcc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.951+0000 7f1dd1555640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1dcc06b3f0 0x7f1dcc06b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.951+0000 7f1dd1555640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc15fc10 con 0x7f1dcc071490 2023-11-24T08:07:35.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.951+0000 7f1dd1555640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc06bdc0 con 0x7f1dcc06b3f0 2023-11-24T08:07:35.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.951+0000 7f1dd1555640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0aeff0 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.951+0000 7f1dcb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1dcc071490 0x7f1dcc0b2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34464/0 (socket says 172.21.15.97:34464) 2023-11-24T08:07:35.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dcb7fe640 1 -- 172.21.15.97:0/140905424 learned_addr learned my addr 172.21.15.97:0/140905424 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:35.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dd0d54640 1 --2- 172.21.15.97:0/140905424 >> v2:172.21.15.97:3300/0 conn(0x7f1dcc06b3f0 0x7f1dcc06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dcbfff640 1 --2- 172.21.15.97:0/140905424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc15d1c0 0x7f1dcc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dcaffd640 1 -- 172.21.15.97:0/140905424 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732129198 0 0) 0x7f1dcc15fc10 con 0x7f1dcc071490 2023-11-24T08:07:35.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dcaffd640 1 -- 172.21.15.97:0/140905424 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db8003520 con 0x7f1dcc071490 2023-11-24T08:07:35.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dd0d54640 1 -- 172.21.15.97:0/140905424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc15d1c0 msgr2=0x7f1dcc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dd0d54640 1 --2- 172.21.15.97:0/140905424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc15d1c0 0x7f1dcc15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dd0d54640 1 -- 172.21.15.97:0/140905424 >> v1:172.21.15.97:6789/0 conn(0x7f1dcc071490 legacy=0x7f1dcc0b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.952+0000 7f1dd0d54640 1 -- 172.21.15.97:0/140905424 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc15f000 con 0x7f1dcc06b3f0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.953+0000 7f1dd0d54640 1 --2- 172.21.15.97:0/140905424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc06b880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40097a0 tx=0x7f1dc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c039df0eade23b5b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dcaffd640 1 -- 172.21.15.97:0/140905424 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4031830 con 0x7f1dcc06b3f0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dcaffd640 1 -- 172.21.15.97:0/140905424 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4031990 con 0x7f1dcc06b3f0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dcaffd640 1 -- 172.21.15.97:0/140905424 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4031d20 con 0x7f1dcc06b3f0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 -- 172.21.15.97:0/140905424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc06b3f0 msgr2=0x7f1dcc06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 --2- 172.21.15.97:0/140905424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc06b880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40097a0 tx=0x7f1dc402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 -- 172.21.15.97:0/140905424 shutdown_connections 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 --2- 172.21.15.97:0/140905424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc06b880 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 --2- 172.21.15.97:0/140905424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc15d1c0 0x7f1dcc15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 -- 172.21.15.97:0/140905424 >> 172.21.15.97:0/140905424 conn(0x7f1dcc070970 msgr2=0x7f1dcc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 -- 172.21.15.97:0/140905424 shutdown_connections 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.954+0000 7f1dd1555640 1 -- 172.21.15.97:0/140905424 wait complete. 2023-11-24T08:07:35.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.956+0000 7f1dd1555640 1 Processor -- start 2023-11-24T08:07:35.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.956+0000 7f1dd1555640 1 -- start start 2023-11-24T08:07:35.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.957+0000 7f1dd1555640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.957+0000 7f1dd1555640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc071490 0x7f1dcc1f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.957+0000 7f1dd1555640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc15d1c0 0x7f1dcc1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.957+0000 7f1dd1555640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc154d20 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.957+0000 7f1dd1555640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1f3c30 con 0x7f1dcc06b3f0 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.957+0000 7f1dd1555640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1f30b0 con 0x7f1dcc071490 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc15d1c0 0x7f1dcc1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc15d1c0 0x7f1dcc1f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51088/0 (socket says 172.21.15.97:51088) 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 -- 172.21.15.97:0/1122105641 learned_addr learned my addr 172.21.15.97:0/1122105641 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dcbfff640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dcb7fe640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc071490 0x7f1dcc1f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 -- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc071490 msgr2=0x7f1dcc1f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc071490 0x7f1dcc1f24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 -- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dcc06b3f0 msgr2=0x7f1dcc1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 -- 172.21.15.97:0/1122105641 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4009400 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dcbfff640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.958+0000 7f1dd0d54640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc15d1c0 0x7f1dcc1f29f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40097a0 tx=0x7f1dc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.959+0000 7f1dc8ff9640 1 -- 172.21.15.97:0/1122105641 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc403a630 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.959+0000 7f1dc8ff9640 1 -- 172.21.15.97:0/1122105641 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc403a790 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.959+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc1f3390 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.959+0000 7f1dc8ff9640 1 -- 172.21.15.97:0/1122105641 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc403ab00 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.959+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc1f3950 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.960+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc0cd410 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.961+0000 7f1dc8ff9640 1 -- 172.21.15.97:0/1122105641 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dc403ac60 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.962+0000 7f1dc8ff9640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1dac06ae40 0x7f1dac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.962+0000 7f1dc8ff9640 1 -- 172.21.15.97:0/1122105641 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1dc40ab230 con 0x7f1dcc15d1c0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.962+0000 7f1dcbfff640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1dac06ae40 0x7f1dac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.963+0000 7f1dcbfff640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1dac06ae40 0x7f1dac06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc1f7310 tx=0x7f1dbc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:35.966+0000 7f1dc8ff9640 1 -- 172.21.15.97:0/1122105641 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dc4076300 con 0x7f1dcc15d1c0 2023-11-24T08:07:36.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.171+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1dcc067b60 con 0x7f1dcc15d1c0 2023-11-24T08:07:36.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.172+0000 7f1dc8ff9640 1 -- 172.21.15.97:0/1122105641 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1dc4079920 con 0x7f1dcc15d1c0 2023-11-24T08:07:36.175 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:36.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1dac06ae40 msgr2=0x7f1dac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1dac06ae40 0x7f1dac06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc1f7310 tx=0x7f1dbc00b040 comp rx=0 tx=0).stop 2023-11-24T08:07:36.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc15d1c0 msgr2=0x7f1dcc1f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc15d1c0 0x7f1dcc1f29f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40097a0 tx=0x7f1dc40046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 shutdown_connections 2023-11-24T08:07:36.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1dac06ae40 0x7f1dac06d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc15d1c0 0x7f1dcc1f29f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dcc071490 0x7f1dcc1f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 --2- 172.21.15.97:0/1122105641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dcc06b3f0 0x7f1dcc1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 >> 172.21.15.97:0/1122105641 conn(0x7f1dcc070970 msgr2=0x7f1dcc0af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 shutdown_connections 2023-11-24T08:07:36.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.175+0000 7f1dd1555640 1 -- 172.21.15.97:0/1122105641 wait complete. 2023-11-24T08:07:36.195 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2023-11-24T08:07:36.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:36.196 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:36.294 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:36.294 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:07:36.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:36.294 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:07:36.359 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:07:36.359 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:36.419 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:07:36.419 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:36.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:36.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.684+0000 7ff5935b0640 1 Processor -- start 2023-11-24T08:07:36.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.684+0000 7ff5935b0640 1 -- start start 2023-11-24T08:07:36.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.685+0000 7ff5935b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 0x7ff58c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff5935b0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0b1ee0 con 0x7ff58c143ae0 2023-11-24T08:07:36.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff5935b0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0b2780 con 0x7ff58c15e1e0 2023-11-24T08:07:36.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff5935b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c15e990 con 0x7ff58c0cf9a0 2023-11-24T08:07:36.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff59134c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff58c143ae0 0x7ff58c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55360/0 (socket says 172.21.15.97:55360) 2023-11-24T08:07:36.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff59134c640 1 -- 172.21.15.97:0/4282438549 learned_addr learned my addr 172.21.15.97:0/4282438549 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764479080 0 0) 0x7ff58c0b1ee0 con 0x7ff58c143ae0 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff590b4b640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 0x7ff58c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.686+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff578003520 con 0x7ff58c143ae0 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565929897 0 0) 0x7ff578003520 con 0x7ff58c143ae0 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 msgr2=0x7ff58c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 0x7ff58c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 >> v1:172.21.15.183:6789/0 conn(0x7ff58c15e1e0 legacy=0x7ff58c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0b2130 con 0x7ff58c143ae0 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7ff588001670 con 0x7ff58c143ae0 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 >> v1:172.21.15.97:6789/0 conn(0x7ff58c143ae0 legacy=0x7ff58c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 0x7ff5780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff578003fd0 0x7ff5780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578004d00 0x7ff578005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c15e990 con 0x7ff578003fd0 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800dd50 con 0x7ff578004d00 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800df10 con 0x7ff58c0cf9a0 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff590b4b640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff578003fd0 0x7ff5780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.687+0000 7ff59134c640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 0x7ff5780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.688+0000 7ff591b4d640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578004d00 0x7ff578005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.688+0000 7ff590b4b640 1 -- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 msgr2=0x7ff5780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.688+0000 7ff590b4b640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0cf9a0 0x7ff5780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.688+0000 7ff590b4b640 1 -- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578004d00 msgr2=0x7ff578005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.688+0000 7ff590b4b640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578004d00 0x7ff578005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.688+0000 7ff590b4b640 1 -- 172.21.15.97:0/4282438549 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578003520 con 0x7ff578003fd0 2023-11-24T08:07:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.688+0000 7ff591b4d640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578004d00 0x7ff578005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:36.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.689+0000 7ff590b4b640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff578003fd0 0x7ff5780047c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00ba30 tx=0x7ff5780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e931f672f991d794 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.689+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c032640 con 0x7ff578003fd0 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.689+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c0327a0 con 0x7ff578003fd0 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.689+0000 7ff583fff640 1 -- 172.21.15.97:0/4282438549 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c032b30 con 0x7ff578003fd0 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.689+0000 7ff5935b0640 1 -- 172.21.15.97:0/4282438549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff578003fd0 msgr2=0x7ff5780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.689+0000 7ff5935b0640 1 --2- 172.21.15.97:0/4282438549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff578003fd0 0x7ff5780047c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00ba30 tx=0x7ff5780057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.690+0000 7ff591b4d640 1 -- 172.21.15.97:0/4282438549 reap_dead start 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.690+0000 7ff5935b0640 1 -- 172.21.15.97:0/4282438549 shutdown_connections 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.690+0000 7ff5935b0640 1 -- 172.21.15.97:0/4282438549 >> 172.21.15.97:0/4282438549 conn(0x7ff58c06a800 msgr2=0x7ff58c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.690+0000 7ff5935b0640 1 -- 172.21.15.97:0/4282438549 shutdown_connections 2023-11-24T08:07:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.690+0000 7ff5935b0640 1 -- 172.21.15.97:0/4282438549 wait complete. 2023-11-24T08:07:36.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.692+0000 7ff5935b0640 1 Processor -- start 2023-11-24T08:07:36.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.692+0000 7ff5935b0640 1 -- start start 2023-11-24T08:07:36.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.693+0000 7ff5935b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578003fd0 0x7ff58c1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.693+0000 7ff5935b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c159970 0x7ff58c141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.693+0000 7ff5935b0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff58c141840 0x7ff58c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.693+0000 7ff5935b0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c141cc0 con 0x7ff58c141840 2023-11-24T08:07:36.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.693+0000 7ff5935b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c140a00 con 0x7ff578003fd0 2023-11-24T08:07:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.693+0000 7ff5935b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c140030 con 0x7ff58c159970 2023-11-24T08:07:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff58c141840 0x7ff58c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff58c141840 0x7ff58c15c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39888/0 (socket says 172.21.15.97:39888) 2023-11-24T08:07:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 -- 172.21.15.97:0/2857784541 learned_addr learned my addr 172.21.15.97:0/2857784541 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff590b4b640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c159970 0x7ff58c141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff59134c640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578003fd0 0x7ff58c1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 -- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c159970 msgr2=0x7ff58c141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c159970 0x7ff58c141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 -- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578003fd0 msgr2=0x7ff58c1404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578003fd0 0x7ff58c1404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 -- 172.21.15.97:0/2857784541 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c13f420 con 0x7ff58c141840 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.694+0000 7ff591b4d640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff58c141840 0x7ff58c15c680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff578003970 tx=0x7ff58400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.695+0000 7ff581ffb640 1 -- 172.21.15.97:0/2857784541 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584003b70 con 0x7ff58c141840 2023-11-24T08:07:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.695+0000 7ff581ffb640 1 -- 172.21.15.97:0/2857784541 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584003cf0 con 0x7ff58c141840 2023-11-24T08:07:36.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.695+0000 7ff581ffb640 1 -- 172.21.15.97:0/2857784541 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5840052b0 con 0x7ff58c141840 2023-11-24T08:07:36.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.695+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c13f700 con 0x7ff58c141840 2023-11-24T08:07:36.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.695+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c13fcc0 con 0x7ff58c141840 2023-11-24T08:07:36.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.696+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c0675d0 con 0x7ff58c141840 2023-11-24T08:07:36.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.697+0000 7ff581ffb640 1 -- 172.21.15.97:0/2857784541 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff584005410 con 0x7ff58c141840 2023-11-24T08:07:36.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.698+0000 7ff581ffb640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff57006ae40 0x7ff57006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.698+0000 7ff581ffb640 1 -- 172.21.15.97:0/2857784541 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff584089030 con 0x7ff58c141840 2023-11-24T08:07:36.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.698+0000 7ff59134c640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff57006ae40 0x7ff57006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.699+0000 7ff59134c640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff57006ae40 0x7ff57006d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff588001eb0 tx=0x7ff588009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.702+0000 7ff581ffb640 1 -- 172.21.15.97:0/2857784541 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff584053fc0 con 0x7ff58c141840 2023-11-24T08:07:36.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.891+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff58c140170 con 0x7ff58c141840 2023-11-24T08:07:36.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.894+0000 7ff581ffb640 1 -- 172.21.15.97:0/2857784541 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7ff584018020 con 0x7ff58c141840 2023-11-24T08:07:36.897 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:36.897 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:36.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.896+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff57006ae40 msgr2=0x7ff57006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.896+0000 7ff5935b0640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff57006ae40 0x7ff57006d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff588001eb0 tx=0x7ff588009040 comp rx=0 tx=0).stop 2023-11-24T08:07:36.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.896+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff58c141840 msgr2=0x7ff58c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.896+0000 7ff5935b0640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff58c141840 0x7ff58c15c680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff578003970 tx=0x7ff58400dc00 comp rx=0 tx=0).stop 2023-11-24T08:07:36.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 shutdown_connections 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff57006ae40 0x7ff57006d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff58c141840 0x7ff58c15c680 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c159970 0x7ff58c141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 --2- 172.21.15.97:0/2857784541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff578003fd0 0x7ff58c1404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 >> 172.21.15.97:0/2857784541 conn(0x7ff58c06a800 msgr2=0x7ff58c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 shutdown_connections 2023-11-24T08:07:36.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:36.897+0000 7ff5935b0640 1 -- 172.21.15.97:0/2857784541 wait complete. 2023-11-24T08:07:36.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:36.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:37.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.134+0000 7f15e389b640 1 Processor -- start 2023-11-24T08:07:37.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.135+0000 7f15e389b640 1 -- start start 2023-11-24T08:07:37.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.136+0000 7f15e389b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15dc159040 0x7f15dc0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.136+0000 7f15e389b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc0b34e0 0x7f15dc0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.136+0000 7f15e389b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15dc0c6060 con 0x7f15dc15c300 2023-11-24T08:07:37.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.136+0000 7f15e389b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15dc0c62d0 con 0x7f15dc159040 2023-11-24T08:07:37.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.136+0000 7f15e389b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0c65b0 con 0x7f15dc0b34e0 2023-11-24T08:07:37.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.137+0000 7f15e1637640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15dc159040 0x7f15dc0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.137+0000 7f15e1e38640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc0b34e0 0x7f15dc0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.137+0000 7f15e1e38640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc0b34e0 0x7f15dc0d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:40760/0 (socket says 172.21.15.97:40760) 2023-11-24T08:07:37.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.137+0000 7f15e1e38640 1 -- 172.21.15.97:0/1350190219 learned_addr learned my addr 172.21.15.97:0/1350190219 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:37.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.137+0000 7f15e1637640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f15dc159040 0x7f15dc0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:37934/0 (socket says 172.21.15.97:37934) 2023-11-24T08:07:37.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.138+0000 7f15e1e38640 1 -- 172.21.15.97:0/1350190219 >> v2:172.21.15.183:3300/0 conn(0x7f15dc159040 msgr2=0x7f15dc0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.138+0000 7f15e1e38640 1 --2- 172.21.15.97:0/1350190219 >> v2:172.21.15.183:3300/0 conn(0x7f15dc159040 0x7f15dc0cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.138+0000 7f15e1e38640 1 -- 172.21.15.97:0/1350190219 >> v1:172.21.15.183:6789/0 conn(0x7f15dc15c300 legacy=0x7f15dc15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.138+0000 7f15e1e38640 1 -- 172.21.15.97:0/1350190219 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc15eec0 con 0x7f15dc0b34e0 2023-11-24T08:07:37.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.139+0000 7f15e1e38640 1 --2- 172.21.15.97:0/1350190219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc0b34e0 0x7f15dc0d0b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009e50 tx=0x7f15d402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f0ee16c17b0038 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15d3fff640 1 -- 172.21.15.97:0/1350190219 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d402cb00 con 0x7f15dc0b34e0 2023-11-24T08:07:37.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15d3fff640 1 -- 172.21.15.97:0/1350190219 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d402cc60 con 0x7f15dc0b34e0 2023-11-24T08:07:37.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15d3fff640 1 -- 172.21.15.97:0/1350190219 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40343f0 con 0x7f15dc0b34e0 2023-11-24T08:07:37.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15e389b640 1 -- 172.21.15.97:0/1350190219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc0b34e0 msgr2=0x7f15dc0d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15e389b640 1 --2- 172.21.15.97:0/1350190219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc0b34e0 0x7f15dc0d0b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009e50 tx=0x7f15d402bf60 comp rx=0 tx=0).stop 2023-11-24T08:07:37.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15e389b640 1 -- 172.21.15.97:0/1350190219 shutdown_connections 2023-11-24T08:07:37.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15e389b640 1 --2- 172.21.15.97:0/1350190219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc0b34e0 0x7f15dc0d0b40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15e389b640 1 --2- 172.21.15.97:0/1350190219 >> v2:172.21.15.183:3300/0 conn(0x7f15dc159040 0x7f15dc0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.140+0000 7f15e389b640 1 -- 172.21.15.97:0/1350190219 >> 172.21.15.97:0/1350190219 conn(0x7f15dc066690 msgr2=0x7f15dc06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.141+0000 7f15e389b640 1 -- 172.21.15.97:0/1350190219 shutdown_connections 2023-11-24T08:07:37.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.141+0000 7f15e389b640 1 -- 172.21.15.97:0/1350190219 wait complete. 2023-11-24T08:07:37.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.142+0000 7f15e389b640 1 Processor -- start 2023-11-24T08:07:37.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.142+0000 7f15e389b640 1 -- start start 2023-11-24T08:07:37.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.143+0000 7f15e389b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15dc0b34e0 0x7f15dc153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.143+0000 7f15e389b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15dc159040 0x7f15dc0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.143+0000 7f15e389b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc15c300 0x7f15dc0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.143+0000 7f15e389b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0c8ab0 con 0x7f15dc159040 2023-11-24T08:07:37.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.143+0000 7f15e389b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0c8d90 con 0x7f15dc0b34e0 2023-11-24T08:07:37.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.143+0000 7f15e389b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc1594c0 con 0x7f15dc15c300 2023-11-24T08:07:37.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15dc159040 0x7f15dc0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15dc159040 0x7f15dc0c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39900/0 (socket says 172.21.15.97:39900) 2023-11-24T08:07:37.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 -- 172.21.15.97:0/3498698166 learned_addr learned my addr 172.21.15.97:0/3498698166 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:37.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e1637640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15dc0b34e0 0x7f15dc153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e1e38640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc15c300 0x7f15dc0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 -- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc15c300 msgr2=0x7f15dc0c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc15c300 0x7f15dc0c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 -- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15dc0b34e0 msgr2=0x7f15dc153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15dc0b34e0 0x7f15dc153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e0e36640 1 -- 172.21.15.97:0/3498698166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4009b30 con 0x7f15dc159040 2023-11-24T08:07:37.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e1e38640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc15c300 0x7f15dc0c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:37.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.144+0000 7f15e1637640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15dc0b34e0 0x7f15dc153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:37.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.145+0000 7f15e0e36640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15dc159040 0x7f15dc0c8140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c400 tx=0x7f15cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.145+0000 7f15d1ffb640 1 -- 172.21.15.97:0/3498698166 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0052d0 con 0x7f15dc159040 2023-11-24T08:07:37.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.145+0000 7f15d1ffb640 1 -- 172.21.15.97:0/3498698166 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc005430 con 0x7f15dc159040 2023-11-24T08:07:37.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.145+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc1597a0 con 0x7f15dc159040 2023-11-24T08:07:37.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.145+0000 7f15d1ffb640 1 -- 172.21.15.97:0/3498698166 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc003830 con 0x7f15dc159040 2023-11-24T08:07:37.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.145+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc0c8680 con 0x7f15dc159040 2023-11-24T08:07:37.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.146+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15dc074a50 con 0x7f15dc159040 2023-11-24T08:07:37.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.147+0000 7f15d1ffb640 1 -- 172.21.15.97:0/3498698166 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15cc003990 con 0x7f15dc159040 2023-11-24T08:07:37.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.148+0000 7f15d1ffb640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15c006ae40 0x7f15c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.148+0000 7f15d1ffb640 1 -- 172.21.15.97:0/3498698166 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f15cc088cb0 con 0x7f15dc159040 2023-11-24T08:07:37.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.148+0000 7f15e1637640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15c006ae40 0x7f15c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.149+0000 7f15e1637640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15c006ae40 0x7f15c006d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009ac0 tx=0x7f15d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.152+0000 7f15d1ffb640 1 -- 172.21.15.97:0/3498698166 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15cc053c40 con 0x7f15dc159040 2023-11-24T08:07:37.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.343+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15dc0c8840 con 0x7f15dc159040 2023-11-24T08:07:37.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.344+0000 7f15d1ffb640 1 -- 172.21.15.97:0/3498698166 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15cc0170a0 con 0x7f15dc159040 2023-11-24T08:07:37.347 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15c006ae40 msgr2=0x7f15c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15c006ae40 0x7f15c006d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009ac0 tx=0x7f15d8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15dc159040 msgr2=0x7f15dc0c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15dc159040 0x7f15dc0c8140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c400 tx=0x7f15cc00c8c0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 shutdown_connections 2023-11-24T08:07:37.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f15c006ae40 0x7f15c006d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15dc15c300 0x7f15dc0c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15dc159040 0x7f15dc0c8140 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 --2- 172.21.15.97:0/3498698166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15dc0b34e0 0x7f15dc153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 >> 172.21.15.97:0/3498698166 conn(0x7f15dc066690 msgr2=0x7f15dc156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 shutdown_connections 2023-11-24T08:07:37.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.347+0000 7f15e389b640 1 -- 172.21.15.97:0/3498698166 wait complete. 2023-11-24T08:07:37.370 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:37.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.574+0000 7f225e02d640 1 Processor -- start 2023-11-24T08:07:37.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.575+0000 7f225e02d640 1 -- start start 2023-11-24T08:07:37.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.576+0000 7f225e02d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f22580ae5a0 0x7f225815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.576+0000 7f225e02d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2258070c40 con 0x7f22580cf290 2023-11-24T08:07:37.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.576+0000 7f225e02d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225806c470 con 0x7f22580b3ae0 2023-11-24T08:07:37.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.576+0000 7f225e02d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2258071450 con 0x7f22580ae5a0 2023-11-24T08:07:37.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f22577fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f22580ae5a0 0x7f225815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f22577fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f22580ae5a0 0x7f225815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39912/0 (socket says 172.21.15.97:39912) 2023-11-24T08:07:37.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f22577fe640 1 -- 172.21.15.97:0/76324485 learned_addr learned my addr 172.21.15.97:0/76324485 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:37.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f2257fff640 1 --1- 172.21.15.97:0/76324485 >> v1:172.21.15.97:6789/0 conn(0x7f22580cf290 0x7f22580b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55366/0 (socket says 172.21.15.97:55366) 2023-11-24T08:07:37.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f22577fe640 1 -- 172.21.15.97:0/76324485 >> v1:172.21.15.183:6789/0 conn(0x7f22580b3ae0 legacy=0x7f225806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f22577fe640 1 -- 172.21.15.97:0/76324485 >> v1:172.21.15.97:6789/0 conn(0x7f22580cf290 legacy=0x7f22580b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f22577fe640 1 -- 172.21.15.97:0/76324485 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225806c750 con 0x7f22580ae5a0 2023-11-24T08:07:37.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.577+0000 7f2256ffd640 1 -- 172.21.15.97:0/76324485 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246846176 0 0) 0x7f2258070c40 con 0x7f22580cf290 2023-11-24T08:07:37.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.578+0000 7f22577fe640 1 --2- 172.21.15.97:0/76324485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580ae5a0 0x7f225815e430 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2248009870 tx=0x7f224802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6825f7d58bb230 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f2256ffd640 1 -- 172.21.15.97:0/76324485 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224802f850 con 0x7f22580ae5a0 2023-11-24T08:07:37.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f2256ffd640 1 -- 172.21.15.97:0/76324485 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224802f9b0 con 0x7f22580ae5a0 2023-11-24T08:07:37.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f2256ffd640 1 -- 172.21.15.97:0/76324485 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224802fd40 con 0x7f22580ae5a0 2023-11-24T08:07:37.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f225e02d640 1 -- 172.21.15.97:0/76324485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580ae5a0 msgr2=0x7f225815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f225e02d640 1 --2- 172.21.15.97:0/76324485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580ae5a0 0x7f225815e430 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2248009870 tx=0x7f224802ba30 comp rx=0 tx=0).stop 2023-11-24T08:07:37.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f225e02d640 1 -- 172.21.15.97:0/76324485 shutdown_connections 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f225e02d640 1 --2- 172.21.15.97:0/76324485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580ae5a0 0x7f225815e430 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f225e02d640 1 -- 172.21.15.97:0/76324485 >> 172.21.15.97:0/76324485 conn(0x7f225806a800 msgr2=0x7f225806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f225e02d640 1 -- 172.21.15.97:0/76324485 shutdown_connections 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.579+0000 7f225e02d640 1 -- 172.21.15.97:0/76324485 wait complete. 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.581+0000 7f225e02d640 1 Processor -- start 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.581+0000 7f225e02d640 1 -- start start 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.582+0000 7f225e02d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22580ae5a0 0x7f22580cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.582+0000 7f225e02d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22580b3ae0 0x7f2258155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.582+0000 7f225e02d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580cf290 0x7f22580cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.582+0000 7f225e02d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2258155d60 con 0x7f22580cf290 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.582+0000 7f225e02d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580ce150 con 0x7f22580ae5a0 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.582+0000 7f225e02d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22580cc770 con 0x7f22580b3ae0 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580cf290 0x7f22580cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580cf290 0x7f22580cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39928/0 (socket says 172.21.15.97:39928) 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 -- 172.21.15.97:0/551743946 learned_addr learned my addr 172.21.15.97:0/551743946 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f22577fe640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22580ae5a0 0x7f22580cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f224ffff640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22580b3ae0 0x7f2258155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 -- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22580b3ae0 msgr2=0x7f2258155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22580b3ae0 0x7f2258155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 -- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22580ae5a0 msgr2=0x7f22580cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22580ae5a0 0x7f22580cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.583+0000 7f2257fff640 1 -- 172.21.15.97:0/551743946 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480094d0 con 0x7f22580cf290 2023-11-24T08:07:37.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.584+0000 7f2257fff640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580cf290 0x7f22580cc230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f225000c780 tx=0x7f225000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.584+0000 7f2254ff9640 1 -- 172.21.15.97:0/551743946 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000ce90 con 0x7f22580cf290 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.584+0000 7f2254ff9640 1 -- 172.21.15.97:0/551743946 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225000a640 con 0x7f22580cf290 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.584+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22580cca10 con 0x7f22580cf290 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.584+0000 7f2254ff9640 1 -- 172.21.15.97:0/551743946 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000a9d0 con 0x7f22580cf290 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.584+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22580ce6d0 con 0x7f22580cf290 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.585+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22580675d0 con 0x7f22580cf290 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.587+0000 7f2254ff9640 1 -- 172.21.15.97:0/551743946 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f225000ab30 con 0x7f22580cf290 2023-11-24T08:07:37.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.588+0000 7f2254ff9640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f223806ae70 0x7f223806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.588+0000 7f2254ff9640 1 -- 172.21.15.97:0/551743946 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2250088aa0 con 0x7f22580cf290 2023-11-24T08:07:37.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.588+0000 7f22577fe640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f223806ae70 0x7f223806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.589+0000 7f22577fe640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f223806ae70 0x7f223806d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2248036000 tx=0x7f2248008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.593+0000 7f2254ff9640 1 -- 172.21.15.97:0/551743946 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2250053ac0 con 0x7f22580cf290 2023-11-24T08:07:37.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.787+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22580ad9f0 con 0x7f22580cf290 2023-11-24T08:07:37.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.788+0000 7f2254ff9640 1 -- 172.21.15.97:0/551743946 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22500180a0 con 0x7f22580cf290 2023-11-24T08:07:37.790 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f223806ae70 msgr2=0x7f223806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f223806ae70 0x7f223806d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2248036000 tx=0x7f2248008030 comp rx=0 tx=0).stop 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580cf290 msgr2=0x7f22580cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580cf290 0x7f22580cc230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f225000c780 tx=0x7f225000cc40 comp rx=0 tx=0).stop 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 shutdown_connections 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f223806ae70 0x7f223806d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22580cf290 0x7f22580cc230 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22580b3ae0 0x7f2258155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 --2- 172.21.15.97:0/551743946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22580ae5a0 0x7f22580cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 >> 172.21.15.97:0/551743946 conn(0x7f225806a800 msgr2=0x7f225815aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 shutdown_connections 2023-11-24T08:07:37.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:37.791+0000 7f225e02d640 1 -- 172.21.15.97:0/551743946 wait complete. 2023-11-24T08:07:37.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:38.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.007+0000 7fcd81143640 1 Processor -- start 2023-11-24T08:07:38.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.007+0000 7fcd81143640 1 -- start start 2023-11-24T08:07:38.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.009+0000 7fcd81143640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c150760 0x7fcd7c072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.009+0000 7fcd81143640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd7c0b32e0 0x7fcd7c15d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.009+0000 7fcd81143640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c15dc80 con 0x7fcd7c15d300 2023-11-24T08:07:38.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.009+0000 7fcd81143640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0b3770 con 0x7fcd7c0b32e0 2023-11-24T08:07:38.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.009+0000 7fcd81143640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c071190 con 0x7fcd7c150760 2023-11-24T08:07:38.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.010+0000 7fcd7ad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c150760 0x7fcd7c072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.010+0000 7fcd7b59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd7c0b32e0 0x7fcd7c15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.010+0000 7fcd7b59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd7c0b32e0 0x7fcd7c15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:37962/0 (socket says 172.21.15.97:37962) 2023-11-24T08:07:38.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.010+0000 7fcd7b59e640 1 -- 172.21.15.97:0/3161925452 learned_addr learned my addr 172.21.15.97:0/3161925452 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.011+0000 7fcd7b59e640 1 -- 172.21.15.97:0/3161925452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c150760 msgr2=0x7fcd7c072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.011+0000 7fcd7b59e640 1 --2- 172.21.15.97:0/3161925452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c150760 0x7fcd7c072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.011+0000 7fcd7b59e640 1 -- 172.21.15.97:0/3161925452 >> v1:172.21.15.183:6789/0 conn(0x7fcd7c15d300 legacy=0x7fcd7c0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.011+0000 7fcd7b59e640 1 -- 172.21.15.97:0/3161925452 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c071470 con 0x7fcd7c0b32e0 2023-11-24T08:07:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.012+0000 7fcd7b59e640 1 --2- 172.21.15.97:0/3161925452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c0b32e0 0x7fcd7c15d740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009e50 tx=0x7fcd7402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3c2beec9e50bd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.013+0000 7fcd79d9b640 1 -- 172.21.15.97:0/3161925452 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7402cb00 con 0x7fcd7c0b32e0 2023-11-24T08:07:38.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.013+0000 7fcd79d9b640 1 -- 172.21.15.97:0/3161925452 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7402cc60 con 0x7fcd7c0b32e0 2023-11-24T08:07:38.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.013+0000 7fcd79d9b640 1 -- 172.21.15.97:0/3161925452 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740343f0 con 0x7fcd7c0b32e0 2023-11-24T08:07:38.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 -- 172.21.15.97:0/3161925452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c0b32e0 msgr2=0x7fcd7c15d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 --2- 172.21.15.97:0/3161925452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c0b32e0 0x7fcd7c15d740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009e50 tx=0x7fcd7402bf60 comp rx=0 tx=0).stop 2023-11-24T08:07:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 -- 172.21.15.97:0/3161925452 shutdown_connections 2023-11-24T08:07:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 --2- 172.21.15.97:0/3161925452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c0b32e0 0x7fcd7c15d740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 --2- 172.21.15.97:0/3161925452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c150760 0x7fcd7c072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 -- 172.21.15.97:0/3161925452 >> 172.21.15.97:0/3161925452 conn(0x7fcd7c06a800 msgr2=0x7fcd7c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 -- 172.21.15.97:0/3161925452 shutdown_connections 2023-11-24T08:07:38.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.014+0000 7fcd81143640 1 -- 172.21.15.97:0/3161925452 wait complete. 2023-11-24T08:07:38.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.015+0000 7fcd81143640 1 Processor -- start 2023-11-24T08:07:38.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.016+0000 7fcd81143640 1 -- start start 2023-11-24T08:07:38.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.016+0000 7fcd81143640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0b32e0 0x7fcd7c1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.016+0000 7fcd81143640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c150760 0x7fcd7c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.016+0000 7fcd81143640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd7c15d300 0x7fcd7c137300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.016+0000 7fcd81143640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c13de80 con 0x7fcd7c15d300 2023-11-24T08:07:38.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.016+0000 7fcd81143640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1596e0 con 0x7fcd7c150760 2023-11-24T08:07:38.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.016+0000 7fcd81143640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c13d7c0 con 0x7fcd7c0b32e0 2023-11-24T08:07:38.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd7c15d300 0x7fcd7c137300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd7c15d300 0x7fcd7c137300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39932/0 (socket says 172.21.15.97:39932) 2023-11-24T08:07:38.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 -- 172.21.15.97:0/1650687046 learned_addr learned my addr 172.21.15.97:0/1650687046 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7ad9d640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0b32e0 0x7fcd7c1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7a59c640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c150760 0x7fcd7c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 -- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0b32e0 msgr2=0x7fcd7c1578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0b32e0 0x7fcd7c1578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 -- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c150760 msgr2=0x7fcd7c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c150760 0x7fcd7c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7b59e640 1 -- 172.21.15.97:0/1650687046 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74009b30 con 0x7fcd7c15d300 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.017+0000 7fcd7a59c640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c150760 0x7fcd7c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:38.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.018+0000 7fcd7b59e640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd7c15d300 0x7fcd7c137300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcd74036040 tx=0x7fcd74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.018+0000 7fcd637fe640 1 -- 172.21.15.97:0/1650687046 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7403e450 con 0x7fcd7c15d300 2023-11-24T08:07:38.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.018+0000 7fcd637fe640 1 -- 172.21.15.97:0/1650687046 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7403e5d0 con 0x7fcd7c15d300 2023-11-24T08:07:38.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.018+0000 7fcd637fe640 1 -- 172.21.15.97:0/1650687046 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7403e980 con 0x7fcd7c15d300 2023-11-24T08:07:38.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.018+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c13daa0 con 0x7fcd7c15d300 2023-11-24T08:07:38.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.018+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c137840 con 0x7fcd7c15d300 2023-11-24T08:07:38.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.019+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c13dfc0 con 0x7fcd7c15d300 2023-11-24T08:07:38.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.020+0000 7fcd637fe640 1 -- 172.21.15.97:0/1650687046 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd7403eae0 con 0x7fcd7c15d300 2023-11-24T08:07:38.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.021+0000 7fcd637fe640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcd6806ae40 0x7fcd6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.021+0000 7fcd637fe640 1 -- 172.21.15.97:0/1650687046 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcd740ac470 con 0x7fcd7c15d300 2023-11-24T08:07:38.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.021+0000 7fcd7ad9d640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcd6806ae40 0x7fcd6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.022+0000 7fcd7ad9d640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcd6806ae40 0x7fcd6806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009a10 tx=0x7fcd6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.026+0000 7fcd637fe640 1 -- 172.21.15.97:0/1650687046 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd7c13dfc0 con 0x7fcd7c15d300 2023-11-24T08:07:38.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.222+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd7c13dfc0 con 0x7fcd7c15d300 2023-11-24T08:07:38.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.223+0000 7fcd637fe640 1 -- 172.21.15.97:0/1650687046 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd7c13dfc0 con 0x7fcd7c15d300 2023-11-24T08:07:38.226 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.225+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcd6806ae40 msgr2=0x7fcd6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.225+0000 7fcd81143640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcd6806ae40 0x7fcd6806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009a10 tx=0x7fcd6c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd7c15d300 msgr2=0x7fcd7c137300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd7c15d300 0x7fcd7c137300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcd74036040 tx=0x7fcd74004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 shutdown_connections 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcd6806ae40 0x7fcd6806d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd7c15d300 0x7fcd7c137300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c150760 0x7fcd7c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 --2- 172.21.15.97:0/1650687046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0b32e0 0x7fcd7c1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 >> 172.21.15.97:0/1650687046 conn(0x7fcd7c06a800 msgr2=0x7fcd7c0b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 shutdown_connections 2023-11-24T08:07:38.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.226+0000 7fcd81143640 1 -- 172.21.15.97:0/1650687046 wait complete. 2023-11-24T08:07:38.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.439+0000 7f6735f41640 1 Processor -- start 2023-11-24T08:07:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.439+0000 7f6735f41640 1 -- start start 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f6735f41640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f673006bb00 0x7f673015b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f6735f41640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6730071d40 con 0x7f67301547a0 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f6735f41640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6730154b80 con 0x7f67300715a0 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f6735f41640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673015e7b0 con 0x7f673006bb00 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f673006bb00 0x7f673015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672f7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f67301547a0 0x7f673006b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55382/0 (socket says 172.21.15.97:55382) 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672f7fe640 1 -- 172.21.15.97:0/1096347768 learned_addr learned my addr 172.21.15.97:0/1096347768 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672effd640 1 --2- 172.21.15.97:0/1096347768 >> v2:172.21.15.97:3300/0 conn(0x7f673006bb00 0x7f673015b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39948/0 (socket says 172.21.15.97:39948) 2023-11-24T08:07:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672effd640 1 -- 172.21.15.97:0/1096347768 >> v1:172.21.15.183:6789/0 conn(0x7f67300715a0 legacy=0x7f67300b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672effd640 1 -- 172.21.15.97:0/1096347768 >> v1:172.21.15.97:6789/0 conn(0x7f67301547a0 legacy=0x7f673006b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672e7fc640 1 -- 172.21.15.97:0/1096347768 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117895238 0 0) 0x7f6730071d40 con 0x7f67301547a0 2023-11-24T08:07:38.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.441+0000 7f672effd640 1 -- 172.21.15.97:0/1096347768 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673015ebd0 con 0x7f673006bb00 2023-11-24T08:07:38.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.443+0000 7f672effd640 1 --2- 172.21.15.97:0/1096347768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673015b290 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f67240097a0 tx=0x7f672402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45350c0e2681f3b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.443+0000 7f672e7fc640 1 -- 172.21.15.97:0/1096347768 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672402e070 con 0x7f673006bb00 2023-11-24T08:07:38.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.443+0000 7f672e7fc640 1 -- 172.21.15.97:0/1096347768 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67240315a0 con 0x7f673006bb00 2023-11-24T08:07:38.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.443+0000 7f672e7fc640 1 -- 172.21.15.97:0/1096347768 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724031930 con 0x7f673006bb00 2023-11-24T08:07:38.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.443+0000 7f6735f41640 1 -- 172.21.15.97:0/1096347768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 msgr2=0x7f673015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.443+0000 7f6735f41640 1 --2- 172.21.15.97:0/1096347768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673015b290 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f67240097a0 tx=0x7f672402b840 comp rx=0 tx=0).stop 2023-11-24T08:07:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.444+0000 7f6735f41640 1 -- 172.21.15.97:0/1096347768 shutdown_connections 2023-11-24T08:07:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.444+0000 7f6735f41640 1 --2- 172.21.15.97:0/1096347768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673015b290 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.444+0000 7f6735f41640 1 -- 172.21.15.97:0/1096347768 >> 172.21.15.97:0/1096347768 conn(0x7f6730070a80 msgr2=0x7f6730070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.444+0000 7f6735f41640 1 -- 172.21.15.97:0/1096347768 shutdown_connections 2023-11-24T08:07:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.444+0000 7f6735f41640 1 -- 172.21.15.97:0/1096347768 wait complete. 2023-11-24T08:07:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.445+0000 7f6735f41640 1 Processor -- start 2023-11-24T08:07:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.445+0000 7f6735f41640 1 -- start start 2023-11-24T08:07:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.446+0000 7f6735f41640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673013d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.446+0000 7f6735f41640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67300715a0 0x7f673013e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.446+0000 7f6735f41640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67301547a0 0x7f67300cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.446+0000 7f6735f41640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67300cdd50 con 0x7f673006bb00 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.446+0000 7f6735f41640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67300cd140 con 0x7f67301547a0 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.446+0000 7f6735f41640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67300cd420 con 0x7f67300715a0 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673013d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673013d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39954/0 (socket says 172.21.15.97:39954) 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 -- 172.21.15.97:0/2026824288 learned_addr learned my addr 172.21.15.97:0/2026824288 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 -- 172.21.15.97:0/2026824288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67300715a0 msgr2=0x7f673013e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67300715a0 0x7f673013e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 -- 172.21.15.97:0/2026824288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67301547a0 msgr2=0x7f67300cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67301547a0 0x7f67300cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 -- 172.21.15.97:0/2026824288 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6724009400 con 0x7f673006bb00 2023-11-24T08:07:38.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.447+0000 7f672f7fe640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673013d890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f672000c430 tx=0x7f672000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.448+0000 7f6717fff640 1 -- 172.21.15.97:0/2026824288 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67200074e0 con 0x7f673006bb00 2023-11-24T08:07:38.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.448+0000 7f6717fff640 1 -- 172.21.15.97:0/2026824288 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720007660 con 0x7f673006bb00 2023-11-24T08:07:38.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.448+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67300cd700 con 0x7f673006bb00 2023-11-24T08:07:38.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.448+0000 7f6717fff640 1 -- 172.21.15.97:0/2026824288 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720004a20 con 0x7f673006bb00 2023-11-24T08:07:38.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.448+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673014b4f0 con 0x7f673006bb00 2023-11-24T08:07:38.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.449+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67300675d0 con 0x7f673006bb00 2023-11-24T08:07:38.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.450+0000 7f6717fff640 1 -- 172.21.15.97:0/2026824288 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6720004b80 con 0x7f673006bb00 2023-11-24T08:07:38.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.451+0000 7f6717fff640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f671c06ae40 0x7f671c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.451+0000 7f6717fff640 1 -- 172.21.15.97:0/2026824288 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6720089590 con 0x7f673006bb00 2023-11-24T08:07:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.451+0000 7f672effd640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f671c06ae40 0x7f671c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.452+0000 7f672effd640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f671c06ae40 0x7f671c06d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6724036000 tx=0x7f6724030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.456+0000 7f6717fff640 1 -- 172.21.15.97:0/2026824288 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67200545b0 con 0x7f673006bb00 2023-11-24T08:07:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.656+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67300665f0 con 0x7f673006bb00 2023-11-24T08:07:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.657+0000 7f6717fff640 1 -- 172.21.15.97:0/2026824288 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6720057bd0 con 0x7f673006bb00 2023-11-24T08:07:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:38.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f671c06ae40 msgr2=0x7f671c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f671c06ae40 0x7f671c06d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6724036000 tx=0x7f6724030000 comp rx=0 tx=0).stop 2023-11-24T08:07:38.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 msgr2=0x7f673013d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673013d890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f672000c430 tx=0x7f672000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 shutdown_connections 2023-11-24T08:07:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f671c06ae40 0x7f671c06d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67301547a0 0x7f67300cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67300715a0 0x7f673013e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 --2- 172.21.15.97:0/2026824288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f673006bb00 0x7f673013d890 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 >> 172.21.15.97:0/2026824288 conn(0x7f6730070a80 msgr2=0x7f673006ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 shutdown_connections 2023-11-24T08:07:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.660+0000 7f6735f41640 1 -- 172.21.15.97:0/2026824288 wait complete. 2023-11-24T08:07:38.681 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:07:38.681 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:38.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:38.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.966+0000 7f8115a51640 1 Processor -- start 2023-11-24T08:07:38.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.966+0000 7f8115a51640 1 -- start start 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f8115a51640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81100cf9a0 0x7f811015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f8115a51640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f811015e1e0 0x7f81100702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f8115a51640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100b1ee0 con 0x7f8110143ae0 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f8115a51640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100b2780 con 0x7f81100cf9a0 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f8115a51640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811015e990 con 0x7f811015e1e0 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f81067fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81100cf9a0 0x7f811015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f81067fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81100cf9a0 0x7f811015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39962/0 (socket says 172.21.15.97:39962) 2023-11-24T08:07:38.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.968+0000 7f81067fc640 1 -- 172.21.15.97:0/3628363154 learned_addr learned my addr 172.21.15.97:0/3628363154 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:38.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.969+0000 7f810f7fe640 1 --2- 172.21.15.97:0/3628363154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f811015e1e0 0x7f81100702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.969+0000 7f81067fc640 1 -- 172.21.15.97:0/3628363154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f811015e1e0 msgr2=0x7f81100702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.969+0000 7f81067fc640 1 --2- 172.21.15.97:0/3628363154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f811015e1e0 0x7f81100702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.969+0000 7f81067fc640 1 -- 172.21.15.97:0/3628363154 >> v1:172.21.15.183:6789/0 conn(0x7f8110143ae0 legacy=0x7f81100cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.969+0000 7f81067fc640 1 -- 172.21.15.97:0/3628363154 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100b2130 con 0x7f81100cf9a0 2023-11-24T08:07:38.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.970+0000 7f81067fc640 1 --2- 172.21.15.97:0/3628363154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81100cf9a0 0x7f811015dca0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c7b24d45f9991c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f810e7fc640 1 -- 172.21.15.97:0/3628363154 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100031640 con 0x7f81100cf9a0 2023-11-24T08:07:38.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f810e7fc640 1 -- 172.21.15.97:0/3628363154 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81000317a0 con 0x7f81100cf9a0 2023-11-24T08:07:38.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f810e7fc640 1 -- 172.21.15.97:0/3628363154 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100031b30 con 0x7f81100cf9a0 2023-11-24T08:07:38.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 -- 172.21.15.97:0/3628363154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81100cf9a0 msgr2=0x7f811015dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 --2- 172.21.15.97:0/3628363154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81100cf9a0 0x7f811015dca0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 -- 172.21.15.97:0/3628363154 shutdown_connections 2023-11-24T08:07:38.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 --2- 172.21.15.97:0/3628363154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f811015e1e0 0x7f81100702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 --2- 172.21.15.97:0/3628363154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81100cf9a0 0x7f811015dca0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 -- 172.21.15.97:0/3628363154 >> 172.21.15.97:0/3628363154 conn(0x7f811006a800 msgr2=0x7f811006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 -- 172.21.15.97:0/3628363154 shutdown_connections 2023-11-24T08:07:38.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.971+0000 7f8115a51640 1 -- 172.21.15.97:0/3628363154 wait complete. 2023-11-24T08:07:38.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.973+0000 7f8115a51640 1 Processor -- start 2023-11-24T08:07:38.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.973+0000 7f8115a51640 1 -- start start 2023-11-24T08:07:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f8115a51640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81100cf9a0 0x7f81100ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f8115a51640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8110143ae0 0x7f81100ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f8115a51640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811015e1e0 0x7f811013edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f8115a51640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100cd500 con 0x7f811015e1e0 2023-11-24T08:07:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f8115a51640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100cd7a0 con 0x7f8110143ae0 2023-11-24T08:07:38.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f8115a51640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100cda80 con 0x7f81100cf9a0 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f810f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811015e1e0 0x7f811013edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f810f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811015e1e0 0x7f811013edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39976/0 (socket says 172.21.15.97:39976) 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.974+0000 7f810f7fe640 1 -- 172.21.15.97:0/1470332955 learned_addr learned my addr 172.21.15.97:0/1470332955 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f81067fc640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8110143ae0 0x7f81100ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810effd640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81100cf9a0 0x7f81100ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810f7fe640 1 -- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81100cf9a0 msgr2=0x7f81100ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810f7fe640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81100cf9a0 0x7f81100ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810f7fe640 1 -- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8110143ae0 msgr2=0x7f81100ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810f7fe640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8110143ae0 0x7f81100ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810f7fe640 1 -- 172.21.15.97:0/1470332955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000094d0 con 0x7f811015e1e0 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f81067fc640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8110143ae0 0x7f81100ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810f7fe640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811015e1e0 0x7f811013edc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8108007e60 tx=0x7f810800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810cff9640 1 -- 172.21.15.97:0/1470332955 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108014420 con 0x7f811015e1e0 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810cff9640 1 -- 172.21.15.97:0/1470332955 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080145a0 con 0x7f811015e1e0 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f810cff9640 1 -- 172.21.15.97:0/1470332955 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108014950 con 0x7f811015e1e0 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.975+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100cdd60 con 0x7f811015e1e0 2023-11-24T08:07:38.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.976+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100ce320 con 0x7f811015e1e0 2023-11-24T08:07:38.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.977+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81100675d0 con 0x7f811015e1e0 2023-11-24T08:07:38.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.977+0000 7f810cff9640 1 -- 172.21.15.97:0/1470332955 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8108014ab0 con 0x7f811015e1e0 2023-11-24T08:07:38.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.979+0000 7f810cff9640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f80f006ae40 0x7f80f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.979+0000 7f810cff9640 1 -- 172.21.15.97:0/1470332955 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8108089ff0 con 0x7f811015e1e0 2023-11-24T08:07:38.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.979+0000 7f810effd640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f80f006ae40 0x7f80f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.980+0000 7f810effd640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f80f006ae40 0x7f80f006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80f8003d90 tx=0x7f80f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:38.983+0000 7f810cff9640 1 -- 172.21.15.97:0/1470332955 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8108055010 con 0x7f811015e1e0 2023-11-24T08:07:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.173+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81101430e0 con 0x7f811015e1e0 2023-11-24T08:07:39.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.174+0000 7f810cff9640 1 -- 172.21.15.97:0/1470332955 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f8108058630 con 0x7f811015e1e0 2023-11-24T08:07:39.177 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:39.178 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f80f006ae40 msgr2=0x7f80f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f80f006ae40 0x7f80f006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f80f8003d90 tx=0x7f80f8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811015e1e0 msgr2=0x7f811013edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811015e1e0 0x7f811013edc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8108007e60 tx=0x7f810800e4b0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 shutdown_connections 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f80f006ae40 0x7f80f006d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f811015e1e0 0x7f811013edc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8110143ae0 0x7f81100ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 --2- 172.21.15.97:0/1470332955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81100cf9a0 0x7f81100ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 >> 172.21.15.97:0/1470332955 conn(0x7f811006a800 msgr2=0x7f811015b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 shutdown_connections 2023-11-24T08:07:39.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.177+0000 7f8115a51640 1 -- 172.21.15.97:0/1470332955 wait complete. 2023-11-24T08:07:39.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:39.198 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:39.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.412+0000 7f47430b4640 1 Processor -- start 2023-11-24T08:07:39.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.412+0000 7f47430b4640 1 -- start start 2023-11-24T08:07:39.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f47430b4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f473c0cf9a0 0x7f473c166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f47430b4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c15c5f0 con 0x7f473c13df80 2023-11-24T08:07:39.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f47430b4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c06c470 con 0x7f473c13e360 2023-11-24T08:07:39.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f47430b4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c06c750 con 0x7f473c0cf9a0 2023-11-24T08:07:39.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f4740e50640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f473c13df80 0x7f473c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55394/0 (socket says 172.21.15.97:55394) 2023-11-24T08:07:39.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f4740e50640 1 -- 172.21.15.97:0/2373316232 learned_addr learned my addr 172.21.15.97:0/2373316232 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:39.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f4741651640 1 --2- 172.21.15.97:0/2373316232 >> v2:172.21.15.183:3300/0 conn(0x7f473c0cf9a0 0x7f473c166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820426466 0 0) 0x7f473c15c5f0 con 0x7f473c13df80 2023-11-24T08:07:39.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.414+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f472c003520 con 0x7f473c13df80 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3095231003 0 0) 0x7f472c003520 con 0x7f473c13df80 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 >> v2:172.21.15.183:3300/0 conn(0x7f473c0cf9a0 msgr2=0x7f473c166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 --2- 172.21.15.97:0/2373316232 >> v2:172.21.15.183:3300/0 conn(0x7f473c0cf9a0 0x7f473c166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 >> v1:172.21.15.183:6789/0 conn(0x7f473c13e360 legacy=0x7f473c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c06ca30 con 0x7f473c13df80 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f4730001670 con 0x7f473c13df80 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 >> v1:172.21.15.97:6789/0 conn(0x7f473c13df80 legacy=0x7f473c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f472c003970 0x7f472c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f472c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f472c005180 0x7f472c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c06c750 con 0x7f472c0047c0 2023-11-24T08:07:39.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c00c020 con 0x7f472c005180 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c00c1e0 con 0x7f472c003970 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.415+0000 7f473bfff640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f472c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f4740e50640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f472c003970 0x7f472c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f4741651640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f472c005180 0x7f472c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f473bfff640 1 -- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f472c003970 msgr2=0x7f472c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f473bfff640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f472c003970 0x7f472c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f473bfff640 1 -- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f472c005180 msgr2=0x7f472c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f473bfff640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f472c005180 0x7f472c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f4741651640 1 -- 172.21.15.97:0/2373316232 reap_dead start 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f473bfff640 1 -- 172.21.15.97:0/2373316232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c003520 con 0x7f472c0047c0 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.416+0000 7f4740e50640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f472c003970 0x7f472c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.417+0000 7f473bfff640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f472c004c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4728001720 tx=0x7f472c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8d4be30eaebfcc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.417+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47280052d0 con 0x7f472c0047c0 2023-11-24T08:07:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.417+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472802e050 con 0x7f472c0047c0 2023-11-24T08:07:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.417+0000 7f473b7fe640 1 -- 172.21.15.97:0/2373316232 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728003830 con 0x7f472c0047c0 2023-11-24T08:07:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.418+0000 7f47430b4640 1 -- 172.21.15.97:0/2373316232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 msgr2=0x7f472c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.418+0000 7f47430b4640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f472c004c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4728001720 tx=0x7f472c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.418+0000 7f47430b4640 1 -- 172.21.15.97:0/2373316232 shutdown_connections 2023-11-24T08:07:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.418+0000 7f47430b4640 1 --2- 172.21.15.97:0/2373316232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f472c004c40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.418+0000 7f47430b4640 1 -- 172.21.15.97:0/2373316232 >> 172.21.15.97:0/2373316232 conn(0x7f473c06a800 msgr2=0x7f473c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.418+0000 7f47430b4640 1 -- 172.21.15.97:0/2373316232 shutdown_connections 2023-11-24T08:07:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.418+0000 7f47430b4640 1 -- 172.21.15.97:0/2373316232 wait complete. 2023-11-24T08:07:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.420+0000 7f47430b4640 1 Processor -- start 2023-11-24T08:07:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.420+0000 7f47430b4640 1 -- start start 2023-11-24T08:07:39.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.421+0000 7f47430b4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f473c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.421+0000 7f47430b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f473c1e54d0 0x7f473c0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.421+0000 7f47430b4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f473c13c5c0 0x7f473c13ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.421+0000 7f47430b4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c13cfb0 con 0x7f472c0047c0 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.421+0000 7f47430b4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1e5960 con 0x7f473c13c5c0 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.421+0000 7f47430b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1f2d20 con 0x7f473c1e54d0 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.421+0000 7f4740e50640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f473c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f473c153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39998/0 (socket says 172.21.15.97:39998) 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 -- 172.21.15.97:0/215664296 learned_addr learned my addr 172.21.15.97:0/215664296 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f473bfff640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f473c1e54d0 0x7f473c0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 -- 172.21.15.97:0/215664296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f473c1e54d0 msgr2=0x7f473c0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f473c1e54d0 0x7f473c0b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 -- 172.21.15.97:0/215664296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f473c13c5c0 msgr2=0x7f473c13ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f473c13c5c0 0x7f473c13ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 -- 172.21.15.97:0/215664296 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c1f3000 con 0x7f472c0047c0 2023-11-24T08:07:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f4740e50640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f473c153fd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f473000d6c0 tx=0x7f473000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.422+0000 7f47397fa640 1 -- 172.21.15.97:0/215664296 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300072d0 con 0x7f472c0047c0 2023-11-24T08:07:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.423+0000 7f47397fa640 1 -- 172.21.15.97:0/215664296 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730007430 con 0x7f472c0047c0 2023-11-24T08:07:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.423+0000 7f47397fa640 1 -- 172.21.15.97:0/215664296 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300047e0 con 0x7f472c0047c0 2023-11-24T08:07:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.423+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c1f32e0 con 0x7f472c0047c0 2023-11-24T08:07:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.423+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c0b3a40 con 0x7f472c0047c0 2023-11-24T08:07:39.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.424+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c0b3c30 con 0x7f472c0047c0 2023-11-24T08:07:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.425+0000 7f47397fa640 1 -- 172.21.15.97:0/215664296 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4730004940 con 0x7f472c0047c0 2023-11-24T08:07:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.425+0000 7f47397fa640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f472006ae40 0x7f472006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.426+0000 7f47397fa640 1 -- 172.21.15.97:0/215664296 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4730089180 con 0x7f472c0047c0 2023-11-24T08:07:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.426+0000 7f473bfff640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f472006ae40 0x7f472006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.427+0000 7f473bfff640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f472006ae40 0x7f472006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4728033000 tx=0x7f4728009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.430+0000 7f47397fa640 1 -- 172.21.15.97:0/215664296 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47300541c0 con 0x7f472c0047c0 2023-11-24T08:07:39.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.606+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f473c067000 con 0x7f472c0047c0 2023-11-24T08:07:39.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.607+0000 7f47397fa640 1 -- 172.21.15.97:0/215664296 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47300577e0 con 0x7f472c0047c0 2023-11-24T08:07:39.610 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:39.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.609+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f472006ae40 msgr2=0x7f472006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.609+0000 7f47430b4640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f472006ae40 0x7f472006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4728033000 tx=0x7f4728009030 comp rx=0 tx=0).stop 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.609+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 msgr2=0x7f473c153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.609+0000 7f47430b4640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f473c153fd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f473000d6c0 tx=0x7f473000db80 comp rx=0 tx=0).stop 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 shutdown_connections 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f472006ae40 0x7f472006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f473c13c5c0 0x7f473c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f473c1e54d0 0x7f473c0b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 --2- 172.21.15.97:0/215664296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f472c0047c0 0x7f473c153fd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 >> 172.21.15.97:0/215664296 conn(0x7f473c06a800 msgr2=0x7f473c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 shutdown_connections 2023-11-24T08:07:39.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.610+0000 7f47430b4640 1 -- 172.21.15.97:0/215664296 wait complete. 2023-11-24T08:07:39.629 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:39.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.835+0000 7f2e4b083640 1 Processor -- start 2023-11-24T08:07:39.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.835+0000 7f2e4b083640 1 -- start start 2023-11-24T08:07:39.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.837+0000 7f2e4b083640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2e4413df80 0x7f2e4415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.837+0000 7f2e4b083640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4406c470 con 0x7f2e4413e360 2023-11-24T08:07:39.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.837+0000 7f2e4b083640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4406c750 con 0x7f2e440cf9a0 2023-11-24T08:07:39.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.837+0000 7f2e4b083640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4406ca30 con 0x7f2e4413df80 2023-11-24T08:07:39.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.837+0000 7f2e3bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2e4413e360 0x7f2e440cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55410/0 (socket says 172.21.15.97:55410) 2023-11-24T08:07:39.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.837+0000 7f2e3bfff640 1 -- 172.21.15.97:0/2056882014 learned_addr learned my addr 172.21.15.97:0/2056882014 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:39.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e48e1f640 1 --2- 172.21.15.97:0/2056882014 >> v2:172.21.15.183:3300/0 conn(0x7f2e4413df80 0x7f2e4415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596274134 0 0) 0x7f2e4406c470 con 0x7f2e4413e360 2023-11-24T08:07:39.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e2c003520 con 0x7f2e4413e360 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3603102672 0 0) 0x7f2e2c003520 con 0x7f2e4413e360 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 >> v2:172.21.15.183:3300/0 conn(0x7f2e4413df80 msgr2=0x7f2e4415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 --2- 172.21.15.97:0/2056882014 >> v2:172.21.15.183:3300/0 conn(0x7f2e4413df80 0x7f2e4415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 >> v1:172.21.15.183:6789/0 conn(0x7f2e440cf9a0 legacy=0x7f2e440cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4406cd10 con 0x7f2e4413e360 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f2e34001670 con 0x7f2e4413e360 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.838+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 >> v1:172.21.15.97:6789/0 conn(0x7f2e4413e360 legacy=0x7f2e440cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3b7fe640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e2c003970 0x7f2e2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3b7fe640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e2c0047c0 0x7f2e2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3b7fe640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e2c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4406ca30 con 0x7f2e2c005180 2023-11-24T08:07:39.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c00c020 con 0x7f2e2c0047c0 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c00c1e0 con 0x7f2e2c003970 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e49620640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e2c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3bfff640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e2c0047c0 0x7f2e2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e49620640 1 -- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e2c003970 msgr2=0x7f2e2c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e49620640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e2c003970 0x7f2e2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e49620640 1 -- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e2c0047c0 msgr2=0x7f2e2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e49620640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e2c0047c0 0x7f2e2c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e49620640 1 -- 172.21.15.97:0/2056882014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c003520 con 0x7f2e2c005180 2023-11-24T08:07:39.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.839+0000 7f2e3bfff640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e2c0047c0 0x7f2e2c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:39.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.840+0000 7f2e49620640 1 -- 172.21.15.97:0/2056882014 reap_dead start 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.840+0000 7f2e49620640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e2c00b980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001720 tx=0x7f2e2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b52366a17afe41 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0052d0 con 0x7f2e2c005180 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c02e050 con 0x7f2e2c005180 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e3b7fe640 1 -- 172.21.15.97:0/2056882014 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0035f0 con 0x7f2e2c005180 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e4b083640 1 -- 172.21.15.97:0/2056882014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 msgr2=0x7f2e2c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e4b083640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e2c00b980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001720 tx=0x7f2e2c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e4b083640 1 -- 172.21.15.97:0/2056882014 shutdown_connections 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e4b083640 1 --2- 172.21.15.97:0/2056882014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e2c00b980 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e4b083640 1 -- 172.21.15.97:0/2056882014 >> 172.21.15.97:0/2056882014 conn(0x7f2e4406a800 msgr2=0x7f2e4406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e4b083640 1 -- 172.21.15.97:0/2056882014 shutdown_connections 2023-11-24T08:07:39.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.841+0000 7f2e4b083640 1 -- 172.21.15.97:0/2056882014 wait complete. 2023-11-24T08:07:39.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.843+0000 7f2e4b083640 1 Processor -- start 2023-11-24T08:07:39.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.843+0000 7f2e4b083640 1 -- start start 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e4b083640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e4413d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e4b083640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e440adbf0 0x7f2e440ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e4b083640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e441f2b90 0x7f2e440b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e4b083640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440707d0 con 0x7f2e2c005180 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e4b083640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440ad790 con 0x7f2e440adbf0 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e4b083640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440ad1d0 con 0x7f2e441f2b90 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e48e1f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e4413d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e48e1f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e4413d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40014/0 (socket says 172.21.15.97:40014) 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.844+0000 7f2e48e1f640 1 -- 172.21.15.97:0/1371861699 learned_addr learned my addr 172.21.15.97:0/1371861699 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e49620640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e441f2b90 0x7f2e440b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e3bfff640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e440adbf0 0x7f2e440ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e48e1f640 1 -- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e441f2b90 msgr2=0x7f2e440b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e48e1f640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e441f2b90 0x7f2e440b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e48e1f640 1 -- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e440adbf0 msgr2=0x7f2e440ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e48e1f640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e440adbf0 0x7f2e440ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e48e1f640 1 -- 172.21.15.97:0/1371861699 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440ad4b0 con 0x7f2e2c005180 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e49620640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e441f2b90 0x7f2e440b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:39.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e3bfff640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e440adbf0 0x7f2e440ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:39.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e48e1f640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e4413d8d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000ef40 tx=0x7f2e4000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e397fa640 1 -- 172.21.15.97:0/1371861699 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40010040 con 0x7f2e2c005180 2023-11-24T08:07:39.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e397fa640 1 -- 172.21.15.97:0/1371861699 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e40014400 con 0x7f2e2c005180 2023-11-24T08:07:39.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e440703f0 con 0x7f2e2c005180 2023-11-24T08:07:39.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.845+0000 7f2e397fa640 1 -- 172.21.15.97:0/1371861699 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40009c20 con 0x7f2e2c005180 2023-11-24T08:07:39.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.846+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e441f3010 con 0x7f2e2c005180 2023-11-24T08:07:39.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.847+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e441f32f0 con 0x7f2e2c005180 2023-11-24T08:07:39.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.847+0000 7f2e397fa640 1 -- 172.21.15.97:0/1371861699 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e400147b0 con 0x7f2e2c005180 2023-11-24T08:07:39.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.848+0000 7f2e397fa640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2e3006ae40 0x7f2e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.848+0000 7f2e397fa640 1 -- 172.21.15.97:0/1371861699 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2e4008a030 con 0x7f2e2c005180 2023-11-24T08:07:39.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.849+0000 7f2e3bfff640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2e3006ae40 0x7f2e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.849+0000 7f2e3bfff640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2e3006ae40 0x7f2e3006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e34001eb0 tx=0x7f2e34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:39.853+0000 7f2e397fa640 1 -- 172.21.15.97:0/1371861699 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e400550f0 con 0x7f2e2c005180 2023-11-24T08:07:40.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.041+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e440675d0 con 0x7f2e2c005180 2023-11-24T08:07:40.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.042+0000 7f2e397fa640 1 -- 172.21.15.97:0/1371861699 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e40058710 con 0x7f2e2c005180 2023-11-24T08:07:40.045 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2e3006ae40 msgr2=0x7f2e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2e3006ae40 0x7f2e3006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e34001eb0 tx=0x7f2e34009040 comp rx=0 tx=0).stop 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 msgr2=0x7f2e4413d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e4413d8d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000ef40 tx=0x7f2e4000b480 comp rx=0 tx=0).stop 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 shutdown_connections 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2e3006ae40 0x7f2e3006d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e441f2b90 0x7f2e440b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e440adbf0 0x7f2e440ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 --2- 172.21.15.97:0/1371861699 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e2c005180 0x7f2e4413d8d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 >> 172.21.15.97:0/1371861699 conn(0x7f2e4406a800 msgr2=0x7f2e440cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 shutdown_connections 2023-11-24T08:07:40.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.045+0000 7f2e4b083640 1 -- 172.21.15.97:0/1371861699 wait complete. 2023-11-24T08:07:40.066 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:40.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.268+0000 7f85c67a9640 1 Processor -- start 2023-11-24T08:07:40.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.269+0000 7f85c67a9640 1 -- start start 2023-11-24T08:07:40.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85c67a9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c015e880 0x7f85c006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85c67a9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85c0070490 0x7f85c0099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85c67a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c009a3f0 con 0x7f85c0099fa0 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85c67a9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00cfa70 con 0x7f85c015e880 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85c67a9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00cff00 con 0x7f85c0070490 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85bffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c015e880 0x7f85c006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85bffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c015e880 0x7f85c006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40024/0 (socket says 172.21.15.97:40024) 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.270+0000 7f85bffff640 1 -- 172.21.15.97:0/3652644776 learned_addr learned my addr 172.21.15.97:0/3652644776 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.271+0000 7f85bffff640 1 -- 172.21.15.97:0/3652644776 >> v2:172.21.15.183:3300/0 conn(0x7f85c0070490 msgr2=0x7f85c0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.271+0000 7f85bffff640 1 --2- 172.21.15.97:0/3652644776 >> v2:172.21.15.183:3300/0 conn(0x7f85c0070490 0x7f85c0099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.271+0000 7f85bffff640 1 -- 172.21.15.97:0/3652644776 >> v1:172.21.15.183:6789/0 conn(0x7f85c0099fa0 legacy=0x7f85c00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:40.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.271+0000 7f85bffff640 1 -- 172.21.15.97:0/3652644776 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c006fc70 con 0x7f85c015e880 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.272+0000 7f85bffff640 1 --2- 172.21.15.97:0/3652644776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c015e880 0x7f85c006ff50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f85c0071800 tx=0x7f85b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda68a8d8b0d86c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.272+0000 7f85bf7fe640 1 -- 172.21.15.97:0/3652644776 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0030860 con 0x7f85c015e880 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.272+0000 7f85bf7fe640 1 -- 172.21.15.97:0/3652644776 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b00309c0 con 0x7f85c015e880 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.272+0000 7f85bf7fe640 1 -- 172.21.15.97:0/3652644776 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0030d50 con 0x7f85c015e880 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 -- 172.21.15.97:0/3652644776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c015e880 msgr2=0x7f85c006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 --2- 172.21.15.97:0/3652644776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c015e880 0x7f85c006ff50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f85c0071800 tx=0x7f85b002b9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 -- 172.21.15.97:0/3652644776 shutdown_connections 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 --2- 172.21.15.97:0/3652644776 >> v2:172.21.15.183:3300/0 conn(0x7f85c0070490 0x7f85c0099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 --2- 172.21.15.97:0/3652644776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c015e880 0x7f85c006ff50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 -- 172.21.15.97:0/3652644776 >> 172.21.15.97:0/3652644776 conn(0x7f85c00b2d00 msgr2=0x7f85c00b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 -- 172.21.15.97:0/3652644776 shutdown_connections 2023-11-24T08:07:40.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.273+0000 7f85c67a9640 1 -- 172.21.15.97:0/3652644776 wait complete. 2023-11-24T08:07:40.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.275+0000 7f85c67a9640 1 Processor -- start 2023-11-24T08:07:40.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.275+0000 7f85c67a9640 1 -- start start 2023-11-24T08:07:40.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85c67a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c0070490 0x7f85c00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85c67a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85c0099fa0 0x7f85c009b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85c67a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85c015e880 0x7f85c00cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85c67a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00ca9c0 con 0x7f85c0070490 2023-11-24T08:07:40.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85c67a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c006b9c0 con 0x7f85c0099fa0 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85c67a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c006b690 con 0x7f85c015e880 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c0070490 0x7f85c00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c0070490 0x7f85c00c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40028/0 (socket says 172.21.15.97:40028) 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 -- 172.21.15.97:0/1597297951 learned_addr learned my addr 172.21.15.97:0/1597297951 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 -- 172.21.15.97:0/1597297951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85c015e880 msgr2=0x7f85c00cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85c015e880 0x7f85c00cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 -- 172.21.15.97:0/1597297951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85c0099fa0 msgr2=0x7f85c009b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85c0099fa0 0x7f85c009b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.276+0000 7f85bffff640 1 -- 172.21.15.97:0/1597297951 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00094d0 con 0x7f85c0070490 2023-11-24T08:07:40.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.277+0000 7f85bffff640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c0070490 0x7f85c00c9d40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000c00 tx=0x7f85b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.277+0000 7f85bd7fa640 1 -- 172.21.15.97:0/1597297951 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0039b40 con 0x7f85c0070490 2023-11-24T08:07:40.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.277+0000 7f85bd7fa640 1 -- 172.21.15.97:0/1597297951 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0039ca0 con 0x7f85c0070490 2023-11-24T08:07:40.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.277+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c009bd50 con 0x7f85c0070490 2023-11-24T08:07:40.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.277+0000 7f85bd7fa640 1 -- 172.21.15.97:0/1597297951 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0043630 con 0x7f85c0070490 2023-11-24T08:07:40.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.277+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c00ca6e0 con 0x7f85c0070490 2023-11-24T08:07:40.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.278+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c006b4f0 con 0x7f85c0070490 2023-11-24T08:07:40.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.279+0000 7f85bd7fa640 1 -- 172.21.15.97:0/1597297951 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85b004c3b0 con 0x7f85c0070490 2023-11-24T08:07:40.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.280+0000 7f85bd7fa640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85a006ae70 0x7f85a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.280+0000 7f85bd7fa640 1 -- 172.21.15.97:0/1597297951 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f85b00abb60 con 0x7f85c0070490 2023-11-24T08:07:40.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.280+0000 7f85b7fff640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85a006ae70 0x7f85a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.281+0000 7f85b7fff640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85a006ae70 0x7f85a006d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009710 tx=0x7f85a8006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.284+0000 7f85bd7fa640 1 -- 172.21.15.97:0/1597297951 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85c006b4f0 con 0x7f85c0070490 2023-11-24T08:07:40.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.471+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85c009a3f0 con 0x7f85c0070490 2023-11-24T08:07:40.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.472+0000 7f85bd7fa640 1 -- 172.21.15.97:0/1597297951 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85c009a3f0 con 0x7f85c0070490 2023-11-24T08:07:40.475 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:40.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85a006ae70 msgr2=0x7f85a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85a006ae70 0x7f85a006d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009710 tx=0x7f85a8006c90 comp rx=0 tx=0).stop 2023-11-24T08:07:40.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c0070490 msgr2=0x7f85c00c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c0070490 0x7f85c00c9d40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000c00 tx=0x7f85b0004730 comp rx=0 tx=0).stop 2023-11-24T08:07:40.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 shutdown_connections 2023-11-24T08:07:40.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f85a006ae70 0x7f85a006d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85c015e880 0x7f85c00cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85c0099fa0 0x7f85c009b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 --2- 172.21.15.97:0/1597297951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c0070490 0x7f85c00c9d40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 >> 172.21.15.97:0/1597297951 conn(0x7f85c00b2d00 msgr2=0x7f85c00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 shutdown_connections 2023-11-24T08:07:40.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.475+0000 7f85c67a9640 1 -- 172.21.15.97:0/1597297951 wait complete. 2023-11-24T08:07:40.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:40.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.705+0000 7f4ac4d97640 1 Processor -- start 2023-11-24T08:07:40.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.705+0000 7f4ac4d97640 1 -- start start 2023-11-24T08:07:40.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4ac4d97640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4ac00cd240 0x7f4ac00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4ac4d97640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4ac006c6b0 0x7f4ac0099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4ac4d97640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac006cea0 con 0x7f4ac0099fa0 2023-11-24T08:07:40.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4ac4d97640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac009a410 con 0x7f4ac00cd240 2023-11-24T08:07:40.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4ac4d97640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac006cbc0 con 0x7f4ac006c6b0 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4abe59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4ac00cd240 0x7f4ac00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4abed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4ac0099fa0 0x7f4ac006b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55418/0 (socket says 172.21.15.97:55418) 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.707+0000 7f4abed9d640 1 -- 172.21.15.97:0/161402358 learned_addr learned my addr 172.21.15.97:0/161402358 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.708+0000 7f4abdd9b640 1 --2- 172.21.15.97:0/161402358 >> v2:172.21.15.183:3300/0 conn(0x7f4ac006c6b0 0x7f4ac0099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.708+0000 7f4abd59a640 1 -- 172.21.15.97:0/161402358 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132184425 0 0) 0x7f4ac006cea0 con 0x7f4ac0099fa0 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.708+0000 7f4abe59c640 1 -- 172.21.15.97:0/161402358 >> v2:172.21.15.183:3300/0 conn(0x7f4ac006c6b0 msgr2=0x7f4ac0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.708+0000 7f4abe59c640 1 --2- 172.21.15.97:0/161402358 >> v2:172.21.15.183:3300/0 conn(0x7f4ac006c6b0 0x7f4ac0099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.708+0000 7f4abe59c640 1 -- 172.21.15.97:0/161402358 >> v1:172.21.15.97:6789/0 conn(0x7f4ac0099fa0 legacy=0x7f4ac006b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.708+0000 7f4abe59c640 1 -- 172.21.15.97:0/161402358 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac006f350 con 0x7f4ac00cd240 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.709+0000 7f4abe59c640 1 --2- 172.21.15.97:0/161402358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac00cd240 0x7f4ac00b3820 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0071800 tx=0x7f4ab002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df3497fa6f22c90 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.709+0000 7f4abd59a640 1 -- 172.21.15.97:0/161402358 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab002cc80 con 0x7f4ac00cd240 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.709+0000 7f4abd59a640 1 -- 172.21.15.97:0/161402358 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab002cde0 con 0x7f4ac00cd240 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.709+0000 7f4abd59a640 1 -- 172.21.15.97:0/161402358 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0034660 con 0x7f4ac00cd240 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 -- 172.21.15.97:0/161402358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac00cd240 msgr2=0x7f4ac00b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/161402358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac00cd240 0x7f4ac00b3820 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0071800 tx=0x7f4ab002bed0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 -- 172.21.15.97:0/161402358 shutdown_connections 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/161402358 >> v2:172.21.15.183:3300/0 conn(0x7f4ac006c6b0 0x7f4ac0099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/161402358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac00cd240 0x7f4ac00b3820 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 -- 172.21.15.97:0/161402358 >> 172.21.15.97:0/161402358 conn(0x7f4ac00b2d00 msgr2=0x7f4ac00b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 -- 172.21.15.97:0/161402358 shutdown_connections 2023-11-24T08:07:40.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.710+0000 7f4ac4d97640 1 -- 172.21.15.97:0/161402358 wait complete. 2023-11-24T08:07:40.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.712+0000 7f4ac4d97640 1 Processor -- start 2023-11-24T08:07:40.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.712+0000 7f4ac4d97640 1 -- start start 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4ac4d97640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac006c6b0 0x7f4ac00c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4ac4d97640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ac0099fa0 0x7f4ac00c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4ac4d97640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ac00cd240 0x7f4ac014eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4ac4d97640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00ca920 con 0x7f4ac006c6b0 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4ac4d97640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00c9ca0 con 0x7f4ac0099fa0 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4ac4d97640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00c9f80 con 0x7f4ac00cd240 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4abe59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac006c6b0 0x7f4ac00c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4abe59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac006c6b0 0x7f4ac00c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40048/0 (socket says 172.21.15.97:40048) 2023-11-24T08:07:40.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.713+0000 7f4abe59c640 1 -- 172.21.15.97:0/4169557459 learned_addr learned my addr 172.21.15.97:0/4169557459 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4abe59c640 1 -- 172.21.15.97:0/4169557459 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ac00cd240 msgr2=0x7f4ac014eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4abe59c640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ac00cd240 0x7f4ac014eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4abe59c640 1 -- 172.21.15.97:0/4169557459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ac0099fa0 msgr2=0x7f4ac00c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4abdd9b640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ac0099fa0 0x7f4ac00c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4abe59c640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ac0099fa0 0x7f4ac00c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4abe59c640 1 -- 172.21.15.97:0/4169557459 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab0009a70 con 0x7f4ac006c6b0 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4abe59c640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac006c6b0 0x7f4ac00c4f70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0037040 tx=0x7f4ab0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4ab6ffd640 1 -- 172.21.15.97:0/4169557459 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0040650 con 0x7f4ac006c6b0 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4ab6ffd640 1 -- 172.21.15.97:0/4169557459 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab00407f0 con 0x7f4ac006c6b0 2023-11-24T08:07:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4ab6ffd640 1 -- 172.21.15.97:0/4169557459 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0040ba0 con 0x7f4ac006c6b0 2023-11-24T08:07:40.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.714+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac00ca260 con 0x7f4ac006c6b0 2023-11-24T08:07:40.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.715+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac00c54b0 con 0x7f4ac006c6b0 2023-11-24T08:07:40.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.716+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac00cad40 con 0x7f4ac006c6b0 2023-11-24T08:07:40.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.716+0000 7f4ab6ffd640 1 -- 172.21.15.97:0/4169557459 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ab0040d00 con 0x7f4ac006c6b0 2023-11-24T08:07:40.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.717+0000 7f4ab6ffd640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4aa006ae70 0x7f4aa006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.717+0000 7f4ab6ffd640 1 -- 172.21.15.97:0/4169557459 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4ab00ac3b0 con 0x7f4ac006c6b0 2023-11-24T08:07:40.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.718+0000 7f4abdd9b640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4aa006ae70 0x7f4aa006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.718+0000 7f4abdd9b640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4aa006ae70 0x7f4aa006d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8006fd0 tx=0x7f4aa8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.722+0000 7f4ab6ffd640 1 -- 172.21.15.97:0/4169557459 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ab0077500 con 0x7f4ac006c6b0 2023-11-24T08:07:40.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.924+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4ac00caa60 con 0x7f4ac006c6b0 2023-11-24T08:07:40.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.925+0000 7f4ab6ffd640 1 -- 172.21.15.97:0/4169557459 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4ac00caa60 con 0x7f4ac006c6b0 2023-11-24T08:07:40.927 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:40.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4aa006ae70 msgr2=0x7f4aa006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4aa006ae70 0x7f4aa006d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8006fd0 tx=0x7f4aa8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:40.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac006c6b0 msgr2=0x7f4ac00c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac006c6b0 0x7f4ac00c4f70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0037040 tx=0x7f4ab0004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:40.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 shutdown_connections 2023-11-24T08:07:40.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f4aa006ae70 0x7f4aa006d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ac00cd240 0x7f4ac014eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ac0099fa0 0x7f4ac00c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 --2- 172.21.15.97:0/4169557459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4ac006c6b0 0x7f4ac00c4f70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 >> 172.21.15.97:0/4169557459 conn(0x7f4ac00b2d00 msgr2=0x7f4ac00cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 shutdown_connections 2023-11-24T08:07:40.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:40.928+0000 7f4ac4d97640 1 -- 172.21.15.97:0/4169557459 wait complete. 2023-11-24T08:07:40.949 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi097.front.sepia.ceph.com... 2023-11-24T08:07:40.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:40.950 DEBUG:teuthology.orchestra.run.smithi097:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-24T08:07:41.048 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:41.048 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:07:41.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:41.048 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:07:41.099 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:07:41.099 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:41.158 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:07:41.158 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:41.212 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:41.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.438+0000 7f4525961640 1 Processor -- start 2023-11-24T08:07:41.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.439+0000 7f4525961640 1 -- start start 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.440+0000 7f4525961640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f45200ae5a0 0x7f452015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.440+0000 7f4525961640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f45200cf290 0x7f45200cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f4525961640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4520070c40 con 0x7f45200b3ae0 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f4525961640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4520071450 con 0x7f45200ae5a0 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f4525961640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45200cfc60 con 0x7f45200cf290 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f45200ae5a0 0x7f452015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f45200ae5a0 0x7f452015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40060/0 (socket says 172.21.15.97:40060) 2023-11-24T08:07:41.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451effd640 1 -- 172.21.15.97:0/1284613686 learned_addr learned my addr 172.21.15.97:0/1284613686 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451f7fe640 1 --2- 172.21.15.97:0/1284613686 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf290 0x7f45200cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451effd640 1 -- 172.21.15.97:0/1284613686 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf290 msgr2=0x7f45200cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451effd640 1 --2- 172.21.15.97:0/1284613686 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf290 0x7f45200cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451effd640 1 -- 172.21.15.97:0/1284613686 >> v1:172.21.15.97:6789/0 conn(0x7f45200b3ae0 legacy=0x7f452006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451effd640 1 -- 172.21.15.97:0/1284613686 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452006c470 con 0x7f45200ae5a0 2023-11-24T08:07:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451e7fc640 1 -- 172.21.15.97:0/1284613686 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730660763 0 0) 0x7f4520070c40 con 0x7f45200b3ae0 2023-11-24T08:07:41.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.441+0000 7f451f7fe640 1 --2- 172.21.15.97:0/1284613686 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf290 0x7f45200cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.442+0000 7f451effd640 1 --2- 172.21.15.97:0/1284613686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452015e430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f45200b3f70 tx=0x7f451002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47a5cbd48d68d98 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f451e7fc640 1 -- 172.21.15.97:0/1284613686 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451002cbb0 con 0x7f45200ae5a0 2023-11-24T08:07:41.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f451e7fc640 1 -- 172.21.15.97:0/1284613686 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451002cd10 con 0x7f45200ae5a0 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f451e7fc640 1 -- 172.21.15.97:0/1284613686 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510034610 con 0x7f45200ae5a0 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f4525961640 1 -- 172.21.15.97:0/1284613686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 msgr2=0x7f452015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f4525961640 1 --2- 172.21.15.97:0/1284613686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452015e430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f45200b3f70 tx=0x7f451002c010 comp rx=0 tx=0).stop 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f4525961640 1 -- 172.21.15.97:0/1284613686 shutdown_connections 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f4525961640 1 --2- 172.21.15.97:0/1284613686 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf290 0x7f45200cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f4525961640 1 --2- 172.21.15.97:0/1284613686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452015e430 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f4525961640 1 -- 172.21.15.97:0/1284613686 >> 172.21.15.97:0/1284613686 conn(0x7f452006a800 msgr2=0x7f452006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.443+0000 7f4525961640 1 -- 172.21.15.97:0/1284613686 shutdown_connections 2023-11-24T08:07:41.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.444+0000 7f4525961640 1 -- 172.21.15.97:0/1284613686 wait complete. 2023-11-24T08:07:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.445+0000 7f4525961640 1 Processor -- start 2023-11-24T08:07:41.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.445+0000 7f4525961640 1 -- start start 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.446+0000 7f4525961640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.446+0000 7f4525961640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45200b3ae0 0x7f4520160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.446+0000 7f4525961640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45200cf290 0x7f4520157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.446+0000 7f4525961640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45201f29a0 con 0x7f45200ae5a0 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.446+0000 7f4525961640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45201f2c80 con 0x7f45200b3ae0 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.446+0000 7f4525961640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45201f2f60 con 0x7f45200cf290 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.446+0000 7f451effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452014c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40068/0 (socket says 172.21.15.97:40068) 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 -- 172.21.15.97:0/2804036725 learned_addr learned my addr 172.21.15.97:0/2804036725 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f45167fc640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45200b3ae0 0x7f4520160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451f7fe640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45200cf290 0x7f4520157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 -- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45200cf290 msgr2=0x7f4520157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45200cf290 0x7f4520157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 -- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45200b3ae0 msgr2=0x7f4520160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45200b3ae0 0x7f4520160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 -- 172.21.15.97:0/2804036725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510009b30 con 0x7f45200ae5a0 2023-11-24T08:07:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f45167fc640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45200b3ae0 0x7f4520160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.447+0000 7f451effd640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452014c790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4510036040 tx=0x7f4510004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.448+0000 7f451cff9640 1 -- 172.21.15.97:0/2804036725 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451003e450 con 0x7f45200ae5a0 2023-11-24T08:07:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.448+0000 7f451cff9640 1 -- 172.21.15.97:0/2804036725 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451003e5b0 con 0x7f45200ae5a0 2023-11-24T08:07:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.448+0000 7f451cff9640 1 -- 172.21.15.97:0/2804036725 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451003e760 con 0x7f45200ae5a0 2023-11-24T08:07:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.448+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45201f3240 con 0x7f45200ae5a0 2023-11-24T08:07:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.448+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4520160780 con 0x7f45200ae5a0 2023-11-24T08:07:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.449+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45201f3460 con 0x7f45200ae5a0 2023-11-24T08:07:41.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.450+0000 7f451cff9640 1 -- 172.21.15.97:0/2804036725 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f451003e8c0 con 0x7f45200ae5a0 2023-11-24T08:07:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.451+0000 7f451cff9640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f450006ae40 0x7f450006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.451+0000 7f451cff9640 1 -- 172.21.15.97:0/2804036725 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f45100ac350 con 0x7f45200ae5a0 2023-11-24T08:07:41.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.451+0000 7f45167fc640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f450006ae40 0x7f450006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.452+0000 7f45167fc640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f450006ae40 0x7f450006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452015d5e0 tx=0x7f4508009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.455+0000 7f451cff9640 1 -- 172.21.15.97:0/2804036725 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45100772e0 con 0x7f45200ae5a0 2023-11-24T08:07:41.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.645+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45200675d0 con 0x7f45200ae5a0 2023-11-24T08:07:41.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.648+0000 7f451cff9640 1 -- 172.21.15.97:0/2804036725 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f4510033e80 con 0x7f45200ae5a0 2023-11-24T08:07:41.651 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:41.651 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f450006ae40 msgr2=0x7f450006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f450006ae40 0x7f450006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452015d5e0 tx=0x7f4508009040 comp rx=0 tx=0).stop 2023-11-24T08:07:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 msgr2=0x7f452014c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452014c790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4510036040 tx=0x7f4510004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 shutdown_connections 2023-11-24T08:07:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f450006ae40 0x7f450006d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45200cf290 0x7f4520157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45200b3ae0 0x7f4520160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 --2- 172.21.15.97:0/2804036725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f45200ae5a0 0x7f452014c790 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 >> 172.21.15.97:0/2804036725 conn(0x7f452006a800 msgr2=0x7f452015d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.651+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 shutdown_connections 2023-11-24T08:07:41.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.652+0000 7f4525961640 1 -- 172.21.15.97:0/2804036725 wait complete. 2023-11-24T08:07:41.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:41.674 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:41.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.893+0000 7f6e436ad640 1 Processor -- start 2023-11-24T08:07:41.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.893+0000 7f6e436ad640 1 -- start start 2023-11-24T08:07:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.894+0000 7f6e436ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.894+0000 7f6e436ad640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e3c162f30 0x7f6e3c165320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.894+0000 7f6e436ad640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3c0ce2a0 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e436ad640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c0d00a0 con 0x7f6e3c162f30 2023-11-24T08:07:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e436ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0b4010 con 0x7f6e3c0cd960 2023-11-24T08:07:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e41449640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6e3c15b2a0 0x7f6e3c0cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55444/0 (socket says 172.21.15.97:55444) 2023-11-24T08:07:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e41449640 1 -- 172.21.15.97:0/3038586649 learned_addr learned my addr 172.21.15.97:0/3038586649 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:41.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e41c4a640 1 --2- 172.21.15.97:0/3038586649 >> v2:172.21.15.97:3300/0 conn(0x7f6e3c162f30 0x7f6e3c165320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e2ffff640 1 -- 172.21.15.97:0/3038586649 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087826338 0 0) 0x7f6e3c0ce2a0 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e2ffff640 1 -- 172.21.15.97:0/3038586649 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e28003520 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e41c4a640 1 -- 172.21.15.97:0/3038586649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 msgr2=0x7f6e3c0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.895+0000 7f6e40c48640 1 --2- 172.21.15.97:0/3038586649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.896+0000 7f6e41c4a640 1 --2- 172.21.15.97:0/3038586649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c0cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.896+0000 7f6e41c4a640 1 -- 172.21.15.97:0/3038586649 >> v1:172.21.15.97:6789/0 conn(0x7f6e3c15b2a0 legacy=0x7f6e3c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.896+0000 7f6e41c4a640 1 -- 172.21.15.97:0/3038586649 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c0b42f0 con 0x7f6e3c162f30 2023-11-24T08:07:41.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.896+0000 7f6e40c48640 1 --2- 172.21.15.97:0/3038586649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.897+0000 7f6e41c4a640 1 --2- 172.21.15.97:0/3038586649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c162f30 0x7f6e3c165320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097a0 tx=0x7f6e3402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea908ee6c6ed04de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.897+0000 7f6e2ffff640 1 -- 172.21.15.97:0/3038586649 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3402d040 con 0x7f6e3c162f30 2023-11-24T08:07:41.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.897+0000 7f6e2ffff640 1 -- 172.21.15.97:0/3038586649 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34031810 con 0x7f6e3c162f30 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.897+0000 7f6e2ffff640 1 -- 172.21.15.97:0/3038586649 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34031ba0 con 0x7f6e3c162f30 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 -- 172.21.15.97:0/3038586649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c162f30 msgr2=0x7f6e3c165320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3038586649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c162f30 0x7f6e3c165320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097a0 tx=0x7f6e3402b8b0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 -- 172.21.15.97:0/3038586649 shutdown_connections 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3038586649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c162f30 0x7f6e3c165320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3038586649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 -- 172.21.15.97:0/3038586649 >> 172.21.15.97:0/3038586649 conn(0x7f6e3c0d1020 msgr2=0x7f6e3c0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 -- 172.21.15.97:0/3038586649 shutdown_connections 2023-11-24T08:07:41.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.898+0000 7f6e436ad640 1 -- 172.21.15.97:0/3038586649 wait complete. 2023-11-24T08:07:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.899+0000 7f6e436ad640 1 Processor -- start 2023-11-24T08:07:41.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.900+0000 7f6e436ad640 1 -- start start 2023-11-24T08:07:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.900+0000 7f6e436ad640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e436ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c15b2a0 0x7f6e3c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e436ad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c162f30 0x7f6e3c14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e436ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c06c510 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e436ad640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c06d100 con 0x7f6e3c162f30 2023-11-24T08:07:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e436ad640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c06d3e0 con 0x7f6e3c0cd960 2023-11-24T08:07:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c15b2a0 0x7f6e3c14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c15b2a0 0x7f6e3c14b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40090/0 (socket says 172.21.15.97:40090) 2023-11-24T08:07:41.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 -- 172.21.15.97:0/3534616542 learned_addr learned my addr 172.21.15.97:0/3534616542 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:41.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e41449640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 -- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 msgr2=0x7f6e3c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c06bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 -- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c162f30 msgr2=0x7f6e3c14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e41c4a640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c162f30 0x7f6e3c14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c162f30 0x7f6e3c14bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.901+0000 7f6e40c48640 1 -- 172.21.15.97:0/3534616542 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34009400 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.902+0000 7f6e40c48640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c15b2a0 0x7f6e3c14b680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800cf60 tx=0x7f6e3800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.902+0000 7f6e2dffb640 1 -- 172.21.15.97:0/3534616542 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800d840 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.902+0000 7f6e2dffb640 1 -- 172.21.15.97:0/3534616542 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3800d9a0 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.902+0000 7f6e2dffb640 1 -- 172.21.15.97:0/3534616542 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800dd30 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.902+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3c06b4f0 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.902+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c06bab0 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.903+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c0b6d60 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.904+0000 7f6e2dffb640 1 -- 172.21.15.97:0/3534616542 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e38015440 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.905+0000 7f6e2dffb640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e2006ae40 0x7f6e2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.905+0000 7f6e2dffb640 1 -- 172.21.15.97:0/3534616542 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6e38089ff0 con 0x7f6e3c15b2a0 2023-11-24T08:07:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.905+0000 7f6e41449640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e2006ae40 0x7f6e2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.906+0000 7f6e41449640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e2006ae40 0x7f6e2006d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e300011e0 tx=0x7f6e30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:41.909+0000 7f6e2dffb640 1 -- 172.21.15.97:0/3534616542 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e38055120 con 0x7f6e3c15b2a0 2023-11-24T08:07:42.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.098+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e3c0675d0 con 0x7f6e3c15b2a0 2023-11-24T08:07:42.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.102+0000 7f6e2dffb640 1 -- 172.21.15.97:0/3534616542 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e3801a020 con 0x7f6e3c15b2a0 2023-11-24T08:07:42.105 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:42.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e2006ae40 msgr2=0x7f6e2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e2006ae40 0x7f6e2006d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e300011e0 tx=0x7f6e30009040 comp rx=0 tx=0).stop 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c15b2a0 msgr2=0x7f6e3c14b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c15b2a0 0x7f6e3c14b680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800cf60 tx=0x7f6e3800cf90 comp rx=0 tx=0).stop 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 shutdown_connections 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6e2006ae40 0x7f6e2006d300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e3c162f30 0x7f6e3c14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e3c15b2a0 0x7f6e3c14b680 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 --2- 172.21.15.97:0/3534616542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e3c0cd960 0x7f6e3c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 >> 172.21.15.97:0/3534616542 conn(0x7f6e3c0d1020 msgr2=0x7f6e3c0b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 shutdown_connections 2023-11-24T08:07:42.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.105+0000 7f6e436ad640 1 -- 172.21.15.97:0/3534616542 wait complete. 2023-11-24T08:07:42.127 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.346+0000 7fc07e82d640 1 Processor -- start 2023-11-24T08:07:42.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.346+0000 7fc07e82d640 1 -- start start 2023-11-24T08:07:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc07e82d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc078143ae0 0x7fc0780cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc07e82d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc0780cf7d0 0x7fc07815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc07e82d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc07815e1e0 0x7fc07815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc07e82d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780cfc30 con 0x7fc0780cf7d0 2023-11-24T08:07:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc07e82d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780b1ee0 con 0x7fc07815e1e0 2023-11-24T08:07:42.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc07e82d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780b2780 con 0x7fc078143ae0 2023-11-24T08:07:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc06ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc0780cf7d0 0x7fc07815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc06ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc0780cf7d0 0x7fc07815dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40100/0 (socket says 172.21.15.97:40100) 2023-11-24T08:07:42.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc06ffff640 1 -- 172.21.15.97:0/2895816529 learned_addr learned my addr 172.21.15.97:0/2895816529 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc06ffff640 1 -- 172.21.15.97:0/2895816529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc078143ae0 msgr2=0x7fc0780cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.348+0000 7fc07cdca640 1 --2- 172.21.15.97:0/2895816529 >> v2:172.21.15.183:3300/0 conn(0x7fc07815e1e0 0x7fc07815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc077fff640 1 --2- 172.21.15.97:0/2895816529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc078143ae0 0x7fc0780cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc06ffff640 1 --2- 172.21.15.97:0/2895816529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc078143ae0 0x7fc0780cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc06ffff640 1 -- 172.21.15.97:0/2895816529 >> v2:172.21.15.183:3300/0 conn(0x7fc07815e1e0 msgr2=0x7fc07815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc06ffff640 1 --2- 172.21.15.97:0/2895816529 >> v2:172.21.15.183:3300/0 conn(0x7fc07815e1e0 0x7fc07815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc06ffff640 1 -- 172.21.15.97:0/2895816529 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07815e990 con 0x7fc0780cf7d0 2023-11-24T08:07:42.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc07cdca640 1 --2- 172.21.15.97:0/2895816529 >> v2:172.21.15.183:3300/0 conn(0x7fc07815e1e0 0x7fc07815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:42.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.349+0000 7fc077fff640 1 --2- 172.21.15.97:0/2895816529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc078143ae0 0x7fc0780cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:42.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.350+0000 7fc06ffff640 1 --2- 172.21.15.97:0/2895816529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0780cf7d0 0x7fc07815dca0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc078072160 tx=0x7fc06002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fa1a7933d9357d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.350+0000 7fc0777fe640 1 -- 172.21.15.97:0/2895816529 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060031870 con 0x7fc0780cf7d0 2023-11-24T08:07:42.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.350+0000 7fc0777fe640 1 -- 172.21.15.97:0/2895816529 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0600319d0 con 0x7fc0780cf7d0 2023-11-24T08:07:42.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.350+0000 7fc0777fe640 1 -- 172.21.15.97:0/2895816529 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060031d60 con 0x7fc0780cf7d0 2023-11-24T08:07:42.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 -- 172.21.15.97:0/2895816529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0780cf7d0 msgr2=0x7fc07815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 --2- 172.21.15.97:0/2895816529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0780cf7d0 0x7fc07815dca0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc078072160 tx=0x7fc06002b910 comp rx=0 tx=0).stop 2023-11-24T08:07:42.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 -- 172.21.15.97:0/2895816529 shutdown_connections 2023-11-24T08:07:42.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 --2- 172.21.15.97:0/2895816529 >> v2:172.21.15.183:3300/0 conn(0x7fc07815e1e0 0x7fc07815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 --2- 172.21.15.97:0/2895816529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0780cf7d0 0x7fc07815dca0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 --2- 172.21.15.97:0/2895816529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc078143ae0 0x7fc0780cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 -- 172.21.15.97:0/2895816529 >> 172.21.15.97:0/2895816529 conn(0x7fc07806a800 msgr2=0x7fc07806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 -- 172.21.15.97:0/2895816529 shutdown_connections 2023-11-24T08:07:42.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.351+0000 7fc07e82d640 1 -- 172.21.15.97:0/2895816529 wait complete. 2023-11-24T08:07:42.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.353+0000 7fc07e82d640 1 Processor -- start 2023-11-24T08:07:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.353+0000 7fc07e82d640 1 -- start start 2023-11-24T08:07:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07e82d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0780cf7d0 0x7fc07813da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07e82d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc078143ae0 0x7fc07813bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07e82d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc07815e1e0 0x7fc078159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07e82d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07813fcc0 con 0x7fc07815e1e0 2023-11-24T08:07:42.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07e82d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07813e390 con 0x7fc078143ae0 2023-11-24T08:07:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07e82d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07813e670 con 0x7fc0780cf7d0 2023-11-24T08:07:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc07815e1e0 0x7fc078159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc07815e1e0 0x7fc078159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40110/0 (socket says 172.21.15.97:40110) 2023-11-24T08:07:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 -- 172.21.15.97:0/693771712 learned_addr learned my addr 172.21.15.97:0/693771712 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc06ffff640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc078143ae0 0x7fc07813bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc077fff640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0780cf7d0 0x7fc07813da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 -- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0780cf7d0 msgr2=0x7fc07813da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0780cf7d0 0x7fc07813da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 -- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc078143ae0 msgr2=0x7fc07813bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc078143ae0 0x7fc07813bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc07cdca640 1 -- 172.21.15.97:0/693771712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600094d0 con 0x7fc07815e1e0 2023-11-24T08:07:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.354+0000 7fc06ffff640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc078143ae0 0x7fc07813bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:42.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.355+0000 7fc07cdca640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc07815e1e0 0x7fc078159540 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc07000cd50 tx=0x7fc07000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.355+0000 7fc0757fa640 1 -- 172.21.15.97:0/693771712 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000f680 con 0x7fc07815e1e0 2023-11-24T08:07:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.355+0000 7fc0757fa640 1 -- 172.21.15.97:0/693771712 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000f800 con 0x7fc07815e1e0 2023-11-24T08:07:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.355+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07813e950 con 0x7fc07815e1e0 2023-11-24T08:07:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.355+0000 7fc0757fa640 1 -- 172.21.15.97:0/693771712 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000fbb0 con 0x7fc07815e1e0 2023-11-24T08:07:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.355+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc078165110 con 0x7fc07815e1e0 2023-11-24T08:07:42.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.356+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc078165300 con 0x7fc07815e1e0 2023-11-24T08:07:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.357+0000 7fc0757fa640 1 -- 172.21.15.97:0/693771712 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc07000b040 con 0x7fc07815e1e0 2023-11-24T08:07:42.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.358+0000 7fc0757fa640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc05806ae40 0x7fc05806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.358+0000 7fc0757fa640 1 -- 172.21.15.97:0/693771712 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc07008a0a0 con 0x7fc07815e1e0 2023-11-24T08:07:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.358+0000 7fc077fff640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc05806ae40 0x7fc05806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.359+0000 7fc077fff640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc05806ae40 0x7fc05806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc068006fd0 tx=0x7fc068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.363+0000 7fc0757fa640 1 -- 172.21.15.97:0/693771712 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0700550c0 con 0x7fc07815e1e0 2023-11-24T08:07:42.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.551+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0780675d0 con 0x7fc07815e1e0 2023-11-24T08:07:42.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.552+0000 7fc0757fa640 1 -- 172.21.15.97:0/693771712 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0700586e0 con 0x7fc07815e1e0 2023-11-24T08:07:42.555 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc05806ae40 msgr2=0x7fc05806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc05806ae40 0x7fc05806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc068006fd0 tx=0x7fc068008040 comp rx=0 tx=0).stop 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc07815e1e0 msgr2=0x7fc078159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc07815e1e0 0x7fc078159540 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc07000cd50 tx=0x7fc07000a650 comp rx=0 tx=0).stop 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 shutdown_connections 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc05806ae40 0x7fc05806d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc07815e1e0 0x7fc078159540 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc078143ae0 0x7fc07813bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 --2- 172.21.15.97:0/693771712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0780cf7d0 0x7fc07813da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 >> 172.21.15.97:0/693771712 conn(0x7fc07806a800 msgr2=0x7fc07815b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 shutdown_connections 2023-11-24T08:07:42.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.555+0000 7fc07e82d640 1 -- 172.21.15.97:0/693771712 wait complete. 2023-11-24T08:07:42.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:42.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.788+0000 7f2df8c27640 1 Processor -- start 2023-11-24T08:07:42.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.788+0000 7f2df8c27640 1 -- start start 2023-11-24T08:07:42.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df8c27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 0x7f2df40d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df8c27640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2df40b41e0 0x7f2df40cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df8c27640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40d0320 con 0x7f2df40cf9a0 2023-11-24T08:07:42.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df8c27640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40b2730 con 0x7f2df40b41e0 2023-11-24T08:07:42.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df8c27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40d1ec0 con 0x7f2df415d4b0 2023-11-24T08:07:42.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2df40cf9a0 0x7f2df40cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55460/0 (socket says 172.21.15.97:55460) 2023-11-24T08:07:42.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df2ffd640 1 -- 172.21.15.97:0/926457721 learned_addr learned my addr 172.21.15.97:0/926457721 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df37fe640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 0x7f2df40d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.790+0000 7f2df3fff640 1 --2- 172.21.15.97:0/926457721 >> v2:172.21.15.183:3300/0 conn(0x7f2df40b41e0 0x7f2df40cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945321766 0 0) 0x7f2df40d0320 con 0x7f2df40cf9a0 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ddc003520 con 0x7f2df40cf9a0 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096930218 0 0) 0x7f2ddc003520 con 0x7f2df40cf9a0 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 msgr2=0x7f2df40d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 0x7f2df40d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 >> v2:172.21.15.183:3300/0 conn(0x7f2df40b41e0 msgr2=0x7f2df40cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 --2- 172.21.15.97:0/926457721 >> v2:172.21.15.183:3300/0 conn(0x7f2df40b41e0 0x7f2df40cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40b29d0 con 0x7f2df40cf9a0 2023-11-24T08:07:42.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f2de8001670 con 0x7f2df40cf9a0 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 >> v1:172.21.15.97:6789/0 conn(0x7f2df40cf9a0 legacy=0x7f2df40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ddc003970 0x7f2ddc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ddc0047c0 0x7f2ddc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 0x7f2ddc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40b2730 con 0x7f2ddc0047c0 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40d1ec0 con 0x7f2ddc003970 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc00b980 con 0x7f2df415d4b0 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.791+0000 7f2df2ffd640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ddc0047c0 0x7f2ddc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.792+0000 7f2df37fe640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ddc003970 0x7f2ddc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.792+0000 7f2df3fff640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 0x7f2ddc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.792+0000 7f2df2ffd640 1 -- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 msgr2=0x7f2ddc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.792+0000 7f2df2ffd640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2df415d4b0 0x7f2ddc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.792+0000 7f2df2ffd640 1 -- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ddc003970 msgr2=0x7f2ddc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.792+0000 7f2df2ffd640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ddc003970 0x7f2ddc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.792+0000 7f2df2ffd640 1 -- 172.21.15.97:0/926457721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc003520 con 0x7f2ddc0047c0 2023-11-24T08:07:42.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.793+0000 7f2df2ffd640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ddc0047c0 0x7f2ddc004c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c0e0 tx=0x7f2ddc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcfe73bc16f5b3c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.793+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8005ad0 con 0x7f2ddc0047c0 2023-11-24T08:07:42.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.793+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8005c50 con 0x7f2ddc0047c0 2023-11-24T08:07:42.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.793+0000 7f2df27fc640 1 -- 172.21.15.97:0/926457721 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de802c810 con 0x7f2ddc0047c0 2023-11-24T08:07:42.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.794+0000 7f2df8c27640 1 -- 172.21.15.97:0/926457721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ddc0047c0 msgr2=0x7f2ddc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.794+0000 7f2df8c27640 1 --2- 172.21.15.97:0/926457721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ddc0047c0 0x7f2ddc004c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c0e0 tx=0x7f2ddc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.794+0000 7f2df3fff640 1 -- 172.21.15.97:0/926457721 reap_dead start 2023-11-24T08:07:42.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.794+0000 7f2df8c27640 1 -- 172.21.15.97:0/926457721 shutdown_connections 2023-11-24T08:07:42.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.794+0000 7f2df8c27640 1 -- 172.21.15.97:0/926457721 >> 172.21.15.97:0/926457721 conn(0x7f2df40d3000 msgr2=0x7f2df40d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.794+0000 7f2df8c27640 1 -- 172.21.15.97:0/926457721 shutdown_connections 2023-11-24T08:07:42.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.794+0000 7f2df8c27640 1 -- 172.21.15.97:0/926457721 wait complete. 2023-11-24T08:07:42.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.796+0000 7f2df8c27640 1 Processor -- start 2023-11-24T08:07:42.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.796+0000 7f2df8c27640 1 -- start start 2023-11-24T08:07:42.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df8c27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ddc0047c0 0x7f2df40b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df8c27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df40b79d0 0x7f2df41f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df8c27640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df41f2340 0x7f2df414e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df8c27640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df414c220 con 0x7f2df41f2340 2023-11-24T08:07:42.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df8c27640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40b7e50 con 0x7f2df40b79d0 2023-11-24T08:07:42.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df8c27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41525c0 con 0x7f2ddc0047c0 2023-11-24T08:07:42.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df41f2340 0x7f2df414e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df41f2340 0x7f2df414e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40122/0 (socket says 172.21.15.97:40122) 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df3fff640 1 -- 172.21.15.97:0/2716718348 learned_addr learned my addr 172.21.15.97:0/2716718348 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df37fe640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ddc0047c0 0x7f2df40b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df2ffd640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df40b79d0 0x7f2df41f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df3fff640 1 -- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ddc0047c0 msgr2=0x7f2df40b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df3fff640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ddc0047c0 0x7f2df40b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df3fff640 1 -- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df40b79d0 msgr2=0x7f2df41f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.797+0000 7f2df3fff640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df40b79d0 0x7f2df41f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2df3fff640 1 -- 172.21.15.97:0/2716718348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df415da10 con 0x7f2df41f2340 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2df2ffd640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df40b79d0 0x7f2df41f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:42.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2df3fff640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df41f2340 0x7f2df414e2b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2df4161000 tx=0x7f2dec00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2ddbfff640 1 -- 172.21.15.97:0/2716718348 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec017400 con 0x7f2df41f2340 2023-11-24T08:07:42.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2ddbfff640 1 -- 172.21.15.97:0/2716718348 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec011040 con 0x7f2df41f2340 2023-11-24T08:07:42.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2ddbfff640 1 -- 172.21.15.97:0/2716718348 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0177e0 con 0x7f2df41f2340 2023-11-24T08:07:42.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df40cc6a0 con 0x7f2df41f2340 2023-11-24T08:07:42.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.798+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df414c470 con 0x7f2df41f2340 2023-11-24T08:07:42.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.799+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4067450 con 0x7f2df41f2340 2023-11-24T08:07:42.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.800+0000 7f2ddbfff640 1 -- 172.21.15.97:0/2716718348 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dec017940 con 0x7f2df41f2340 2023-11-24T08:07:42.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.801+0000 7f2ddbfff640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2de006ae40 0x7f2de006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.801+0000 7f2ddbfff640 1 -- 172.21.15.97:0/2716718348 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2dec089c80 con 0x7f2df41f2340 2023-11-24T08:07:42.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.801+0000 7f2df37fe640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2de006ae40 0x7f2de006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.802+0000 7f2df37fe640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2de006ae40 0x7f2de006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009930 tx=0x7f2de4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.806+0000 7f2ddbfff640 1 -- 172.21.15.97:0/2716718348 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2dec054c10 con 0x7f2df41f2340 2023-11-24T08:07:42.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.995+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2df40afc70 con 0x7f2df41f2340 2023-11-24T08:07:42.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.997+0000 7f2ddbfff640 1 -- 172.21.15.97:0/2716718348 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2dec01c0a0 con 0x7f2df41f2340 2023-11-24T08:07:42.999 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.999+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2de006ae40 msgr2=0x7f2de006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.999+0000 7f2df8c27640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2de006ae40 0x7f2de006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009930 tx=0x7f2de4008040 comp rx=0 tx=0).stop 2023-11-24T08:07:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.999+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df41f2340 msgr2=0x7f2df414e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:42.999+0000 7f2df8c27640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df41f2340 0x7f2df414e2b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2df4161000 tx=0x7f2dec00f4a0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 shutdown_connections 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2de006ae40 0x7f2de006d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2df41f2340 0x7f2df414e2b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df40b79d0 0x7f2df41f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 --2- 172.21.15.97:0/2716718348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ddc0047c0 0x7f2df40b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 >> 172.21.15.97:0/2716718348 conn(0x7f2df40d3000 msgr2=0x7f2df415fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 shutdown_connections 2023-11-24T08:07:43.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.000+0000 7f2df8c27640 1 -- 172.21.15.97:0/2716718348 wait complete. 2023-11-24T08:07:43.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:43.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.216+0000 7fdc15e7c640 1 Processor -- start 2023-11-24T08:07:43.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.216+0000 7fdc15e7c640 1 -- start start 2023-11-24T08:07:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.217+0000 7fdc15e7c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc10143ae0 0x7fdc100cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.217+0000 7fdc15e7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc1015e3b0 0x7fdc100702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.217+0000 7fdc15e7c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100cfc30 con 0x7fdc100cf7d0 2023-11-24T08:07:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.217+0000 7fdc15e7c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc100b1ee0 con 0x7fdc10143ae0 2023-11-24T08:07:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.217+0000 7fdc15e7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100b2780 con 0x7fdc1015e3b0 2023-11-24T08:07:43.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.218+0000 7fdc0f7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc10143ae0 0x7fdc100cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.218+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc1015e3b0 0x7fdc100702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.218+0000 7fdc0f7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc10143ae0 0x7fdc100cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:38158/0 (socket says 172.21.15.97:38158) 2023-11-24T08:07:43.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.218+0000 7fdc0f7fe640 1 -- 172.21.15.97:0/306621688 learned_addr learned my addr 172.21.15.97:0/306621688 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:43.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.219+0000 7fdc0ffff640 1 -- 172.21.15.97:0/306621688 >> v2:172.21.15.183:3300/0 conn(0x7fdc10143ae0 msgr2=0x7fdc100cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.219+0000 7fdc0ffff640 1 --2- 172.21.15.97:0/306621688 >> v2:172.21.15.183:3300/0 conn(0x7fdc10143ae0 0x7fdc100cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.219+0000 7fdc0ffff640 1 -- 172.21.15.97:0/306621688 >> v1:172.21.15.183:6789/0 conn(0x7fdc100cf7d0 legacy=0x7fdc1015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.219+0000 7fdc0ffff640 1 -- 172.21.15.97:0/306621688 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1015e990 con 0x7fdc1015e3b0 2023-11-24T08:07:43.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.219+0000 7fdc0f7fe640 1 --2- 172.21.15.97:0/306621688 >> v2:172.21.15.183:3300/0 conn(0x7fdc10143ae0 0x7fdc100cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:43.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.220+0000 7fdc0ffff640 1 --2- 172.21.15.97:0/306621688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc1015e3b0 0x7fdc100702c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d90 tx=0x7fdc0802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ba76d9fcba4f2b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.221+0000 7fdc0effd640 1 -- 172.21.15.97:0/306621688 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0802cc50 con 0x7fdc1015e3b0 2023-11-24T08:07:43.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.221+0000 7fdc0effd640 1 -- 172.21.15.97:0/306621688 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0802cdb0 con 0x7fdc1015e3b0 2023-11-24T08:07:43.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.221+0000 7fdc0effd640 1 -- 172.21.15.97:0/306621688 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08034660 con 0x7fdc1015e3b0 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 -- 172.21.15.97:0/306621688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc1015e3b0 msgr2=0x7fdc100702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/306621688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc1015e3b0 0x7fdc100702c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d90 tx=0x7fdc0802bea0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 -- 172.21.15.97:0/306621688 shutdown_connections 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/306621688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc1015e3b0 0x7fdc100702c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/306621688 >> v2:172.21.15.183:3300/0 conn(0x7fdc10143ae0 0x7fdc100cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 -- 172.21.15.97:0/306621688 >> 172.21.15.97:0/306621688 conn(0x7fdc1006a800 msgr2=0x7fdc1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 -- 172.21.15.97:0/306621688 shutdown_connections 2023-11-24T08:07:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.222+0000 7fdc15e7c640 1 -- 172.21.15.97:0/306621688 wait complete. 2023-11-24T08:07:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.224+0000 7fdc15e7c640 1 Processor -- start 2023-11-24T08:07:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.224+0000 7fdc15e7c640 1 -- start start 2023-11-24T08:07:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc15e7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc100cf7d0 0x7fdc10140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc15e7c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc10143ae0 0x7fdc10159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc15e7c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc1015e3b0 0x7fdc101599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc15e7c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100ae210 con 0x7fdc10143ae0 2023-11-24T08:07:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc15e7c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10159ee0 con 0x7fdc1015e3b0 2023-11-24T08:07:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc15e7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100ad590 con 0x7fdc100cf7d0 2023-11-24T08:07:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc10143ae0 0x7fdc10159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc10143ae0 0x7fdc10159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40134/0 (socket says 172.21.15.97:40134) 2023-11-24T08:07:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc07fff640 1 -- 172.21.15.97:0/3907546267 learned_addr learned my addr 172.21.15.97:0/3907546267 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:43.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc0ffff640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc1015e3b0 0x7fdc101599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.225+0000 7fdc0f7fe640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc100cf7d0 0x7fdc10140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc07fff640 1 -- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc100cf7d0 msgr2=0x7fdc10140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc07fff640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc100cf7d0 0x7fdc10140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc07fff640 1 -- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc1015e3b0 msgr2=0x7fdc101599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc07fff640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc1015e3b0 0x7fdc101599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc07fff640 1 -- 172.21.15.97:0/3907546267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000094d0 con 0x7fdc10143ae0 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc07fff640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc10143ae0 0x7fdc10159460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c450 tx=0x7fdbf800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc0cff9640 1 -- 172.21.15.97:0/3907546267 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80052d0 con 0x7fdc10143ae0 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc0cff9640 1 -- 172.21.15.97:0/3907546267 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf8005430 con 0x7fdc10143ae0 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc0cff9640 1 -- 172.21.15.97:0/3907546267 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8012870 con 0x7fdc10143ae0 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc08009a70 con 0x7fdc10143ae0 2023-11-24T08:07:43.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.226+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc100adb50 con 0x7fdc10143ae0 2023-11-24T08:07:43.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.227+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc100ae350 con 0x7fdc10143ae0 2023-11-24T08:07:43.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.228+0000 7fdc0cff9640 1 -- 172.21.15.97:0/3907546267 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbf80129d0 con 0x7fdc10143ae0 2023-11-24T08:07:43.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.229+0000 7fdc0cff9640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdbf006ae40 0x7fdbf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.229+0000 7fdc0cff9640 1 -- 172.21.15.97:0/3907546267 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdbf8089270 con 0x7fdc10143ae0 2023-11-24T08:07:43.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.229+0000 7fdc0f7fe640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdbf006ae40 0x7fdbf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.230+0000 7fdc0f7fe640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdbf006ae40 0x7fdbf006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009cf0 tx=0x7fdc00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.236+0000 7fdc0cff9640 1 -- 172.21.15.97:0/3907546267 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc100ae350 con 0x7fdc10143ae0 2023-11-24T08:07:43.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.440+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdc100ae350 con 0x7fdc10143ae0 2023-11-24T08:07:43.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.441+0000 7fdc0cff9640 1 -- 172.21.15.97:0/3907546267 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdc100ae350 con 0x7fdc10143ae0 2023-11-24T08:07:43.444 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdbf006ae40 msgr2=0x7fdbf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdbf006ae40 0x7fdbf006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009cf0 tx=0x7fdc00008040 comp rx=0 tx=0).stop 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc10143ae0 msgr2=0x7fdc10159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc10143ae0 0x7fdc10159460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c450 tx=0x7fdbf800c910 comp rx=0 tx=0).stop 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 shutdown_connections 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdbf006ae40 0x7fdbf006d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc1015e3b0 0x7fdc101599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc10143ae0 0x7fdc10159460 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 --2- 172.21.15.97:0/3907546267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc100cf7d0 0x7fdc10140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 >> 172.21.15.97:0/3907546267 conn(0x7fdc1006a800 msgr2=0x7fdc1015c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 shutdown_connections 2023-11-24T08:07:43.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.444+0000 7fdc15e7c640 1 -- 172.21.15.97:0/3907546267 wait complete. 2023-11-24T08:07:43.466 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:07:43.466 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:43.525 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:43.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.744+0000 7f866a71d640 1 Processor -- start 2023-11-24T08:07:43.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.744+0000 7f866a71d640 1 -- start start 2023-11-24T08:07:43.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f866a71d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f866413e360 0x7f86640cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f866a71d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866415c5f0 con 0x7f866413df80 2023-11-24T08:07:43.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f866a71d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866406c470 con 0x7f866415f9c0 2023-11-24T08:07:43.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f866a71d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866406c750 con 0x7f866413e360 2023-11-24T08:07:43.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f8663fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f866413df80 0x7f866415bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55466/0 (socket says 172.21.15.97:55466) 2023-11-24T08:07:43.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f8663fff640 1 -- 172.21.15.97:0/1586618963 learned_addr learned my addr 172.21.15.97:0/1586618963 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:43.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f86637fe640 1 --2- 172.21.15.97:0/1586618963 >> v2:172.21.15.183:3300/0 conn(0x7f866413e360 0x7f86640cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132590568 0 0) 0x7f866415c5f0 con 0x7f866413df80 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.746+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f864c003520 con 0x7f866413df80 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2347812003 0 0) 0x7f864c003520 con 0x7f866413df80 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 >> v2:172.21.15.183:3300/0 conn(0x7f866413e360 msgr2=0x7f86640cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 --2- 172.21.15.97:0/1586618963 >> v2:172.21.15.183:3300/0 conn(0x7f866413e360 0x7f86640cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 >> v1:172.21.15.183:6789/0 conn(0x7f866415f9c0 legacy=0x7f86640cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866406ca30 con 0x7f866413df80 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f8654001690 con 0x7f866413df80 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 >> v1:172.21.15.97:6789/0 conn(0x7f866413df80 legacy=0x7f866415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f864c003970 0x7f864c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f864c0047c0 0x7f864c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866406c750 con 0x7f864c0047c0 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00c000 con 0x7f864c005180 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00c1c0 con 0x7f864c003970 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.747+0000 7f86637fe640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f864c0047c0 0x7f864c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f86637fe640 1 -- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f864c003970 msgr2=0x7f864c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f8668cba640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f8663fff640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f864c003970 0x7f864c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f86637fe640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f864c003970 0x7f864c003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f86637fe640 1 -- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c005180 msgr2=0x7f864c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f86637fe640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f86637fe640 1 -- 172.21.15.97:0/1586618963 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c003520 con 0x7f864c0047c0 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f8668cba640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c005180 0x7f864c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:43.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.748+0000 7f8668cba640 1 -- 172.21.15.97:0/1586618963 reap_dead start 2023-11-24T08:07:43.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.749+0000 7f86637fe640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f864c0047c0 0x7f864c004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8658009a90 tx=0x7f864c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b45d00e5ba75662 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.749+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865802c680 con 0x7f864c0047c0 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.749+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865802c7e0 con 0x7f864c0047c0 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.749+0000 7f8662ffd640 1 -- 172.21.15.97:0/1586618963 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865802cb90 con 0x7f864c0047c0 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.750+0000 7f866a71d640 1 -- 172.21.15.97:0/1586618963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f864c0047c0 msgr2=0x7f864c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.750+0000 7f866a71d640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f864c0047c0 0x7f864c004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8658009a90 tx=0x7f864c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.750+0000 7f866a71d640 1 -- 172.21.15.97:0/1586618963 shutdown_connections 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.750+0000 7f866a71d640 1 --2- 172.21.15.97:0/1586618963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f864c0047c0 0x7f864c004c40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.750+0000 7f866a71d640 1 -- 172.21.15.97:0/1586618963 >> 172.21.15.97:0/1586618963 conn(0x7f866406a800 msgr2=0x7f866406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.750+0000 7f866a71d640 1 -- 172.21.15.97:0/1586618963 shutdown_connections 2023-11-24T08:07:43.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.750+0000 7f866a71d640 1 -- 172.21.15.97:0/1586618963 wait complete. 2023-11-24T08:07:43.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.752+0000 7f866a71d640 1 Processor -- start 2023-11-24T08:07:43.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.752+0000 7f866a71d640 1 -- start start 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f866a71d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c0047c0 0x7f8664150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f866a71d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866413d740 0x7f8664152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f866a71d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8664153280 0x7f86640b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f866a71d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664152920 con 0x7f8664153280 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f866a71d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664151ca0 con 0x7f864c0047c0 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f866a71d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8664151f80 con 0x7f866413d740 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8664153280 0x7f86640b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8664153280 0x7f86640b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40138/0 (socket says 172.21.15.97:40138) 2023-11-24T08:07:43.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 -- 172.21.15.97:0/2014160570 learned_addr learned my addr 172.21.15.97:0/2014160570 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:43.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8663fff640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c0047c0 0x7f8664150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f86637fe640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866413d740 0x7f8664152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 -- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866413d740 msgr2=0x7f8664152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866413d740 0x7f8664152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 -- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c0047c0 msgr2=0x7f8664150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c0047c0 0x7f8664150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8668cba640 1 -- 172.21.15.97:0/2014160570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664152260 con 0x7f8664153280 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.753+0000 7f8663fff640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c0047c0 0x7f8664150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.754+0000 7f8668cba640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8664153280 0x7f86640b2cf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86640cfea0 tx=0x7f865c00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.754+0000 7f8660ff9640 1 -- 172.21.15.97:0/2014160570 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c018070 con 0x7f8664153280 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.754+0000 7f8660ff9640 1 -- 172.21.15.97:0/2014160570 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c006b50 con 0x7f8664153280 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.754+0000 7f8660ff9640 1 -- 172.21.15.97:0/2014160570 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c012600 con 0x7f8664153280 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.754+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8664152540 con 0x7f8664153280 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.754+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866413d1f0 con 0x7f8664153280 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.755+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8664152a60 con 0x7f8664153280 2023-11-24T08:07:43.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.756+0000 7f8660ff9640 1 -- 172.21.15.97:0/2014160570 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f865c012760 con 0x7f8664153280 2023-11-24T08:07:43.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.757+0000 7f8660ff9640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f865006ae40 0x7f865006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.757+0000 7f8660ff9640 1 -- 172.21.15.97:0/2014160570 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f865c088dd0 con 0x7f8664153280 2023-11-24T08:07:43.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.757+0000 7f8663fff640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f865006ae40 0x7f865006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.758+0000 7f8663fff640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f865006ae40 0x7f865006d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8654000f60 tx=0x7f8654009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.761+0000 7f8660ff9640 1 -- 172.21.15.97:0/2014160570 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8664152a60 con 0x7f8664153280 2023-11-24T08:07:43.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.951+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8664152a60 con 0x7f8664153280 2023-11-24T08:07:43.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.953+0000 7f8660ff9640 1 -- 172.21.15.97:0/2014160570 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f8664152a60 con 0x7f8664153280 2023-11-24T08:07:43.956 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:43.957 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:43.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f865006ae40 msgr2=0x7f865006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f865006ae40 0x7f865006d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8654000f60 tx=0x7f8654009040 comp rx=0 tx=0).stop 2023-11-24T08:07:43.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8664153280 msgr2=0x7f86640b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8664153280 0x7f86640b2cf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86640cfea0 tx=0x7f865c00d960 comp rx=0 tx=0).stop 2023-11-24T08:07:43.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 shutdown_connections 2023-11-24T08:07:43.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f865006ae40 0x7f865006d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8664153280 0x7f86640b2cf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866413d740 0x7f8664152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 --2- 172.21.15.97:0/2014160570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f864c0047c0 0x7f8664150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 >> 172.21.15.97:0/2014160570 conn(0x7f866406a800 msgr2=0x7f866406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 shutdown_connections 2023-11-24T08:07:43.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:43.957+0000 7f866a71d640 1 -- 172.21.15.97:0/2014160570 wait complete. 2023-11-24T08:07:43.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:43.978 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:44.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.182+0000 7f21d359e640 1 Processor -- start 2023-11-24T08:07:44.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.182+0000 7f21d359e640 1 -- start start 2023-11-24T08:07:44.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.183+0000 7f21d359e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f21d413cf10 0x7f21d413f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.183+0000 7f21d359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 0x7f21d40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.183+0000 7f21d359e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d40ce440 con 0x7f21d40cdc20 2023-11-24T08:07:44.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.183+0000 7f21d359e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d413ff60 con 0x7f21d413cf10 2023-11-24T08:07:44.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.183+0000 7f21d359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40ce720 con 0x7f21d413fae0 2023-11-24T08:07:44.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.183+0000 7f21d2d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f21d40cdc20 0x7f21d415d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55480/0 (socket says 172.21.15.97:55480) 2023-11-24T08:07:44.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.183+0000 7f21d2d9d640 1 -- 172.21.15.97:0/1658219212 learned_addr learned my addr 172.21.15.97:0/1658219212 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:44.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 0x7f21d40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d259c640 1 --2- 172.21.15.97:0/1658219212 >> v2:172.21.15.183:3300/0 conn(0x7f21d413cf10 0x7f21d413f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278247140 0 0) 0x7f21d40ce440 con 0x7f21d40cdc20 2023-11-24T08:07:44.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c0003520 con 0x7f21d40cdc20 2023-11-24T08:07:44.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518947451 0 0) 0x7f21c0003520 con 0x7f21d40cdc20 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 msgr2=0x7f21d40cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 0x7f21d40cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 >> v2:172.21.15.183:3300/0 conn(0x7f21d413cf10 msgr2=0x7f21d413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 --2- 172.21.15.97:0/1658219212 >> v2:172.21.15.183:3300/0 conn(0x7f21d413cf10 0x7f21d413f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d40cea00 con 0x7f21d40cdc20 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f21cc0019f0 con 0x7f21d40cdc20 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 >> v1:172.21.15.97:6789/0 conn(0x7f21d40cdc20 legacy=0x7f21d415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 0x7f21c0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c0003ef0 0x7f21c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.184+0000 7f21d1d9b640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c0004d00 0x7f21c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413ff60 con 0x7f21c0003ef0 2023-11-24T08:07:44.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40ce720 con 0x7f21c0004d00 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c000db90 con 0x7f21d413fae0 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c0003ef0 0x7f21c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21d259c640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 0x7f21c0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21cbfff640 1 -- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 msgr2=0x7f21c0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21d413fae0 0x7f21c0003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21cbfff640 1 -- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c0004d00 msgr2=0x7f21c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21d2d9d640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c0004d00 0x7f21c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c0004d00 0x7f21c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21cbfff640 1 -- 172.21.15.97:0/1658219212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0003520 con 0x7f21c0003ef0 2023-11-24T08:07:44.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.185+0000 7f21d2d9d640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c0004d00 0x7f21c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:44.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.186+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c0003ef0 0x7f21c00047c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009ac0 tx=0x7f21c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5e2b43415d746f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc02c6b0 con 0x7f21c0003ef0 2023-11-24T08:07:44.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc02c810 con 0x7f21c0003ef0 2023-11-24T08:07:44.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d1d9b640 1 -- 172.21.15.97:0/1658219212 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc02cba0 con 0x7f21c0003ef0 2023-11-24T08:07:44.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d359e640 1 -- 172.21.15.97:0/1658219212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c0003ef0 msgr2=0x7f21c00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d359e640 1 --2- 172.21.15.97:0/1658219212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21c0003ef0 0x7f21c00047c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009ac0 tx=0x7f21c00057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d2d9d640 1 -- 172.21.15.97:0/1658219212 reap_dead start 2023-11-24T08:07:44.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d359e640 1 -- 172.21.15.97:0/1658219212 shutdown_connections 2023-11-24T08:07:44.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d359e640 1 -- 172.21.15.97:0/1658219212 >> 172.21.15.97:0/1658219212 conn(0x7f21d406a7d0 msgr2=0x7f21d406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d359e640 1 -- 172.21.15.97:0/1658219212 shutdown_connections 2023-11-24T08:07:44.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.187+0000 7f21d359e640 1 -- 172.21.15.97:0/1658219212 wait complete. 2023-11-24T08:07:44.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.189+0000 7f21d359e640 1 Processor -- start 2023-11-24T08:07:44.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.189+0000 7f21d359e640 1 -- start start 2023-11-24T08:07:44.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.190+0000 7f21d359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c0003ef0 0x7f21d41314d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.190+0000 7f21d359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d413ee10 0x7f21d413d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.190+0000 7f21d359e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21d413d830 0x7f21d415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.190+0000 7f21d359e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413e980 con 0x7f21d413ee10 2023-11-24T08:07:44.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.190+0000 7f21d359e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413dd70 con 0x7f21d413d830 2023-11-24T08:07:44.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.190+0000 7f21d359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413e050 con 0x7f21c0003ef0 2023-11-24T08:07:44.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.190+0000 7f21cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d413ee10 0x7f21d413d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d413ee10 0x7f21d413d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40160/0 (socket says 172.21.15.97:40160) 2023-11-24T08:07:44.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 -- 172.21.15.97:0/1308924800 learned_addr learned my addr 172.21.15.97:0/1308924800 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21d259c640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c0003ef0 0x7f21d41314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 -- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c0003ef0 msgr2=0x7f21d41314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21d2d9d640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21d413d830 0x7f21d415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c0003ef0 0x7f21d41314d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 -- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21d413d830 msgr2=0x7f21d415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21d413d830 0x7f21d415c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 -- 172.21.15.97:0/1308924800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d413e330 con 0x7f21d413ee10 2023-11-24T08:07:44.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.191+0000 7f21cbfff640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d413ee10 0x7f21d413d2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f21bc02c2b0 tx=0x7f21bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.192+0000 7f21caffd640 1 -- 172.21.15.97:0/1308924800 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc003810 con 0x7f21d413ee10 2023-11-24T08:07:44.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.192+0000 7f21caffd640 1 -- 172.21.15.97:0/1308924800 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc003970 con 0x7f21d413ee10 2023-11-24T08:07:44.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.192+0000 7f21caffd640 1 -- 172.21.15.97:0/1308924800 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc003ce0 con 0x7f21d413ee10 2023-11-24T08:07:44.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.192+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d413e610 con 0x7f21d413ee10 2023-11-24T08:07:44.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.192+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d415caf0 con 0x7f21d413ee10 2023-11-24T08:07:44.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.193+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d4067450 con 0x7f21d413ee10 2023-11-24T08:07:44.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.194+0000 7f21caffd640 1 -- 172.21.15.97:0/1308924800 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21bc034440 con 0x7f21d413ee10 2023-11-24T08:07:44.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.195+0000 7f21caffd640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f21b406ae70 0x7f21b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.195+0000 7f21caffd640 1 -- 172.21.15.97:0/1308924800 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f21bc0ab8b0 con 0x7f21d413ee10 2023-11-24T08:07:44.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.195+0000 7f21d259c640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f21b406ae70 0x7f21b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.196+0000 7f21d259c640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f21b406ae70 0x7f21b406d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009990 tx=0x7f21c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.199+0000 7f21caffd640 1 -- 172.21.15.97:0/1308924800 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21bc0768f0 con 0x7f21d413ee10 2023-11-24T08:07:44.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.387+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21d40cbf10 con 0x7f21d413ee10 2023-11-24T08:07:44.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.387+0000 7f21caffd640 1 -- 172.21.15.97:0/1308924800 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21bc04c0a0 con 0x7f21d413ee10 2023-11-24T08:07:44.390 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:44.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f21b406ae70 msgr2=0x7f21b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f21b406ae70 0x7f21b406d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009990 tx=0x7f21c4008040 comp rx=0 tx=0).stop 2023-11-24T08:07:44.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d413ee10 msgr2=0x7f21d413d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d413ee10 0x7f21d413d2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f21bc02c2b0 tx=0x7f21bc004730 comp rx=0 tx=0).stop 2023-11-24T08:07:44.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 shutdown_connections 2023-11-24T08:07:44.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f21b406ae70 0x7f21b406d330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21d413d830 0x7f21d415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21d413ee10 0x7f21d413d2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 --2- 172.21.15.97:0/1308924800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c0003ef0 0x7f21d41314d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 >> 172.21.15.97:0/1308924800 conn(0x7f21d406a7d0 msgr2=0x7f21d4152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 shutdown_connections 2023-11-24T08:07:44.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.391+0000 7f21d359e640 1 -- 172.21.15.97:0/1308924800 wait complete. 2023-11-24T08:07:44.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:44.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.610+0000 7f30f24c9640 1 Processor -- start 2023-11-24T08:07:44.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.610+0000 7f30f24c9640 1 -- start start 2023-11-24T08:07:44.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.611+0000 7f30f24c9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f30ec15e3b0 0x7f30ec164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.611+0000 7f30f24c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec0b1ee0 con 0x7f30ec0cf9a0 2023-11-24T08:07:44.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.611+0000 7f30f24c9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec0b2780 con 0x7f30ec143ae0 2023-11-24T08:07:44.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.612+0000 7f30f24c9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec15e990 con 0x7f30ec15e3b0 2023-11-24T08:07:44.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.612+0000 7f30eb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f30ec0cf9a0 0x7f30ec15dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55482/0 (socket says 172.21.15.97:55482) 2023-11-24T08:07:44.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.612+0000 7f30eb7fe640 1 -- 172.21.15.97:0/512852441 learned_addr learned my addr 172.21.15.97:0/512852441 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:44.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.612+0000 7f30f0a66640 1 --2- 172.21.15.97:0/512852441 >> v2:172.21.15.183:3300/0 conn(0x7f30ec15e3b0 0x7f30ec164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.612+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571769787 0 0) 0x7f30ec0b1ee0 con 0x7f30ec0cf9a0 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.612+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d8005730 con 0x7f30ec0cf9a0 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429215954 0 0) 0x7f30d8005730 con 0x7f30ec0cf9a0 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 >> v2:172.21.15.183:3300/0 conn(0x7f30ec15e3b0 msgr2=0x7f30ec164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 --2- 172.21.15.97:0/512852441 >> v2:172.21.15.183:3300/0 conn(0x7f30ec15e3b0 0x7f30ec164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 >> v1:172.21.15.183:6789/0 conn(0x7f30ec143ae0 legacy=0x7f30ec0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0b2130 con 0x7f30ec0cf9a0 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f30d40019f0 con 0x7f30ec0cf9a0 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 >> v1:172.21.15.97:6789/0 conn(0x7f30ec0cf9a0 legacy=0x7f30ec15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30d8005b80 0x7f30d8005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d80069d0 0x7f30d8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30d8007390 0x7f30d800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec15e990 con 0x7f30d8007390 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d800e230 con 0x7f30d8005b80 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d800e3f0 con 0x7f30d80069d0 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.613+0000 7f30f0a66640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30d8007390 0x7f30d800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.614+0000 7f30ebfff640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30d8005b80 0x7f30d8005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.614+0000 7f30eb7fe640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d80069d0 0x7f30d8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.614+0000 7f30f0a66640 1 -- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d80069d0 msgr2=0x7f30d8006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.614+0000 7f30f0a66640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d80069d0 0x7f30d8006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.614+0000 7f30f0a66640 1 -- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30d8005b80 msgr2=0x7f30d8005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.614+0000 7f30f0a66640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30d8005b80 0x7f30d8005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.614+0000 7f30f0a66640 1 -- 172.21.15.97:0/512852441 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8005730 con 0x7f30d8007390 2023-11-24T08:07:44.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.615+0000 7f30f0a66640 1 -- 172.21.15.97:0/512852441 reap_dead start 2023-11-24T08:07:44.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.615+0000 7f30f0a66640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30d8007390 0x7f30d800db90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ac0 tx=0x7f30d8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c862adaa6b83c48 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.615+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4004020 con 0x7f30d8007390 2023-11-24T08:07:44.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.615+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4004180 con 0x7f30d8007390 2023-11-24T08:07:44.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.615+0000 7f30eaffd640 1 -- 172.21.15.97:0/512852441 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40044f0 con 0x7f30d8007390 2023-11-24T08:07:44.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.616+0000 7f30f24c9640 1 -- 172.21.15.97:0/512852441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30d8007390 msgr2=0x7f30d800db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.616+0000 7f30f24c9640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30d8007390 0x7f30d800db90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ac0 tx=0x7f30d8007a00 comp rx=0 tx=0).stop 2023-11-24T08:07:44.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.616+0000 7f30f24c9640 1 -- 172.21.15.97:0/512852441 shutdown_connections 2023-11-24T08:07:44.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.616+0000 7f30f24c9640 1 --2- 172.21.15.97:0/512852441 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30d8007390 0x7f30d800db90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.616+0000 7f30f24c9640 1 -- 172.21.15.97:0/512852441 >> 172.21.15.97:0/512852441 conn(0x7f30ec06a800 msgr2=0x7f30ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.616+0000 7f30f24c9640 1 -- 172.21.15.97:0/512852441 shutdown_connections 2023-11-24T08:07:44.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.616+0000 7f30f24c9640 1 -- 172.21.15.97:0/512852441 wait complete. 2023-11-24T08:07:44.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.618+0000 7f30f24c9640 1 Processor -- start 2023-11-24T08:07:44.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.618+0000 7f30f24c9640 1 -- start start 2023-11-24T08:07:44.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.619+0000 7f30f24c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d8007390 0x7f30ec0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.619+0000 7f30f24c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ec159a00 0x7f30ec0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.619+0000 7f30f24c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ec070800 0x7f30ec0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.619+0000 7f30f24c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec070c80 con 0x7f30ec070800 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.619+0000 7f30f24c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec0c4b00 con 0x7f30ec159a00 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.619+0000 7f30f24c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec134680 con 0x7f30d8007390 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ec070800 0x7f30ec0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ec070800 0x7f30ec0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40176/0 (socket says 172.21.15.97:40176) 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 -- 172.21.15.97:0/2404894725 learned_addr learned my addr 172.21.15.97:0/2404894725 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30eb7fe640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ec159a00 0x7f30ec0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 -- 172.21.15.97:0/2404894725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d8007390 msgr2=0x7f30ec0c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d8007390 0x7f30ec0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 -- 172.21.15.97:0/2404894725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ec159a00 msgr2=0x7f30ec0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ec159a00 0x7f30ec0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 -- 172.21.15.97:0/2404894725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec134960 con 0x7f30ec070800 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.620+0000 7f30f0a66640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ec070800 0x7f30ec0aea20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f30e402c380 tx=0x7f30e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.621+0000 7f30e8ff9640 1 -- 172.21.15.97:0/2404894725 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4003810 con 0x7f30ec070800 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.621+0000 7f30e8ff9640 1 -- 172.21.15.97:0/2404894725 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4003990 con 0x7f30ec070800 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.621+0000 7f30e8ff9640 1 -- 172.21.15.97:0/2404894725 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4003d40 con 0x7f30ec070800 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.621+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec134c40 con 0x7f30ec070800 2023-11-24T08:07:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.621+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec135200 con 0x7f30ec070800 2023-11-24T08:07:44.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.622+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec0675d0 con 0x7f30ec070800 2023-11-24T08:07:44.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.623+0000 7f30e8ff9640 1 -- 172.21.15.97:0/2404894725 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30e4003ea0 con 0x7f30ec070800 2023-11-24T08:07:44.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.624+0000 7f30e8ff9640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f30cc06ae70 0x7f30cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.624+0000 7f30e8ff9640 1 -- 172.21.15.97:0/2404894725 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f30e403b070 con 0x7f30ec070800 2023-11-24T08:07:44.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.625+0000 7f30ebfff640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f30cc06ae70 0x7f30cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.625+0000 7f30ebfff640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f30cc06ae70 0x7f30cc06d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30dc007fd0 tx=0x7f30dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.628+0000 7f30e8ff9640 1 -- 172.21.15.97:0/2404894725 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30e40759d0 con 0x7f30ec070800 2023-11-24T08:07:44.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.818+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30ec067d00 con 0x7f30ec070800 2023-11-24T08:07:44.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.819+0000 7f30e8ff9640 1 -- 172.21.15.97:0/2404894725 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30e4078ff0 con 0x7f30ec070800 2023-11-24T08:07:44.822 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f30cc06ae70 msgr2=0x7f30cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f30cc06ae70 0x7f30cc06d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30dc007fd0 tx=0x7f30dc009040 comp rx=0 tx=0).stop 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ec070800 msgr2=0x7f30ec0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ec070800 0x7f30ec0aea20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f30e402c380 tx=0x7f30e4004730 comp rx=0 tx=0).stop 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 shutdown_connections 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f30cc06ae70 0x7f30cc06d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30ec070800 0x7f30ec0aea20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30ec159a00 0x7f30ec0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 --2- 172.21.15.97:0/2404894725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30d8007390 0x7f30ec0c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 >> 172.21.15.97:0/2404894725 conn(0x7f30ec06a800 msgr2=0x7f30ec15ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 shutdown_connections 2023-11-24T08:07:44.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:44.822+0000 7f30f24c9640 1 -- 172.21.15.97:0/2404894725 wait complete. 2023-11-24T08:07:44.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:45.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.050+0000 7fa498c21640 1 Processor -- start 2023-11-24T08:07:45.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.050+0000 7fa498c21640 1 -- start start 2023-11-24T08:07:45.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa498c21640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa49406d6d0 0x7fa4940b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa498c21640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa49415a690 0x7fa49406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa498c21640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4940b1e30 con 0x7fa4941505b0 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa498c21640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49415ab20 con 0x7fa49415a690 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa498c21640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940b20a0 con 0x7fa49406d6d0 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa493fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa49415a690 0x7fa49406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa493fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa49415a690 0x7fa49406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40188/0 (socket says 172.21.15.97:40188) 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.052+0000 7fa493fff640 1 -- 172.21.15.97:0/2639671899 learned_addr learned my addr 172.21.15.97:0/2639671899 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.053+0000 7fa492ffd640 1 --2- 172.21.15.97:0/2639671899 >> v2:172.21.15.183:3300/0 conn(0x7fa49406d6d0 0x7fa4940b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.053+0000 7fa493fff640 1 -- 172.21.15.97:0/2639671899 >> v2:172.21.15.183:3300/0 conn(0x7fa49406d6d0 msgr2=0x7fa4940b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.053+0000 7fa493fff640 1 --2- 172.21.15.97:0/2639671899 >> v2:172.21.15.183:3300/0 conn(0x7fa49406d6d0 0x7fa4940b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.053+0000 7fa493fff640 1 -- 172.21.15.97:0/2639671899 >> v1:172.21.15.183:6789/0 conn(0x7fa4941505b0 legacy=0x7fa49406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.053+0000 7fa493fff640 1 -- 172.21.15.97:0/2639671899 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940b2380 con 0x7fa49415a690 2023-11-24T08:07:45.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.054+0000 7fa493fff640 1 --2- 172.21.15.97:0/2639671899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49415a690 0x7fa49406c730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa4940b3140 tx=0x7fa48c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941735712f10a91c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.054+0000 7fa4927fc640 1 -- 172.21.15.97:0/2639671899 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c031870 con 0x7fa49415a690 2023-11-24T08:07:45.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.054+0000 7fa4927fc640 1 -- 172.21.15.97:0/2639671899 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c0319d0 con 0x7fa49415a690 2023-11-24T08:07:45.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.054+0000 7fa4927fc640 1 -- 172.21.15.97:0/2639671899 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c031d60 con 0x7fa49415a690 2023-11-24T08:07:45.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 -- 172.21.15.97:0/2639671899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49415a690 msgr2=0x7fa49406c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 --2- 172.21.15.97:0/2639671899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49415a690 0x7fa49406c730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa4940b3140 tx=0x7fa48c02b910 comp rx=0 tx=0).stop 2023-11-24T08:07:45.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 -- 172.21.15.97:0/2639671899 shutdown_connections 2023-11-24T08:07:45.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 --2- 172.21.15.97:0/2639671899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49415a690 0x7fa49406c730 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 --2- 172.21.15.97:0/2639671899 >> v2:172.21.15.183:3300/0 conn(0x7fa49406d6d0 0x7fa4940b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 -- 172.21.15.97:0/2639671899 >> 172.21.15.97:0/2639671899 conn(0x7fa49406a7d0 msgr2=0x7fa49406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 -- 172.21.15.97:0/2639671899 shutdown_connections 2023-11-24T08:07:45.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.055+0000 7fa498c21640 1 -- 172.21.15.97:0/2639671899 wait complete. 2023-11-24T08:07:45.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.057+0000 7fa498c21640 1 Processor -- start 2023-11-24T08:07:45.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.058+0000 7fa498c21640 1 -- start start 2023-11-24T08:07:45.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa498c21640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49406d6d0 0x7fa49414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa498c21640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4941505b0 0x7fa4941eeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa498c21640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49415a690 0x7fa4940711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa498c21640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49414dcd0 con 0x7fa49406d6d0 2023-11-24T08:07:45.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa498c21640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940ac0a0 con 0x7fa49415a690 2023-11-24T08:07:45.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa498c21640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940ac380 con 0x7fa4941505b0 2023-11-24T08:07:45.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49406d6d0 0x7fa49414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49406d6d0 0x7fa49414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40198/0 (socket says 172.21.15.97:40198) 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 -- 172.21.15.97:0/331991732 learned_addr learned my addr 172.21.15.97:0/331991732 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 -- 172.21.15.97:0/331991732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4941505b0 msgr2=0x7fa4941eeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4941505b0 0x7fa4941eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 -- 172.21.15.97:0/331991732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49415a690 msgr2=0x7fa4940711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49415a690 0x7fa4940711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.059+0000 7fa4937fe640 1 -- 172.21.15.97:0/331991732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0094d0 con 0x7fa49406d6d0 2023-11-24T08:07:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.060+0000 7fa4937fe640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49406d6d0 0x7fa49414d790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c430 tx=0x7fa48400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.060+0000 7fa48bfff640 1 -- 172.21.15.97:0/331991732 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484011790 con 0x7fa49406d6d0 2023-11-24T08:07:45.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.060+0000 7fa48bfff640 1 -- 172.21.15.97:0/331991732 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840118f0 con 0x7fa49406d6d0 2023-11-24T08:07:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.060+0000 7fa48bfff640 1 -- 172.21.15.97:0/331991732 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484011ce0 con 0x7fa49406d6d0 2023-11-24T08:07:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.060+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4940ac660 con 0x7fa49406d6d0 2023-11-24T08:07:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.060+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940af370 con 0x7fa49406d6d0 2023-11-24T08:07:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.061+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4940acb80 con 0x7fa49406d6d0 2023-11-24T08:07:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.062+0000 7fa48bfff640 1 -- 172.21.15.97:0/331991732 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa48401c460 con 0x7fa49406d6d0 2023-11-24T08:07:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.063+0000 7fa48bfff640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa47406ae40 0x7fa47406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.064+0000 7fa48bfff640 1 -- 172.21.15.97:0/331991732 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa484089550 con 0x7fa49406d6d0 2023-11-24T08:07:45.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.064+0000 7fa492ffd640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa47406ae40 0x7fa47406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.064+0000 7fa492ffd640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa47406ae40 0x7fa47406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0070b0 tx=0x7fa47c007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.067+0000 7fa48bfff640 1 -- 172.21.15.97:0/331991732 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4940acb80 con 0x7fa49406d6d0 2023-11-24T08:07:45.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.253+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4940acb80 con 0x7fa49406d6d0 2023-11-24T08:07:45.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.254+0000 7fa48bfff640 1 -- 172.21.15.97:0/331991732 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4940acb80 con 0x7fa49406d6d0 2023-11-24T08:07:45.257 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:45.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.256+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa47406ae40 msgr2=0x7fa47406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.256+0000 7fa498c21640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa47406ae40 0x7fa47406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0070b0 tx=0x7fa47c007040 comp rx=0 tx=0).stop 2023-11-24T08:07:45.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.256+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49406d6d0 msgr2=0x7fa49414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.256+0000 7fa498c21640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49406d6d0 0x7fa49414d790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c430 tx=0x7fa48400c8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 shutdown_connections 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa47406ae40 0x7fa47406d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49415a690 0x7fa4940711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4941505b0 0x7fa4941eeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 --2- 172.21.15.97:0/331991732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa49406d6d0 0x7fa49414d790 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 >> 172.21.15.97:0/331991732 conn(0x7fa49406a7d0 msgr2=0x7fa49414e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 shutdown_connections 2023-11-24T08:07:45.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.257+0000 7fa498c21640 1 -- 172.21.15.97:0/331991732 wait complete. 2023-11-24T08:07:45.279 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:45.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.474+0000 7f5f5f09b640 1 Processor -- start 2023-11-24T08:07:45.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.474+0000 7f5f5f09b640 1 -- start start 2023-11-24T08:07:45.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.475+0000 7f5f5f09b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5f5813df80 0x7f5f5815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.475+0000 7f5f5f09b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 0x7f5f580cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.475+0000 7f5f5f09b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5806c470 con 0x7f5f5813e360 2023-11-24T08:07:45.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.475+0000 7f5f5f09b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5806c750 con 0x7f5f5813df80 2023-11-24T08:07:45.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.475+0000 7f5f5f09b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5806ca30 con 0x7f5f580cf9a0 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f5ce37640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5f5813df80 0x7f5f5815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f57fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5f5813e360 0x7f5f580cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:55486/0 (socket says 172.21.15.97:55486) 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f57fff640 1 -- 172.21.15.97:0/3058767320 learned_addr learned my addr 172.21.15.97:0/3058767320 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f577fe640 1 -- 172.21.15.97:0/3058767320 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115839816 0 0) 0x7f5f5806c470 con 0x7f5f5813e360 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f577fe640 1 -- 172.21.15.97:0/3058767320 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f44003520 con 0x7f5f5813e360 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f5ce37640 1 -- 172.21.15.97:0/3058767320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 msgr2=0x7f5f580cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f5ce37640 1 --2- 172.21.15.97:0/3058767320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 0x7f5f580cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f5ce37640 1 -- 172.21.15.97:0/3058767320 >> v1:172.21.15.97:6789/0 conn(0x7f5f5813e360 legacy=0x7f5f580cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f5ce37640 1 -- 172.21.15.97:0/3058767320 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5806cd10 con 0x7f5f5813df80 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.477+0000 7f5f5ce37640 1 --2- 172.21.15.97:0/3058767320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813df80 0x7f5f5815bee0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d90 tx=0x7f5f4802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba31409f865118c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f577fe640 1 -- 172.21.15.97:0/3058767320 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4802cc50 con 0x7f5f5813df80 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f577fe640 1 -- 172.21.15.97:0/3058767320 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4802cdb0 con 0x7f5f5813df80 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f577fe640 1 -- 172.21.15.97:0/3058767320 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48034660 con 0x7f5f5813df80 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 -- 172.21.15.97:0/3058767320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813df80 msgr2=0x7f5f5815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/3058767320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813df80 0x7f5f5815bee0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d90 tx=0x7f5f4802bea0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 -- 172.21.15.97:0/3058767320 shutdown_connections 2023-11-24T08:07:45.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/3058767320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 0x7f5f580cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/3058767320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813df80 0x7f5f5815bee0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 -- 172.21.15.97:0/3058767320 >> 172.21.15.97:0/3058767320 conn(0x7f5f5806a800 msgr2=0x7f5f5806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 -- 172.21.15.97:0/3058767320 shutdown_connections 2023-11-24T08:07:45.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.478+0000 7f5f5f09b640 1 -- 172.21.15.97:0/3058767320 wait complete. 2023-11-24T08:07:45.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.480+0000 7f5f5f09b640 1 Processor -- start 2023-11-24T08:07:45.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.480+0000 7f5f5f09b640 1 -- start start 2023-11-24T08:07:45.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.481+0000 7f5f5f09b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 0x7f5f58153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.481+0000 7f5f5f09b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f5813df80 0x7f5f580b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.481+0000 7f5f5f09b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813e360 0x7f5f580b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.481+0000 7f5f5f09b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f581e6710 con 0x7f5f5813e360 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.481+0000 7f5f5f09b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f581e5970 con 0x7f5f5813df80 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.481+0000 7f5f5f09b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f581e5690 con 0x7f5f580cf9a0 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813e360 0x7f5f580b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813e360 0x7f5f580b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40216/0 (socket says 172.21.15.97:40216) 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 -- 172.21.15.97:0/1797503216 learned_addr learned my addr 172.21.15.97:0/1797503216 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5ce37640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 0x7f5f58153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f57fff640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f5813df80 0x7f5f580b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 -- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 msgr2=0x7f5f58153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 0x7f5f58153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 -- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f5813df80 msgr2=0x7f5f580b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f5813df80 0x7f5f580b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 -- 172.21.15.97:0/1797503216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009a70 con 0x7f5f5813e360 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f5d638640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813e360 0x7f5f580b3740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b410 tx=0x7f5f5000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.482+0000 7f5f557fa640 1 -- 172.21.15.97:0/1797503216 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011830 con 0x7f5f5813e360 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.483+0000 7f5f557fa640 1 -- 172.21.15.97:0/1797503216 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50011990 con 0x7f5f5813e360 2023-11-24T08:07:45.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.483+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f581e60c0 con 0x7f5f5813e360 2023-11-24T08:07:45.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.483+0000 7f5f557fa640 1 -- 172.21.15.97:0/1797503216 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011d40 con 0x7f5f5813e360 2023-11-24T08:07:45.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.483+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f58154040 con 0x7f5f5813e360 2023-11-24T08:07:45.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.484+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f581e6880 con 0x7f5f5813e360 2023-11-24T08:07:45.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.485+0000 7f5f557fa640 1 -- 172.21.15.97:0/1797503216 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f5001a400 con 0x7f5f5813e360 2023-11-24T08:07:45.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.486+0000 7f5f557fa640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f3806ae40 0x7f5f3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.486+0000 7f5f557fa640 1 -- 172.21.15.97:0/1797503216 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5f50089900 con 0x7f5f5813e360 2023-11-24T08:07:45.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.486+0000 7f5f5ce37640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f3806ae40 0x7f5f3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.487+0000 7f5f5ce37640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f3806ae40 0x7f5f3806d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f48036000 tx=0x7f5f48030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.490+0000 7f5f557fa640 1 -- 172.21.15.97:0/1797503216 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f50054890 con 0x7f5f5813e360 2023-11-24T08:07:45.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.700+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f580675d0 con 0x7f5f5813e360 2023-11-24T08:07:45.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.701+0000 7f5f557fa640 1 -- 172.21.15.97:0/1797503216 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5f50015020 con 0x7f5f5813e360 2023-11-24T08:07:45.702 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:07:45.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f3806ae40 msgr2=0x7f5f3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f3806ae40 0x7f5f3806d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f48036000 tx=0x7f5f48030000 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813e360 msgr2=0x7f5f580b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813e360 0x7f5f580b3740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b410 tx=0x7f5f5000b810 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 shutdown_connections 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5f3806ae40 0x7f5f3806d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f5813e360 0x7f5f580b3740 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f5813df80 0x7f5f580b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 --2- 172.21.15.97:0/1797503216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f580cf9a0 0x7f5f58153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.703+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 >> 172.21.15.97:0/1797503216 conn(0x7f5f5806a800 msgr2=0x7f5f580affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.704+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 shutdown_connections 2023-11-24T08:07:45.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:45.704+0000 7f5f5f09b640 1 -- 172.21.15.97:0/1797503216 wait complete. 2023-11-24T08:07:45.724 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2023-11-24T08:07:45.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:45.724 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-24T08:07:45.825 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:45.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:07:45.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:45.825 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:07:45.875 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:07:45.876 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:46.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.088+0000 7f530869b640 1 Processor -- start 2023-11-24T08:07:46.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.088+0000 7f530869b640 1 -- start start 2023-11-24T08:07:46.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f530869b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f530013e360 0x7f53000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f530869b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f530015f9c0 0x7f53000cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f530869b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530015c5f0 con 0x7f530013df80 2023-11-24T08:07:46.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f530869b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530006c470 con 0x7f530013e360 2023-11-24T08:07:46.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f530869b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530006c750 con 0x7f530015f9c0 2023-11-24T08:07:46.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f5305c36640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f530013e360 0x7f53000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f5306437640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f530013df80 0x7f530015bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60246/0 (socket says 172.21.15.97:60246) 2023-11-24T08:07:46.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.090+0000 7f5306437640 1 -- 172.21.15.97:0/296729378 learned_addr learned my addr 172.21.15.97:0/296729378 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.091+0000 7f5306c38640 1 --2- 172.21.15.97:0/296729378 >> v2:172.21.15.183:3300/0 conn(0x7f530015f9c0 0x7f53000cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.091+0000 7f5305435640 1 -- 172.21.15.97:0/296729378 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826120128 0 0) 0x7f530015c5f0 con 0x7f530013df80 2023-11-24T08:07:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.091+0000 7f5305435640 1 -- 172.21.15.97:0/296729378 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ec003520 con 0x7f530013df80 2023-11-24T08:07:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.091+0000 7f5305c36640 1 -- 172.21.15.97:0/296729378 >> v2:172.21.15.183:3300/0 conn(0x7f530015f9c0 msgr2=0x7f53000cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.091+0000 7f5305c36640 1 --2- 172.21.15.97:0/296729378 >> v2:172.21.15.183:3300/0 conn(0x7f530015f9c0 0x7f53000cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.091+0000 7f5305c36640 1 -- 172.21.15.97:0/296729378 >> v1:172.21.15.97:6789/0 conn(0x7f530013df80 legacy=0x7f530015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.091+0000 7f5305c36640 1 -- 172.21.15.97:0/296729378 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530006ca30 con 0x7f530013e360 2023-11-24T08:07:46.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.092+0000 7f5305c36640 1 --2- 172.21.15.97:0/296729378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013e360 0x7f53000cf290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f53000ccae0 tx=0x7f52f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2400ef1ce2cebfc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.092+0000 7f5305435640 1 -- 172.21.15.97:0/296729378 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0031830 con 0x7f530013e360 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.092+0000 7f5305435640 1 -- 172.21.15.97:0/296729378 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0031990 con 0x7f530013e360 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.092+0000 7f5305435640 1 -- 172.21.15.97:0/296729378 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0031d20 con 0x7f530013e360 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 -- 172.21.15.97:0/296729378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013e360 msgr2=0x7f53000cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 --2- 172.21.15.97:0/296729378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013e360 0x7f53000cf290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f53000ccae0 tx=0x7f52f002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 -- 172.21.15.97:0/296729378 shutdown_connections 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 --2- 172.21.15.97:0/296729378 >> v2:172.21.15.183:3300/0 conn(0x7f530015f9c0 0x7f53000cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 --2- 172.21.15.97:0/296729378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013e360 0x7f53000cf290 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 -- 172.21.15.97:0/296729378 >> 172.21.15.97:0/296729378 conn(0x7f530006a800 msgr2=0x7f530006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 -- 172.21.15.97:0/296729378 shutdown_connections 2023-11-24T08:07:46.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.093+0000 7f530869b640 1 -- 172.21.15.97:0/296729378 wait complete. 2023-11-24T08:07:46.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.094+0000 7f530869b640 1 Processor -- start 2023-11-24T08:07:46.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.095+0000 7f530869b640 1 -- start start 2023-11-24T08:07:46.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.095+0000 7f530869b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013df80 0x7f53000713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f530869b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f530013e360 0x7f530013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f530869b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f530015f9c0 0x7f53001502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f530869b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5300070fd0 con 0x7f530013df80 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f530869b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5300150c60 con 0x7f530015f9c0 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f530869b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5300070630 con 0x7f530013e360 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013df80 0x7f53000713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013df80 0x7f53000713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41360/0 (socket says 172.21.15.97:41360) 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 -- 172.21.15.97:0/509226400 learned_addr learned my addr 172.21.15.97:0/509226400 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 -- 172.21.15.97:0/509226400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f530013e360 msgr2=0x7f530013d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f530013e360 0x7f530013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 -- 172.21.15.97:0/509226400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f530015f9c0 msgr2=0x7f53001502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f530015f9c0 0x7f53001502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 -- 172.21.15.97:0/509226400 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0009400 con 0x7f530013df80 2023-11-24T08:07:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.096+0000 7f5306437640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013df80 0x7f53000713f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c400 tx=0x7f52fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.097+0000 7f52f6ffd640 1 -- 172.21.15.97:0/509226400 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc005ce0 con 0x7f530013df80 2023-11-24T08:07:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.097+0000 7f52f6ffd640 1 -- 172.21.15.97:0/509226400 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc005e40 con 0x7f530013df80 2023-11-24T08:07:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.097+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5300070910 con 0x7f530013df80 2023-11-24T08:07:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.097+0000 7f52f6ffd640 1 -- 172.21.15.97:0/509226400 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0072d0 con 0x7f530013df80 2023-11-24T08:07:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.097+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530013dd10 con 0x7f530013df80 2023-11-24T08:07:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.098+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53000675d0 con 0x7f530013df80 2023-11-24T08:07:46.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.099+0000 7f52f6ffd640 1 -- 172.21.15.97:0/509226400 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52fc007430 con 0x7f530013df80 2023-11-24T08:07:46.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.100+0000 7f52f6ffd640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52e406ae70 0x7f52e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.100+0000 7f52f6ffd640 1 -- 172.21.15.97:0/509226400 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f52fc088aa0 con 0x7f530013df80 2023-11-24T08:07:46.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.100+0000 7f5305c36640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52e406ae70 0x7f52e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.101+0000 7f5305c36640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52e406ae70 0x7f52e406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52f0036000 tx=0x7f52f0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.104+0000 7f52f6ffd640 1 -- 172.21.15.97:0/509226400 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52fc053c10 con 0x7f530013df80 2023-11-24T08:07:46.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.318+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f530006df00 con 0x7f530013df80 2023-11-24T08:07:46.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.319+0000 7f52f6ffd640 1 -- 172.21.15.97:0/509226400 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f52fc017090 con 0x7f530013df80 2023-11-24T08:07:46.321 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:46.321 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:07:46.322 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:07:46.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52e406ae70 msgr2=0x7f52e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52e406ae70 0x7f52e406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52f0036000 tx=0x7f52f0030000 comp rx=0 tx=0).stop 2023-11-24T08:07:46.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013df80 msgr2=0x7f53000713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013df80 0x7f53000713f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c400 tx=0x7f52fc00c8c0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 shutdown_connections 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52e406ae70 0x7f52e406d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f530015f9c0 0x7f53001502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f530013e360 0x7f530013d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 --2- 172.21.15.97:0/509226400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f530013df80 0x7f53000713f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.321+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 >> 172.21.15.97:0/509226400 conn(0x7f530006a800 msgr2=0x7f53000cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.322+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 shutdown_connections 2023-11-24T08:07:46.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.322+0000 7f530869b640 1 -- 172.21.15.97:0/509226400 wait complete. 2023-11-24T08:07:46.341 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:46.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.548+0000 7f5071a50640 1 Processor -- start 2023-11-24T08:07:46.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.548+0000 7f5071a50640 1 -- start start 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.549+0000 7f5071a50640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f506c159590 0x7f506c070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5071a50640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f506c0b3c20 0x7f506c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5071a50640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 0x7f506c06d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5071a50640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c071790 con 0x7f506c159590 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5071a50640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c071100 con 0x7f506c0b3c20 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5071a50640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c070860 con 0x7f506c0cd220 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f506c159590 0x7f506c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f506c159590 0x7f506c070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41366/0 (socket says 172.21.15.97:41366) 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 -- 172.21.15.97:0/3839877932 learned_addr learned my addr 172.21.15.97:0/3839877932 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 -- 172.21.15.97:0/3839877932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 msgr2=0x7f506c06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 --2- 172.21.15.97:0/3839877932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 0x7f506c06d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 -- 172.21.15.97:0/3839877932 >> v2:172.21.15.183:3300/0 conn(0x7f506c0b3c20 msgr2=0x7f506c0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f506bfff640 1 --2- 172.21.15.97:0/3839877932 >> v2:172.21.15.183:3300/0 conn(0x7f506c0b3c20 0x7f506c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 --2- 172.21.15.97:0/3839877932 >> v2:172.21.15.183:3300/0 conn(0x7f506c0b3c20 0x7f506c0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f5070a4e640 1 -- 172.21.15.97:0/3839877932 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c070b40 con 0x7f506c159590 2023-11-24T08:07:46.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.550+0000 7f506bfff640 1 --2- 172.21.15.97:0/3839877932 >> v2:172.21.15.183:3300/0 conn(0x7f506c0b3c20 0x7f506c0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:46.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.551+0000 7f5070a4e640 1 --2- 172.21.15.97:0/3839877932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c070160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f506c0ce820 tx=0x7f505c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51757128a4dbc95c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f506b7fe640 1 -- 172.21.15.97:0/3839877932 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0317e0 con 0x7f506c159590 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f506b7fe640 1 -- 172.21.15.97:0/3839877932 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c031940 con 0x7f506c159590 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f506b7fe640 1 -- 172.21.15.97:0/3839877932 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c031cd0 con 0x7f506c159590 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f5071a50640 1 -- 172.21.15.97:0/3839877932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 msgr2=0x7f506c070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f5071a50640 1 --2- 172.21.15.97:0/3839877932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c070160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f506c0ce820 tx=0x7f505c02b880 comp rx=0 tx=0).stop 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f5071a50640 1 -- 172.21.15.97:0/3839877932 shutdown_connections 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f5071a50640 1 --2- 172.21.15.97:0/3839877932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 0x7f506c06d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f5071a50640 1 --2- 172.21.15.97:0/3839877932 >> v2:172.21.15.183:3300/0 conn(0x7f506c0b3c20 0x7f506c0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f5071a50640 1 --2- 172.21.15.97:0/3839877932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c070160 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.552+0000 7f5071a50640 1 -- 172.21.15.97:0/3839877932 >> 172.21.15.97:0/3839877932 conn(0x7f506c06a800 msgr2=0x7f506c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.553+0000 7f5071a50640 1 -- 172.21.15.97:0/3839877932 shutdown_connections 2023-11-24T08:07:46.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.553+0000 7f5071a50640 1 -- 172.21.15.97:0/3839877932 wait complete. 2023-11-24T08:07:46.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.554+0000 7f5071a50640 1 Processor -- start 2023-11-24T08:07:46.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.555+0000 7f5071a50640 1 -- start start 2023-11-24T08:07:46.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5071a50640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f506c0b3c20 0x7f506c1495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5071a50640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 0x7f506c137120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5071a50640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5071a50640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c137660 con 0x7f506c159590 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5071a50640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c137890 con 0x7f506c0b3c20 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5071a50640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c137b70 con 0x7f506c0cd220 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c136540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41372/0 (socket says 172.21.15.97:41372) 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 -- 172.21.15.97:0/3097540439 learned_addr learned my addr 172.21.15.97:0/3097540439 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5070a4e640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f506c0b3c20 0x7f506c1495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f506bfff640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 0x7f506c137120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 -- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 msgr2=0x7f506c137120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 0x7f506c137120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 -- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f506c0b3c20 msgr2=0x7f506c1495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f506c0b3c20 0x7f506c1495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f507124f640 1 -- 172.21.15.97:0/3097540439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c0094d0 con 0x7f506c159590 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.556+0000 7f5070a4e640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f506c0b3c20 0x7f506c1495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.557+0000 7f507124f640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c136540 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5064009fd0 tx=0x7f506400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.557+0000 7f50697fa640 1 -- 172.21.15.97:0/3097540439 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011830 con 0x7f506c159590 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.557+0000 7f50697fa640 1 -- 172.21.15.97:0/3097540439 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064011990 con 0x7f506c159590 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.557+0000 7f50697fa640 1 -- 172.21.15.97:0/3097540439 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011d20 con 0x7f506c159590 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.557+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c137e50 con 0x7f506c159590 2023-11-24T08:07:46.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.557+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c138410 con 0x7f506c159590 2023-11-24T08:07:46.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.558+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c138630 con 0x7f506c159590 2023-11-24T08:07:46.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.559+0000 7f50697fa640 1 -- 172.21.15.97:0/3097540439 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f506401b460 con 0x7f506c159590 2023-11-24T08:07:46.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.560+0000 7f50697fa640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f504c06ae40 0x7f504c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.560+0000 7f50697fa640 1 -- 172.21.15.97:0/3097540439 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f50640894b0 con 0x7f506c159590 2023-11-24T08:07:46.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.560+0000 7f5070a4e640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f504c06ae40 0x7f504c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.561+0000 7f5070a4e640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f504c06ae40 0x7f504c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f505c036000 tx=0x7f505c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.565+0000 7f50697fa640 1 -- 172.21.15.97:0/3097540439 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5064057ed0 con 0x7f506c159590 2023-11-24T08:07:46.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.758+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f506c067450 con 0x7f506c159590 2023-11-24T08:07:46.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.761+0000 7f50697fa640 1 -- 172.21.15.97:0/3097540439 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f5064057a60 con 0x7f506c159590 2023-11-24T08:07:46.763 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:46.763 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:46.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f504c06ae40 msgr2=0x7f504c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f504c06ae40 0x7f504c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f505c036000 tx=0x7f505c03d040 comp rx=0 tx=0).stop 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 msgr2=0x7f506c136540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c136540 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5064009fd0 tx=0x7f506400b8e0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 shutdown_connections 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f504c06ae40 0x7f504c06d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f506c159590 0x7f506c136540 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506c0cd220 0x7f506c137120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 --2- 172.21.15.97:0/3097540439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f506c0b3c20 0x7f506c1495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 >> 172.21.15.97:0/3097540439 conn(0x7f506c06a800 msgr2=0x7f506c1588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 shutdown_connections 2023-11-24T08:07:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.764+0000 7f5071a50640 1 -- 172.21.15.97:0/3097540439 wait complete. 2023-11-24T08:07:46.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:06:39.685561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:06:41.081821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:46.785 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:46.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.991+0000 7f1d55f5a640 1 Processor -- start 2023-11-24T08:07:46.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.991+0000 7f1d55f5a640 1 -- start start 2023-11-24T08:07:46.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.992+0000 7f1d55f5a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d500c9870 0x7f1d500ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.992+0000 7f1d55f5a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1d50161740 0x7f1d500c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.992+0000 7f1d55f5a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500cf4c0 con 0x7f1d500d0560 2023-11-24T08:07:46.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.992+0000 7f1d55f5a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500d2ef0 con 0x7f1d500c9870 2023-11-24T08:07:46.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.992+0000 7f1d55f5a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500c9c50 con 0x7f1d50161740 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d500c9870 0x7f1d500ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d500c9870 0x7f1d500ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41384/0 (socket says 172.21.15.97:41384) 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4f7fe640 1 -- 172.21.15.97:0/2750846751 learned_addr learned my addr 172.21.15.97:0/2750846751 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4ffff640 1 --2- 172.21.15.97:0/2750846751 >> v2:172.21.15.183:3300/0 conn(0x7f1d50161740 0x7f1d500c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4f7fe640 1 -- 172.21.15.97:0/2750846751 >> v2:172.21.15.183:3300/0 conn(0x7f1d50161740 msgr2=0x7f1d500c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4f7fe640 1 --2- 172.21.15.97:0/2750846751 >> v2:172.21.15.183:3300/0 conn(0x7f1d50161740 0x7f1d500c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4f7fe640 1 -- 172.21.15.97:0/2750846751 >> v1:172.21.15.183:6789/0 conn(0x7f1d500d0560 legacy=0x7f1d50161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4f7fe640 1 -- 172.21.15.97:0/2750846751 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500cf7a0 con 0x7f1d500c9870 2023-11-24T08:07:46.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.993+0000 7f1d4ffff640 1 --2- 172.21.15.97:0/2750846751 >> v2:172.21.15.183:3300/0 conn(0x7f1d50161740 0x7f1d500c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:46.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.994+0000 7f1d4f7fe640 1 --2- 172.21.15.97:0/2750846751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d500c9870 0x7f1d500ceb50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1d5008d8f0 tx=0x7f1d4002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414563b1e013ef5b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d4e7fc640 1 -- 172.21.15.97:0/2750846751 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4002ca70 con 0x7f1d500c9870 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d4e7fc640 1 -- 172.21.15.97:0/2750846751 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4002cbd0 con 0x7f1d500c9870 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d4e7fc640 1 -- 172.21.15.97:0/2750846751 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400343f0 con 0x7f1d500c9870 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d55f5a640 1 -- 172.21.15.97:0/2750846751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d500c9870 msgr2=0x7f1d500ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/2750846751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d500c9870 0x7f1d500ceb50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1d5008d8f0 tx=0x7f1d4002bed0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d55f5a640 1 -- 172.21.15.97:0/2750846751 shutdown_connections 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/2750846751 >> v2:172.21.15.183:3300/0 conn(0x7f1d50161740 0x7f1d500c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/2750846751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d500c9870 0x7f1d500ceb50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.995+0000 7f1d55f5a640 1 -- 172.21.15.97:0/2750846751 >> 172.21.15.97:0/2750846751 conn(0x7f1d5009c560 msgr2=0x7f1d500d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.996+0000 7f1d55f5a640 1 -- 172.21.15.97:0/2750846751 shutdown_connections 2023-11-24T08:07:46.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.996+0000 7f1d55f5a640 1 -- 172.21.15.97:0/2750846751 wait complete. 2023-11-24T08:07:46.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.997+0000 7f1d55f5a640 1 Processor -- start 2023-11-24T08:07:46.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.997+0000 7f1d55f5a640 1 -- start start 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.998+0000 7f1d55f5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d500c9870 0x7f1d50159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.998+0000 7f1d55f5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d500d0560 0x7f1d500caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.998+0000 7f1d55f5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d50161740 0x7f1d500b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.998+0000 7f1d55f5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5015a150 con 0x7f1d50161740 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.998+0000 7f1d55f5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500cb1e0 con 0x7f1d500d0560 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.998+0000 7f1d55f5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500cb410 con 0x7f1d500c9870 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d50161740 0x7f1d500b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d50161740 0x7f1d500b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41396/0 (socket says 172.21.15.97:41396) 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 -- 172.21.15.97:0/664169638 learned_addr learned my addr 172.21.15.97:0/664169638 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4f7fe640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d500c9870 0x7f1d50159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4effd640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d500d0560 0x7f1d500caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 -- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d500c9870 msgr2=0x7f1d50159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d500c9870 0x7f1d50159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 -- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d500d0560 msgr2=0x7f1d500caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d500d0560 0x7f1d500caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4ffff640 1 -- 172.21.15.97:0/664169638 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40009b30 con 0x7f1d50161740 2023-11-24T08:07:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:46.999+0000 7f1d4effd640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d500d0560 0x7f1d500caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:47.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.000+0000 7f1d4ffff640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d50161740 0x7f1d500b7340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c7c0 tx=0x7f1d4800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.000+0000 7f1d37fff640 1 -- 172.21.15.97:0/664169638 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48004230 con 0x7f1d50161740 2023-11-24T08:07:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.000+0000 7f1d37fff640 1 -- 172.21.15.97:0/664169638 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48004390 con 0x7f1d50161740 2023-11-24T08:07:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.000+0000 7f1d37fff640 1 -- 172.21.15.97:0/664169638 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48007860 con 0x7f1d50161740 2023-11-24T08:07:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.000+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5015b790 con 0x7f1d50161740 2023-11-24T08:07:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.000+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5015bd50 con 0x7f1d50161740 2023-11-24T08:07:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.001+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5006b710 con 0x7f1d50161740 2023-11-24T08:07:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.002+0000 7f1d37fff640 1 -- 172.21.15.97:0/664169638 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d480079c0 con 0x7f1d50161740 2023-11-24T08:07:47.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.003+0000 7f1d37fff640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1d3c06ae40 0x7f1d3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.003+0000 7f1d37fff640 1 -- 172.21.15.97:0/664169638 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1d48089980 con 0x7f1d50161740 2023-11-24T08:07:47.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.003+0000 7f1d4f7fe640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1d3c06ae40 0x7f1d3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.004+0000 7f1d4f7fe640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1d3c06ae40 0x7f1d3c06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d40035000 tx=0x7f1d40030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.007+0000 7f1d37fff640 1 -- 172.21.15.97:0/664169638 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d48054a80 con 0x7f1d50161740 2023-11-24T08:07:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.197+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d500675d0 con 0x7f1d50161740 2023-11-24T08:07:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.198+0000 7f1d37fff640 1 -- 172.21.15.97:0/664169638 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d480150a0 con 0x7f1d50161740 2023-11-24T08:07:47.200 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1d3c06ae40 msgr2=0x7f1d3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1d3c06ae40 0x7f1d3c06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d40035000 tx=0x7f1d40030000 comp rx=0 tx=0).stop 2023-11-24T08:07:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d50161740 msgr2=0x7f1d500b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d50161740 0x7f1d500b7340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c7c0 tx=0x7f1d4800cc80 comp rx=0 tx=0).stop 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 shutdown_connections 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1d3c06ae40 0x7f1d3c06d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d50161740 0x7f1d500b7340 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d500d0560 0x7f1d500caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 --2- 172.21.15.97:0/664169638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d500c9870 0x7f1d50159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.200+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 >> 172.21.15.97:0/664169638 conn(0x7f1d5009c560 msgr2=0x7f1d5006b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.201+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 shutdown_connections 2023-11-24T08:07:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.201+0000 7f1d55f5a640 1 -- 172.21.15.97:0/664169638 wait complete. 2023-11-24T08:07:47.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:47.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.436+0000 7fd592961640 1 Processor -- start 2023-11-24T08:07:47.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.436+0000 7fd592961640 1 -- start start 2023-11-24T08:07:47.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.437+0000 7fd592961640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd58c14b2c0 0x7fd58c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd592961640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd58c071070 0x7fd58c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd592961640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c0cfbf0 con 0x7fd58c0cf7d0 2023-11-24T08:07:47.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd592961640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c14b6a0 con 0x7fd58c14b2c0 2023-11-24T08:07:47.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd592961640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c071690 con 0x7fd58c071070 2023-11-24T08:07:47.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd58bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd58c14b2c0 0x7fd58c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd583fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd58c0cf7d0 0x7fd58c070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60252/0 (socket says 172.21.15.97:60252) 2023-11-24T08:07:47.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd583fff640 1 -- 172.21.15.97:0/2277254687 learned_addr learned my addr 172.21.15.97:0/2277254687 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:47.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd58bfff640 1 -- 172.21.15.97:0/2277254687 >> v2:172.21.15.183:3300/0 conn(0x7fd58c071070 msgr2=0x7fd58c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd58bfff640 1 --2- 172.21.15.97:0/2277254687 >> v2:172.21.15.183:3300/0 conn(0x7fd58c071070 0x7fd58c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd58bfff640 1 -- 172.21.15.97:0/2277254687 >> v1:172.21.15.97:6789/0 conn(0x7fd58c0cf7d0 legacy=0x7fd58c070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd58b7fe640 1 -- 172.21.15.97:0/2277254687 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231330084 0 0) 0x7fd58c0cfbf0 con 0x7fd58c0cf7d0 2023-11-24T08:07:47.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.438+0000 7fd58bfff640 1 -- 172.21.15.97:0/2277254687 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c071970 con 0x7fd58c14b2c0 2023-11-24T08:07:47.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.439+0000 7fd58bfff640 1 --2- 172.21.15.97:0/2277254687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c14b2c0 0x7fd58c0cf290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd58c165330 tx=0x7fd57c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bf535dc4f99a5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd58b7fe640 1 -- 172.21.15.97:0/2277254687 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c031830 con 0x7fd58c14b2c0 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd58b7fe640 1 -- 172.21.15.97:0/2277254687 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c031990 con 0x7fd58c14b2c0 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd58b7fe640 1 -- 172.21.15.97:0/2277254687 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c031d20 con 0x7fd58c14b2c0 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd592961640 1 -- 172.21.15.97:0/2277254687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c14b2c0 msgr2=0x7fd58c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd592961640 1 --2- 172.21.15.97:0/2277254687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c14b2c0 0x7fd58c0cf290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd58c165330 tx=0x7fd57c02b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd592961640 1 -- 172.21.15.97:0/2277254687 shutdown_connections 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd592961640 1 --2- 172.21.15.97:0/2277254687 >> v2:172.21.15.183:3300/0 conn(0x7fd58c071070 0x7fd58c0cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd592961640 1 --2- 172.21.15.97:0/2277254687 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c14b2c0 0x7fd58c0cf290 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.440+0000 7fd592961640 1 -- 172.21.15.97:0/2277254687 >> 172.21.15.97:0/2277254687 conn(0x7fd58c06a800 msgr2=0x7fd58c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.441+0000 7fd592961640 1 -- 172.21.15.97:0/2277254687 shutdown_connections 2023-11-24T08:07:47.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.441+0000 7fd592961640 1 -- 172.21.15.97:0/2277254687 wait complete. 2023-11-24T08:07:47.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.442+0000 7fd592961640 1 Processor -- start 2023-11-24T08:07:47.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.442+0000 7fd592961640 1 -- start start 2023-11-24T08:07:47.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.443+0000 7fd592961640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c071070 0x7fd58c142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.443+0000 7fd592961640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd58c0cf7d0 0x7fd58c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.443+0000 7fd592961640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd58c14b2c0 0x7fd58c144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.443+0000 7fd592961640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c147560 con 0x7fd58c071070 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.443+0000 7fd592961640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c142650 con 0x7fd58c14b2c0 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.443+0000 7fd592961640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c1468e0 con 0x7fd58c0cf7d0 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c071070 0x7fd58c142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c071070 0x7fd58c142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41408/0 (socket says 172.21.15.97:41408) 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 -- 172.21.15.97:0/480968861 learned_addr learned my addr 172.21.15.97:0/480968861 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd590efe640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd58c14b2c0 0x7fd58c144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 -- 172.21.15.97:0/480968861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd58c0cf7d0 msgr2=0x7fd58c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd58c0cf7d0 0x7fd58c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 -- 172.21.15.97:0/480968861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd58c14b2c0 msgr2=0x7fd58c144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd58c14b2c0 0x7fd58c144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 -- 172.21.15.97:0/480968861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009400 con 0x7fd58c071070 2023-11-24T08:07:47.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.444+0000 7fd58bfff640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c071070 0x7fd58c142110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd57c034040 tx=0x7fd57c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.445+0000 7fd5897fa640 1 -- 172.21.15.97:0/480968861 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c004030 con 0x7fd58c071070 2023-11-24T08:07:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.445+0000 7fd5897fa640 1 -- 172.21.15.97:0/480968861 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c004190 con 0x7fd58c071070 2023-11-24T08:07:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.445+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c146bc0 con 0x7fd58c071070 2023-11-24T08:07:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.445+0000 7fd5897fa640 1 -- 172.21.15.97:0/480968861 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c03b860 con 0x7fd58c071070 2023-11-24T08:07:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.445+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c147180 con 0x7fd58c071070 2023-11-24T08:07:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.446+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c1477d0 con 0x7fd58c071070 2023-11-24T08:07:47.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.447+0000 7fd5897fa640 1 -- 172.21.15.97:0/480968861 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd57c043070 con 0x7fd58c071070 2023-11-24T08:07:47.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.448+0000 7fd5897fa640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd56c06ae70 0x7fd56c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.448+0000 7fd5897fa640 1 -- 172.21.15.97:0/480968861 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd57c0ab470 con 0x7fd58c071070 2023-11-24T08:07:47.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.448+0000 7fd583fff640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd56c06ae70 0x7fd56c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.449+0000 7fd583fff640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd56c06ae70 0x7fd56c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd574007fd0 tx=0x7fd574007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.452+0000 7fd5897fa640 1 -- 172.21.15.97:0/480968861 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd57c076400 con 0x7fd58c071070 2023-11-24T08:07:47.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.643+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd58c0675d0 con 0x7fd58c071070 2023-11-24T08:07:47.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.643+0000 7fd5897fa640 1 -- 172.21.15.97:0/480968861 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd57c079a20 con 0x7fd58c071070 2023-11-24T08:07:47.646 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:07:47.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd56c06ae70 msgr2=0x7fd56c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd56c06ae70 0x7fd56c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd574007fd0 tx=0x7fd574007920 comp rx=0 tx=0).stop 2023-11-24T08:07:47.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c071070 msgr2=0x7fd58c142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c071070 0x7fd58c142110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd57c034040 tx=0x7fd57c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 shutdown_connections 2023-11-24T08:07:47.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd56c06ae70 0x7fd56c06d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd58c14b2c0 0x7fd58c144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd58c0cf7d0 0x7fd58c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 --2- 172.21.15.97:0/480968861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd58c071070 0x7fd58c142110 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 >> 172.21.15.97:0/480968861 conn(0x7fd58c06a800 msgr2=0x7fd58c149000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.646+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 shutdown_connections 2023-11-24T08:07:47.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.647+0000 7fd592961640 1 -- 172.21.15.97:0/480968861 wait complete. 2023-11-24T08:07:47.667 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.882+0000 7f3c16eee640 1 Processor -- start 2023-11-24T08:07:47.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.882+0000 7f3c16eee640 1 -- start start 2023-11-24T08:07:47.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.884+0000 7f3c16eee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 0x7f3c10070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.884+0000 7f3c16eee640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c10071690 con 0x7f3c10070ea0 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.884+0000 7f3c16eee640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c10071970 con 0x7f3c1014b2c0 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.884+0000 7f3c16eee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1014b6a0 con 0x7f3c100cf9a0 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.884+0000 7f3c1548b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3c10070ea0 0x7f3c100cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60254/0 (socket says 172.21.15.97:60254) 2023-11-24T08:07:47.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.884+0000 7f3c1548b640 1 -- 172.21.15.97:0/2840501660 learned_addr learned my addr 172.21.15.97:0/2840501660 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 0x7f3c10070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576714283 0 0) 0x7f3c10071690 con 0x7f3c10070ea0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c00003520 con 0x7f3c10070ea0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4143964075 0 0) 0x7f3c00003520 con 0x7f3c10070ea0 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 msgr2=0x7f3c10070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 0x7f3c10070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 >> v1:172.21.15.183:6789/0 conn(0x7f3c1014b2c0 legacy=0x7f3c100cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10071c50 con 0x7f3c10070ea0 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f3c080019f0 con 0x7f3c10070ea0 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 >> v1:172.21.15.97:6789/0 conn(0x7f3c10070ea0 legacy=0x7f3c100cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c000039a0 0x7f3c00003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 0x7f3c00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1014b6a0 con 0x7f3c000047c0 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0000ba30 con 0x7f3c000039a0 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.885+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0000bbf0 con 0x7f3c100cf9a0 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c1548b640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 0x7f3c00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c14c8a640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c000039a0 0x7f3c00003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c0ffff640 1 -- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 msgr2=0x7f3c00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100cf9a0 0x7f3c00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c0ffff640 1 -- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c000039a0 msgr2=0x7f3c00003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c000039a0 0x7f3c00003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.886+0000 7f3c0ffff640 1 -- 172.21.15.97:0/2840501660 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00003520 con 0x7f3c000047c0 2023-11-24T08:07:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.887+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c00004c40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009a90 tx=0x7f3c000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32aafb0aa3e3a7ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.887+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc02c680 con 0x7f3c000047c0 2023-11-24T08:07:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.887+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc02c7e0 con 0x7f3c000047c0 2023-11-24T08:07:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.887+0000 7f3c0f7fe640 1 -- 172.21.15.97:0/2840501660 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc02cb70 con 0x7f3c000047c0 2023-11-24T08:07:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.888+0000 7f3c16eee640 1 -- 172.21.15.97:0/2840501660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 msgr2=0x7f3c00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.888+0000 7f3c16eee640 1 --2- 172.21.15.97:0/2840501660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c00004c40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009a90 tx=0x7f3c000057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.888+0000 7f3c1548b640 1 -- 172.21.15.97:0/2840501660 reap_dead start 2023-11-24T08:07:47.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.888+0000 7f3c16eee640 1 -- 172.21.15.97:0/2840501660 shutdown_connections 2023-11-24T08:07:47.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.888+0000 7f3c16eee640 1 -- 172.21.15.97:0/2840501660 >> 172.21.15.97:0/2840501660 conn(0x7f3c1006a800 msgr2=0x7f3c1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.888+0000 7f3c16eee640 1 -- 172.21.15.97:0/2840501660 shutdown_connections 2023-11-24T08:07:47.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.888+0000 7f3c16eee640 1 -- 172.21.15.97:0/2840501660 wait complete. 2023-11-24T08:07:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.890+0000 7f3c16eee640 1 Processor -- start 2023-11-24T08:07:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.890+0000 7f3c16eee640 1 -- start start 2023-11-24T08:07:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.891+0000 7f3c16eee640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c10164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.891+0000 7f3c16eee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1013f440 0x7f3c101611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.891+0000 7f3c16eee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100ce070 0x7f3c100ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.891+0000 7f3c16eee640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100cea60 con 0x7f3c000047c0 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.891+0000 7f3c16eee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10140c50 con 0x7f3c1013f440 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.891+0000 7f3c16eee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101616f0 con 0x7f3c100ce070 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c10164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c10164970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41422/0 (socket says 172.21.15.97:41422) 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 -- 172.21.15.97:0/3100479997 learned_addr learned my addr 172.21.15.97:0/3100479997 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1013f440 0x7f3c101611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c1548b640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100ce070 0x7f3c100ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 -- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100ce070 msgr2=0x7f3c100ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100ce070 0x7f3c100ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 -- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1013f440 msgr2=0x7f3c101611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1013f440 0x7f3c101611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 -- 172.21.15.97:0/3100479997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1013fbb0 con 0x7f3c000047c0 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.892+0000 7f3c14c8a640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c10164970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400e580 tx=0x7f3c0400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.893+0000 7f3c0d7fa640 1 -- 172.21.15.97:0/3100479997 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040052e0 con 0x7f3c000047c0 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.893+0000 7f3c0d7fa640 1 -- 172.21.15.97:0/3100479997 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04005440 con 0x7f3c000047c0 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.893+0000 7f3c0d7fa640 1 -- 172.21.15.97:0/3100479997 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04003810 con 0x7f3c000047c0 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.893+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1013fe90 con 0x7f3c000047c0 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.893+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c10140450 con 0x7f3c000047c0 2023-11-24T08:07:47.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.894+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c100712f0 con 0x7f3c000047c0 2023-11-24T08:07:47.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.895+0000 7f3c0d7fa640 1 -- 172.21.15.97:0/3100479997 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c04003970 con 0x7f3c000047c0 2023-11-24T08:07:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.896+0000 7f3c0d7fa640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3bf406ae70 0x7f3bf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.896+0000 7f3c0d7fa640 1 -- 172.21.15.97:0/3100479997 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3c040893d0 con 0x7f3c000047c0 2023-11-24T08:07:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.897+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3bf406ae70 0x7f3bf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.897+0000 7f3c0ffff640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3bf406ae70 0x7f3bf406d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc036000 tx=0x7f3bfc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:47.901+0000 7f3c0d7fa640 1 -- 172.21.15.97:0/3100479997 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c04054370 con 0x7f3c000047c0 2023-11-24T08:07:48.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.090+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c100675d0 con 0x7f3c000047c0 2023-11-24T08:07:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.091+0000 7f3c0d7fa640 1 -- 172.21.15.97:0/3100479997 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c04057990 con 0x7f3c000047c0 2023-11-24T08:07:48.093 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3bf406ae70 msgr2=0x7f3bf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3bf406ae70 0x7f3bf406d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc036000 tx=0x7f3bfc030000 comp rx=0 tx=0).stop 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 msgr2=0x7f3c10164970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c10164970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400e580 tx=0x7f3c0400ea40 comp rx=0 tx=0).stop 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 shutdown_connections 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3bf406ae70 0x7f3bf406d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c100ce070 0x7f3c100ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c1013f440 0x7f3c101611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 --2- 172.21.15.97:0/3100479997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c000047c0 0x7f3c10164970 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 >> 172.21.15.97:0/3100479997 conn(0x7f3c1006a800 msgr2=0x7f3c100afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 shutdown_connections 2023-11-24T08:07:48.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.094+0000 7f3c16eee640 1 -- 172.21.15.97:0/3100479997 wait complete. 2023-11-24T08:07:48.114 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:48.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.313+0000 7f7492bc9640 1 Processor -- start 2023-11-24T08:07:48.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.314+0000 7f7492bc9640 1 -- start start 2023-11-24T08:07:48.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.315+0000 7f7492bc9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f748c15c7f0 0x7f748c166120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.315+0000 7f7492bc9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0cf1d0 con 0x7f748c15b400 2023-11-24T08:07:48.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.315+0000 7f7492bc9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0cf420 con 0x7f748c15f990 2023-11-24T08:07:48.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.315+0000 7f7492bc9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0cf700 con 0x7f748c15c7f0 2023-11-24T08:07:48.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.315+0000 7f7491bc7640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f748c15b400 0x7f748c066270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60258/0 (socket says 172.21.15.97:60258) 2023-11-24T08:07:48.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.315+0000 7f7491bc7640 1 -- 172.21.15.97:0/2198192301 learned_addr learned my addr 172.21.15.97:0/2198192301 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:48.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.315+0000 7f74923c8640 1 --2- 172.21.15.97:0/2198192301 >> v2:172.21.15.97:3300/0 conn(0x7f748c15c7f0 0x7f748c166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.316+0000 7f7490bc5640 1 -- 172.21.15.97:0/2198192301 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255916097 0 0) 0x7f748c0cf1d0 con 0x7f748c15b400 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.316+0000 7f7490bc5640 1 -- 172.21.15.97:0/2198192301 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7478003520 con 0x7f748c15b400 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.316+0000 7f74923c8640 1 -- 172.21.15.97:0/2198192301 >> v1:172.21.15.183:6789/0 conn(0x7f748c15f990 legacy=0x7f748c06a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.316+0000 7f74923c8640 1 -- 172.21.15.97:0/2198192301 >> v1:172.21.15.97:6789/0 conn(0x7f748c15b400 legacy=0x7f748c066270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.316+0000 7f74923c8640 1 -- 172.21.15.97:0/2198192301 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0cf9e0 con 0x7f748c15c7f0 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.317+0000 7f74923c8640 1 --2- 172.21.15.97:0/2198192301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15c7f0 0x7f748c166120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7484009d90 tx=0x7f748402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93466041959bba0b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.317+0000 7f7490bc5640 1 -- 172.21.15.97:0/2198192301 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748402ccf0 con 0x7f748c15c7f0 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.317+0000 7f7490bc5640 1 -- 172.21.15.97:0/2198192301 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748402ce50 con 0x7f748c15c7f0 2023-11-24T08:07:48.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.317+0000 7f7490bc5640 1 -- 172.21.15.97:0/2198192301 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484034660 con 0x7f748c15c7f0 2023-11-24T08:07:48.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.318+0000 7f7492bc9640 1 -- 172.21.15.97:0/2198192301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15c7f0 msgr2=0x7f748c166120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.318+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2198192301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15c7f0 0x7f748c166120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7484009d90 tx=0x7f748402bf40 comp rx=0 tx=0).stop 2023-11-24T08:07:48.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.318+0000 7f7492bc9640 1 -- 172.21.15.97:0/2198192301 shutdown_connections 2023-11-24T08:07:48.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.318+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2198192301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15c7f0 0x7f748c166120 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.318+0000 7f7492bc9640 1 -- 172.21.15.97:0/2198192301 >> 172.21.15.97:0/2198192301 conn(0x7f748c071c00 msgr2=0x7f748c072010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.318+0000 7f7492bc9640 1 -- 172.21.15.97:0/2198192301 shutdown_connections 2023-11-24T08:07:48.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.318+0000 7f7492bc9640 1 -- 172.21.15.97:0/2198192301 wait complete. 2023-11-24T08:07:48.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.320+0000 7f7492bc9640 1 Processor -- start 2023-11-24T08:07:48.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.320+0000 7f7492bc9640 1 -- start start 2023-11-24T08:07:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7492bc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15b400 0x7f748c1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7492bc9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748c15c7f0 0x7f748c0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7492bc9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748c15f990 0x7f748c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7492bc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0b1e30 con 0x7f748c15b400 2023-11-24T08:07:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7492bc9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f4200 con 0x7f748c15c7f0 2023-11-24T08:07:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7492bc9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1f3d70 con 0x7f748c15f990 2023-11-24T08:07:48.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15b400 0x7f748c1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15b400 0x7f748c1576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41442/0 (socket says 172.21.15.97:41442) 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 -- 172.21.15.97:0/2861598889 learned_addr learned my addr 172.21.15.97:0/2861598889 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 -- 172.21.15.97:0/2861598889 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748c15f990 msgr2=0x7f748c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748c15f990 0x7f748c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 -- 172.21.15.97:0/2861598889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748c15c7f0 msgr2=0x7f748c0b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748c15c7f0 0x7f748c0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.321+0000 7f7491bc7640 1 -- 172.21.15.97:0/2861598889 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484009a70 con 0x7f748c15b400 2023-11-24T08:07:48.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.322+0000 7f7491bc7640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15b400 0x7f748c1576c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f748800c500 tx=0x7f748800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.322+0000 7f74827fc640 1 -- 172.21.15.97:0/2861598889 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488005ce0 con 0x7f748c15b400 2023-11-24T08:07:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.322+0000 7f74827fc640 1 -- 172.21.15.97:0/2861598889 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7488005e40 con 0x7f748c15b400 2023-11-24T08:07:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.322+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c1f31d0 con 0x7f748c15b400 2023-11-24T08:07:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.322+0000 7f74827fc640 1 -- 172.21.15.97:0/2861598889 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488007330 con 0x7f748c15b400 2023-11-24T08:07:48.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.322+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c158e80 con 0x7f748c15b400 2023-11-24T08:07:48.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.323+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c0d0430 con 0x7f748c15b400 2023-11-24T08:07:48.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.324+0000 7f74827fc640 1 -- 172.21.15.97:0/2861598889 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7488007490 con 0x7f748c15b400 2023-11-24T08:07:48.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.325+0000 7f74827fc640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f747006ae40 0x7f747006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.325+0000 7f74827fc640 1 -- 172.21.15.97:0/2861598889 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7488088d30 con 0x7f748c15b400 2023-11-24T08:07:48.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.325+0000 7f74913c6640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f747006ae40 0x7f747006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.326+0000 7f74913c6640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f747006ae40 0x7f747006d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f747c006fd0 tx=0x7f747c006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.330+0000 7f74827fc640 1 -- 172.21.15.97:0/2861598889 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7488053e10 con 0x7f748c15b400 2023-11-24T08:07:48.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.548+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f748c067450 con 0x7f748c15b400 2023-11-24T08:07:48.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.549+0000 7f74827fc640 1 -- 172.21.15.97:0/2861598889 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f7488017020 con 0x7f748c15b400 2023-11-24T08:07:48.551 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:48.551 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:07:48.551 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f747006ae40 msgr2=0x7f747006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f747006ae40 0x7f747006d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f747c006fd0 tx=0x7f747c006bc0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15b400 msgr2=0x7f748c1576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15b400 0x7f748c1576c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f748800c500 tx=0x7f748800c9c0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 shutdown_connections 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f747006ae40 0x7f747006d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748c15f990 0x7f748c06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748c15c7f0 0x7f748c0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 --2- 172.21.15.97:0/2861598889 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f748c15b400 0x7f748c1576c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 >> 172.21.15.97:0/2861598889 conn(0x7f748c071c00 msgr2=0x7f748c0c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 shutdown_connections 2023-11-24T08:07:48.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.552+0000 7f7492bc9640 1 -- 172.21.15.97:0/2861598889 wait complete. 2023-11-24T08:07:48.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:48.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.771+0000 7f0318e72640 1 Processor -- start 2023-11-24T08:07:48.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.771+0000 7f0318e72640 1 -- start start 2023-11-24T08:07:48.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f0318e72640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f031413e360 0x7f03140cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f0318e72640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 0x7f03140cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f0318e72640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031415c5f0 con 0x7f031413df80 2023-11-24T08:07:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f0318e72640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031406c470 con 0x7f031413e360 2023-11-24T08:07:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f0318e72640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031406c750 con 0x7f031415f9c0 2023-11-24T08:07:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f031259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f031413df80 0x7f031415bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60272/0 (socket says 172.21.15.97:60272) 2023-11-24T08:07:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f031259c640 1 -- 172.21.15.97:0/958066462 learned_addr learned my addr 172.21.15.97:0/958066462 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:48.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.773+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569615990 0 0) 0x7f031415c5f0 con 0x7f031413df80 2023-11-24T08:07:48.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f030bfff640 1 --2- 172.21.15.97:0/958066462 >> v2:172.21.15.183:3300/0 conn(0x7f031413e360 0x7f03140cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0300003520 con 0x7f031413df80 2023-11-24T08:07:48.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0312d9d640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 0x7f03140cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3313660376 0 0) 0x7f0300003520 con 0x7f031413df80 2023-11-24T08:07:48.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 msgr2=0x7f03140cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 0x7f03140cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 >> v2:172.21.15.183:3300/0 conn(0x7f031413e360 msgr2=0x7f03140cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 --2- 172.21.15.97:0/958066462 >> v2:172.21.15.183:3300/0 conn(0x7f031413e360 0x7f03140cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031406ca30 con 0x7f031413df80 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f0304001690 con 0x7f031413df80 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 >> v1:172.21.15.97:6789/0 conn(0x7f031413df80 legacy=0x7f031415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 0x7f0300003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0300003ef0 0x7f03000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0300004d00 0x7f0300005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031406c470 con 0x7f0300004d00 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031406c750 con 0x7f0300003ef0 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030000b9d0 con 0x7f031415f9c0 2023-11-24T08:07:48.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.774+0000 7f0312d9d640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0300004d00 0x7f0300005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f030bfff640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0300003ef0 0x7f03000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f031259c640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 0x7f0300003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f0312d9d640 1 -- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 msgr2=0x7f0300003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f0312d9d640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 0x7f0300003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f0312d9d640 1 -- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0300003ef0 msgr2=0x7f03000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f0312d9d640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0300003ef0 0x7f03000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f0312d9d640 1 -- 172.21.15.97:0/958066462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300003520 con 0x7f0300004d00 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f030bfff640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0300003ef0 0x7f03000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:48.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.775+0000 7f031259c640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f031415f9c0 0x7f0300003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.776+0000 7f0312d9d640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0300004d00 0x7f0300005180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f030c007330 tx=0x7f03000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4290b38149eb2c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.776+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c02cc80 con 0x7f0300004d00 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.776+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c02cde0 con 0x7f0300004d00 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.776+0000 7f0311d9b640 1 -- 172.21.15.97:0/958066462 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c034680 con 0x7f0300004d00 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.777+0000 7f0318e72640 1 -- 172.21.15.97:0/958066462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0300004d00 msgr2=0x7f0300005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.777+0000 7f0318e72640 1 --2- 172.21.15.97:0/958066462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0300004d00 0x7f0300005180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f030c007330 tx=0x7f03000057f0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.777+0000 7f0312d9d640 1 -- 172.21.15.97:0/958066462 reap_dead start 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.777+0000 7f0318e72640 1 -- 172.21.15.97:0/958066462 shutdown_connections 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.777+0000 7f0318e72640 1 -- 172.21.15.97:0/958066462 >> 172.21.15.97:0/958066462 conn(0x7f031406a800 msgr2=0x7f031406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.777+0000 7f0318e72640 1 -- 172.21.15.97:0/958066462 shutdown_connections 2023-11-24T08:07:48.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.777+0000 7f0318e72640 1 -- 172.21.15.97:0/958066462 wait complete. 2023-11-24T08:07:48.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.779+0000 7f0318e72640 1 Processor -- start 2023-11-24T08:07:48.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.779+0000 7f0318e72640 1 -- start start 2023-11-24T08:07:48.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0318e72640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0300004d00 0x7f031414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0318e72640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0314150a10 0x7f03140b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0318e72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0314150e50 0x7f03140b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0318e72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031414bbd0 con 0x7f0314150e50 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0318e72640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031414beb0 con 0x7f0314150a10 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0318e72640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031414c190 con 0x7f0300004d00 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0314150e50 0x7f03140b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0314150e50 0x7f03140b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41474/0 (socket says 172.21.15.97:41474) 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 -- 172.21.15.97:0/4183642259 learned_addr learned my addr 172.21.15.97:0/4183642259 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 -- 172.21.15.97:0/4183642259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0300004d00 msgr2=0x7f031414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0300004d00 0x7f031414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f030bfff640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0314150a10 0x7f03140b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 -- 172.21.15.97:0/4183642259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0314150a10 msgr2=0x7f03140b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0314150a10 0x7f03140b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.780+0000 7f0312d9d640 1 -- 172.21.15.97:0/4183642259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031414c470 con 0x7f0314150e50 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.781+0000 7f0312d9d640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0314150e50 0x7f03140b3230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f030c037040 tx=0x7f030c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.781+0000 7f030affd640 1 -- 172.21.15.97:0/4183642259 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c03e640 con 0x7f0314150e50 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.781+0000 7f030affd640 1 -- 172.21.15.97:0/4183642259 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c03e7a0 con 0x7f0314150e50 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.781+0000 7f030affd640 1 -- 172.21.15.97:0/4183642259 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c03eb10 con 0x7f0314150e50 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.781+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031414c750 con 0x7f0314150e50 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.781+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031414ce50 con 0x7f0314150e50 2023-11-24T08:07:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.782+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03140675d0 con 0x7f0314150e50 2023-11-24T08:07:48.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.783+0000 7f030affd640 1 -- 172.21.15.97:0/4183642259 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f030c034d50 con 0x7f0314150e50 2023-11-24T08:07:48.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.784+0000 7f030affd640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f02f406ae70 0x7f02f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:48.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.784+0000 7f030affd640 1 -- 172.21.15.97:0/4183642259 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f030c0ab900 con 0x7f0314150e50 2023-11-24T08:07:48.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.784+0000 7f031259c640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f02f406ae70 0x7f02f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:48.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.785+0000 7f031259c640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f02f406ae70 0x7f02f406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f03040017c0 tx=0x7f0304009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:48.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.788+0000 7f030affd640 1 -- 172.21.15.97:0/4183642259 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f030c076940 con 0x7f0314150e50 2023-11-24T08:07:48.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.965+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f031406df00 con 0x7f0314150e50 2023-11-24T08:07:48.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.968+0000 7f030affd640 1 -- 172.21.15.97:0/4183642259 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f030c039090 con 0x7f0314150e50 2023-11-24T08:07:48.970 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:48.970 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f02f406ae70 msgr2=0x7f02f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f02f406ae70 0x7f02f406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f03040017c0 tx=0x7f0304009040 comp rx=0 tx=0).stop 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0314150e50 msgr2=0x7f03140b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0314150e50 0x7f03140b3230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f030c037040 tx=0x7f030c004ab0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 shutdown_connections 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f02f406ae70 0x7f02f406d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0314150e50 0x7f03140b3230 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0314150a10 0x7f03140b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 --2- 172.21.15.97:0/4183642259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0300004d00 0x7f031414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 >> 172.21.15.97:0/4183642259 conn(0x7f031406a800 msgr2=0x7f031415dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 shutdown_connections 2023-11-24T08:07:48.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:48.971+0000 7f0318e72640 1 -- 172.21.15.97:0/4183642259 wait complete. 2023-11-24T08:07:48.992 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:07:48.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:49.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.178+0000 7fc1c6c87640 1 Processor -- start 2023-11-24T08:07:49.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.178+0000 7fc1c6c87640 1 -- start start 2023-11-24T08:07:49.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c6c87640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc1c00ae5a0 0x7fc1c015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c6c87640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 0x7fc1c00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c6c87640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c0070c40 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c6c87640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c0071450 con 0x7fc1c00ae5a0 2023-11-24T08:07:49.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c6c87640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00cfc60 con 0x7fc1c00cf290 2023-11-24T08:07:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c4a23640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc1c00ae5a0 0x7fc1c015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c4a23640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc1c00ae5a0 0x7fc1c015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41490/0 (socket says 172.21.15.97:41490) 2023-11-24T08:07:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.180+0000 7fc1c4a23640 1 -- 172.21.15.97:0/1173006324 learned_addr learned my addr 172.21.15.97:0/1173006324 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:49.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.181+0000 7fc1c5224640 1 --2- 172.21.15.97:0/1173006324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 0x7fc1c00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.181+0000 7fc1c4a23640 1 -- 172.21.15.97:0/1173006324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 msgr2=0x7fc1c00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.181+0000 7fc1c4a23640 1 --2- 172.21.15.97:0/1173006324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 0x7fc1c00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.181+0000 7fc1c4a23640 1 -- 172.21.15.97:0/1173006324 >> v1:172.21.15.183:6789/0 conn(0x7fc1c00b3ae0 legacy=0x7fc1c006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.181+0000 7fc1c4a23640 1 -- 172.21.15.97:0/1173006324 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c006c470 con 0x7fc1c00ae5a0 2023-11-24T08:07:49.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.183+0000 7fc1c4a23640 1 --2- 172.21.15.97:0/1173006324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00ae5a0 0x7fc1c015e430 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ce7abbb87f1a4b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.183+0000 7fc1bf7fe640 1 -- 172.21.15.97:0/1173006324 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b402f840 con 0x7fc1c00ae5a0 2023-11-24T08:07:49.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.183+0000 7fc1bf7fe640 1 -- 172.21.15.97:0/1173006324 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b402f9a0 con 0x7fc1c00ae5a0 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.183+0000 7fc1bf7fe640 1 -- 172.21.15.97:0/1173006324 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b402fd30 con 0x7fc1c00ae5a0 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.183+0000 7fc1c6c87640 1 -- 172.21.15.97:0/1173006324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00ae5a0 msgr2=0x7fc1c015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.183+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/1173006324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00ae5a0 0x7fc1c015e430 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b402ba20 comp rx=0 tx=0).stop 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.184+0000 7fc1c6c87640 1 -- 172.21.15.97:0/1173006324 shutdown_connections 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.184+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/1173006324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 0x7fc1c00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.184+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/1173006324 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00ae5a0 0x7fc1c015e430 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.184+0000 7fc1c6c87640 1 -- 172.21.15.97:0/1173006324 >> 172.21.15.97:0/1173006324 conn(0x7fc1c006a800 msgr2=0x7fc1c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.184+0000 7fc1c6c87640 1 -- 172.21.15.97:0/1173006324 shutdown_connections 2023-11-24T08:07:49.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.184+0000 7fc1c6c87640 1 -- 172.21.15.97:0/1173006324 wait complete. 2023-11-24T08:07:49.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.186+0000 7fc1c6c87640 1 Processor -- start 2023-11-24T08:07:49.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.186+0000 7fc1c6c87640 1 -- start start 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1c6c87640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c00ae5a0 0x7fc1c0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1c6c87640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00b3ae0 0x7fc1c0153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1c6c87640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 0x7fc1c0145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1c6c87640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c0157a10 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1c6c87640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c0157cf0 con 0x7fc1c00ae5a0 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1c6c87640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c0157fd0 con 0x7fc1c00cf290 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00b3ae0 0x7fc1c0153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00b3ae0 0x7fc1c0153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41504/0 (socket says 172.21.15.97:41504) 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 -- 172.21.15.97:0/3922976569 learned_addr learned my addr 172.21.15.97:0/3922976569 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1c4a23640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c00ae5a0 0x7fc1c0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 -- 172.21.15.97:0/3922976569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 msgr2=0x7fc1c0145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 0x7fc1c0145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 -- 172.21.15.97:0/3922976569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c00ae5a0 msgr2=0x7fc1c0158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c00ae5a0 0x7fc1c0158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.187+0000 7fc1bffff640 1 -- 172.21.15.97:0/3922976569 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40094d0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.188+0000 7fc1bffff640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00b3ae0 0x7fc1c0153300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c450 tx=0x7fc1ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.188+0000 7fc1bd7fa640 1 -- 172.21.15.97:0/3922976569 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0052d0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.188+0000 7fc1bd7fa640 1 -- 172.21.15.97:0/3922976569 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac005430 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.188+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c01582b0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.188+0000 7fc1bd7fa640 1 -- 172.21.15.97:0/3922976569 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac012870 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.188+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c0150620 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.189+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c01587d0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.190+0000 7fc1bd7fa640 1 -- 172.21.15.97:0/3922976569 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1ac0129d0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.191+0000 7fc1bd7fa640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1a406ae40 0x7fc1a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.191+0000 7fc1bd7fa640 1 -- 172.21.15.97:0/3922976569 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc1ac089130 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.192+0000 7fc1c4a23640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1a406ae40 0x7fc1a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.192+0000 7fc1c4a23640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1a406ae40 0x7fc1a406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4036000 tx=0x7fc1b4039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.195+0000 7fc1bd7fa640 1 -- 172.21.15.97:0/3922976569 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1c01587d0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.426+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1c01587d0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.427+0000 7fc1bd7fa640 1 -- 172.21.15.97:0/3922976569 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fc1c01587d0 con 0x7fc1c00b3ae0 2023-11-24T08:07:49.429 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:49.429 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:07:49.429 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:07:49.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.429+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1a406ae40 msgr2=0x7fc1a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.429+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1a406ae40 0x7fc1a406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4036000 tx=0x7fc1b4039040 comp rx=0 tx=0).stop 2023-11-24T08:07:49.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.429+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00b3ae0 msgr2=0x7fc1c0153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.429+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00b3ae0 0x7fc1c0153300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c450 tx=0x7fc1ac00c910 comp rx=0 tx=0).stop 2023-11-24T08:07:49.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 shutdown_connections 2023-11-24T08:07:49.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1a406ae40 0x7fc1a406d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c00cf290 0x7fc1c0145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1c00b3ae0 0x7fc1c0153300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 --2- 172.21.15.97:0/3922976569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c00ae5a0 0x7fc1c0158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 >> 172.21.15.97:0/3922976569 conn(0x7fc1c006a800 msgr2=0x7fc1c0160f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 shutdown_connections 2023-11-24T08:07:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.430+0000 7fc1c6c87640 1 -- 172.21.15.97:0/3922976569 wait complete. 2023-11-24T08:07:49.450 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:49.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.658+0000 7fce799b0640 1 Processor -- start 2023-11-24T08:07:49.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.658+0000 7fce799b0640 1 -- start start 2023-11-24T08:07:49.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.659+0000 7fce799b0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fce740cf9a0 0x7fce7415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.659+0000 7fce799b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce7415e1e0 0x7fce740702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.659+0000 7fce799b0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740b1ee0 con 0x7fce74143ae0 2023-11-24T08:07:49.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.659+0000 7fce799b0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce740b2780 con 0x7fce740cf9a0 2023-11-24T08:07:49.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.659+0000 7fce799b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7415e990 con 0x7fce7415e1e0 2023-11-24T08:07:49.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.660+0000 7fce727fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fce740cf9a0 0x7fce7415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.660+0000 7fce737fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce7415e1e0 0x7fce740702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.660+0000 7fce727fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fce740cf9a0 0x7fce7415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:46078/0 (socket says 172.21.15.97:46078) 2023-11-24T08:07:49.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.660+0000 7fce727fc640 1 -- 172.21.15.97:0/4242241392 learned_addr learned my addr 172.21.15.97:0/4242241392 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:49.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.661+0000 7fce727fc640 1 -- 172.21.15.97:0/4242241392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce7415e1e0 msgr2=0x7fce740702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.661+0000 7fce727fc640 1 --2- 172.21.15.97:0/4242241392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce7415e1e0 0x7fce740702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.661+0000 7fce727fc640 1 -- 172.21.15.97:0/4242241392 >> v1:172.21.15.183:6789/0 conn(0x7fce74143ae0 legacy=0x7fce740cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.661+0000 7fce727fc640 1 -- 172.21.15.97:0/4242241392 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740b2130 con 0x7fce740cf9a0 2023-11-24T08:07:49.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.662+0000 7fce727fc640 1 --2- 172.21.15.97:0/4242241392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce740cf9a0 0x7fce7415dca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce680098a0 tx=0x7fce6802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31a53dc6e86166bf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.663+0000 7fce71ffb640 1 -- 172.21.15.97:0/4242241392 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68030840 con 0x7fce740cf9a0 2023-11-24T08:07:49.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.663+0000 7fce71ffb640 1 -- 172.21.15.97:0/4242241392 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce680309a0 con 0x7fce740cf9a0 2023-11-24T08:07:49.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.663+0000 7fce71ffb640 1 -- 172.21.15.97:0/4242241392 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68030d30 con 0x7fce740cf9a0 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.663+0000 7fce799b0640 1 -- 172.21.15.97:0/4242241392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce740cf9a0 msgr2=0x7fce7415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.663+0000 7fce799b0640 1 --2- 172.21.15.97:0/4242241392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce740cf9a0 0x7fce7415dca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce680098a0 tx=0x7fce6802b980 comp rx=0 tx=0).stop 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.664+0000 7fce799b0640 1 -- 172.21.15.97:0/4242241392 shutdown_connections 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.664+0000 7fce799b0640 1 --2- 172.21.15.97:0/4242241392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce7415e1e0 0x7fce740702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.664+0000 7fce799b0640 1 --2- 172.21.15.97:0/4242241392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce740cf9a0 0x7fce7415dca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.664+0000 7fce799b0640 1 -- 172.21.15.97:0/4242241392 >> 172.21.15.97:0/4242241392 conn(0x7fce7406a800 msgr2=0x7fce7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.664+0000 7fce799b0640 1 -- 172.21.15.97:0/4242241392 shutdown_connections 2023-11-24T08:07:49.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.664+0000 7fce799b0640 1 -- 172.21.15.97:0/4242241392 wait complete. 2023-11-24T08:07:49.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.665+0000 7fce799b0640 1 Processor -- start 2023-11-24T08:07:49.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.666+0000 7fce799b0640 1 -- start start 2023-11-24T08:07:49.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.666+0000 7fce799b0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce740cf9a0 0x7fce74159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.666+0000 7fce799b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce74143ae0 0x7fce7415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.666+0000 7fce799b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce7415e1e0 0x7fce7415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.666+0000 7fce799b0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741f2a70 con 0x7fce740cf9a0 2023-11-24T08:07:49.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.666+0000 7fce799b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741ef9a0 con 0x7fce7415e1e0 2023-11-24T08:07:49.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.666+0000 7fce799b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce741f2e90 con 0x7fce74143ae0 2023-11-24T08:07:49.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.667+0000 7fce72ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce740cf9a0 0x7fce74159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.667+0000 7fce72ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce740cf9a0 0x7fce74159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41506/0 (socket says 172.21.15.97:41506) 2023-11-24T08:07:49.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.667+0000 7fce72ffd640 1 -- 172.21.15.97:0/1688831985 learned_addr learned my addr 172.21.15.97:0/1688831985 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:49.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.667+0000 7fce727fc640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce74143ae0 0x7fce7415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.667+0000 7fce737fe640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce7415e1e0 0x7fce7415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce72ffd640 1 -- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce74143ae0 msgr2=0x7fce7415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce72ffd640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce74143ae0 0x7fce7415a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce72ffd640 1 -- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce7415e1e0 msgr2=0x7fce7415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce72ffd640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce7415e1e0 0x7fce7415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce72ffd640 1 -- 172.21.15.97:0/1688831985 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680094d0 con 0x7fce740cf9a0 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce727fc640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce74143ae0 0x7fce7415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce737fe640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce7415e1e0 0x7fce7415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce72ffd640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce740cf9a0 0x7fce74159b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c450 tx=0x7fce6400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce5bfff640 1 -- 172.21.15.97:0/1688831985 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640052d0 con 0x7fce740cf9a0 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce5bfff640 1 -- 172.21.15.97:0/1688831985 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64005430 con 0x7fce740cf9a0 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce5bfff640 1 -- 172.21.15.97:0/1688831985 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64012870 con 0x7fce740cf9a0 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.668+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce741f20d0 con 0x7fce740cf9a0 2023-11-24T08:07:49.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.669+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce741f2690 con 0x7fce740cf9a0 2023-11-24T08:07:49.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.670+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce740675d0 con 0x7fce740cf9a0 2023-11-24T08:07:49.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.671+0000 7fce5bfff640 1 -- 172.21.15.97:0/1688831985 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce640129d0 con 0x7fce740cf9a0 2023-11-24T08:07:49.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.671+0000 7fce5bfff640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce6006ae70 0x7fce6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.672+0000 7fce5bfff640 1 -- 172.21.15.97:0/1688831985 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fce64089190 con 0x7fce740cf9a0 2023-11-24T08:07:49.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.672+0000 7fce727fc640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce6006ae70 0x7fce6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.672+0000 7fce727fc640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce6006ae70 0x7fce6006d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce68036000 tx=0x7fce68008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.676+0000 7fce5bfff640 1 -- 172.21.15.97:0/1688831985 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce640541c0 con 0x7fce740cf9a0 2023-11-24T08:07:49.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.898+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce740cecc0 con 0x7fce740cf9a0 2023-11-24T08:07:49.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.899+0000 7fce5bfff640 1 -- 172.21.15.97:0/1688831985 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fce640577e0 con 0x7fce740cf9a0 2023-11-24T08:07:49.901 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:49.901 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/870762325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":870762325},{"type":"v1","addr":"172.21.15.183:6835","nonce":870762325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/2737970542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2737970542},{"type":"v1","addr":"172.21.15.97:6836","nonce":2737970542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/2245825131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":2245825131},{"type":"v1","addr":"172.21.15.97:6837","nonce":2245825131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:06:42.070911+0000","modified":"2023-11-24T08:06:45.090102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6833/738142400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":738142400},{"type":"v1","addr":"172.21.15.183:6833","nonce":738142400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:07:49.901 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-11-24T08:07:49.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.901+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce6006ae70 msgr2=0x7fce6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.901+0000 7fce799b0640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce6006ae70 0x7fce6006d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce68036000 tx=0x7fce68008030 comp rx=0 tx=0).stop 2023-11-24T08:07:49.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.901+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce740cf9a0 msgr2=0x7fce74159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.901+0000 7fce799b0640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce740cf9a0 0x7fce74159b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c450 tx=0x7fce6400c910 comp rx=0 tx=0).stop 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 shutdown_connections 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fce6006ae70 0x7fce6006d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce7415e1e0 0x7fce7415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce74143ae0 0x7fce7415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 --2- 172.21.15.97:0/1688831985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce740cf9a0 0x7fce74159b20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 >> 172.21.15.97:0/1688831985 conn(0x7fce7406a800 msgr2=0x7fce7415b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 shutdown_connections 2023-11-24T08:07:49.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:49.902+0000 7fce799b0640 1 -- 172.21.15.97:0/1688831985 wait complete. 2023-11-24T08:07:49.921 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.126+0000 7fa6fe415640 1 Processor -- start 2023-11-24T08:07:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.126+0000 7fa6fe415640 1 -- start start 2023-11-24T08:07:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6fe415640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa6f813e360 0x7fa6f80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6fe415640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6fe415640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f815c5f0 con 0x7fa6f813df80 2023-11-24T08:07:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6fe415640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f806c470 con 0x7fa6f813e360 2023-11-24T08:07:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6fe415640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f806c750 con 0x7fa6f815f9c0 2023-11-24T08:07:50.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6effff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa6f813e360 0x7fa6f80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6effff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa6f813e360 0x7fa6f80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:46104/0 (socket says 172.21.15.97:46104) 2023-11-24T08:07:50.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6effff640 1 -- 172.21.15.97:0/3377545728 learned_addr learned my addr 172.21.15.97:0/3377545728 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:50.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.128+0000 7fa6fc9b2640 1 --2- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.129+0000 7fa6effff640 1 -- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 msgr2=0x7fa6f80cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.129+0000 7fa6effff640 1 --2- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f80cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.129+0000 7fa6effff640 1 -- 172.21.15.97:0/3377545728 >> v1:172.21.15.183:6789/0 conn(0x7fa6f813df80 legacy=0x7fa6f815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.129+0000 7fa6effff640 1 -- 172.21.15.97:0/3377545728 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f806ca30 con 0x7fa6f813e360 2023-11-24T08:07:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.131+0000 7fa6effff640 1 --2- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813e360 0x7fa6f80cf290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009870 tx=0x7fa6e002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1deb7ab5a5dcfaf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.131+0000 7fa6f77fe640 1 -- 172.21.15.97:0/3377545728 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0030840 con 0x7fa6f813e360 2023-11-24T08:07:50.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.131+0000 7fa6f77fe640 1 -- 172.21.15.97:0/3377545728 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e00309a0 con 0x7fa6f813e360 2023-11-24T08:07:50.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.131+0000 7fa6f77fe640 1 -- 172.21.15.97:0/3377545728 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0030d30 con 0x7fa6f813e360 2023-11-24T08:07:50.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 -- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813e360 msgr2=0x7fa6f80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813e360 0x7fa6f80cf290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009870 tx=0x7fa6e002b980 comp rx=0 tx=0).stop 2023-11-24T08:07:50.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 -- 172.21.15.97:0/3377545728 shutdown_connections 2023-11-24T08:07:50.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3377545728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813e360 0x7fa6f80cf290 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 -- 172.21.15.97:0/3377545728 >> 172.21.15.97:0/3377545728 conn(0x7fa6f806a800 msgr2=0x7fa6f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 -- 172.21.15.97:0/3377545728 shutdown_connections 2023-11-24T08:07:50.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.132+0000 7fa6fe415640 1 -- 172.21.15.97:0/3377545728 wait complete. 2023-11-24T08:07:50.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.134+0000 7fa6fe415640 1 Processor -- start 2023-11-24T08:07:50.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.135+0000 7fa6fe415640 1 -- start start 2023-11-24T08:07:50.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6fe415640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813df80 0x7fa6f81e5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6fe415640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6f813e360 0x7fa6f80b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6fe415640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6fe415640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f81ea750 con 0x7fa6f813e360 2023-11-24T08:07:50.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6fe415640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8152290 con 0x7fa6f813df80 2023-11-24T08:07:50.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6fe415640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8152570 con 0x7fa6f815f9c0 2023-11-24T08:07:50.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6effff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6f813e360 0x7fa6f80b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6effff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6f813e360 0x7fa6f80b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41514/0 (socket says 172.21.15.97:41514) 2023-11-24T08:07:50.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6effff640 1 -- 172.21.15.97:0/3698481203 learned_addr learned my addr 172.21.15.97:0/3698481203 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6f7fff640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813df80 0x7fa6f81e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.136+0000 7fa6fc9b2640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6effff640 1 -- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 msgr2=0x7fa6f814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6effff640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6effff640 1 -- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813df80 msgr2=0x7fa6f81e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6effff640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813df80 0x7fa6f81e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6effff640 1 -- 172.21.15.97:0/3698481203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00094d0 con 0x7fa6f813e360 2023-11-24T08:07:50.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6effff640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6f813e360 0x7fa6f80b0050 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0000c00 tx=0x7fa6e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6f57fa640 1 -- 172.21.15.97:0/3698481203 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0039c90 con 0x7fa6f813e360 2023-11-24T08:07:50.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6f57fa640 1 -- 172.21.15.97:0/3698481203 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0039df0 con 0x7fa6f813e360 2023-11-24T08:07:50.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6f57fa640 1 -- 172.21.15.97:0/3698481203 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0043640 con 0x7fa6f813e360 2023-11-24T08:07:50.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.137+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f8152850 con 0x7fa6f813e360 2023-11-24T08:07:50.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.138+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f8152e10 con 0x7fa6f813e360 2023-11-24T08:07:50.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.139+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f80675d0 con 0x7fa6f813e360 2023-11-24T08:07:50.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.140+0000 7fa6f57fa640 1 -- 172.21.15.97:0/3698481203 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6e00437a0 con 0x7fa6f813e360 2023-11-24T08:07:50.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.141+0000 7fa6f57fa640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa6d806ae40 0x7fa6d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.141+0000 7fa6f57fa640 1 -- 172.21.15.97:0/3698481203 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa6e003e070 con 0x7fa6f813e360 2023-11-24T08:07:50.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.142+0000 7fa6f7fff640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa6d806ae40 0x7fa6d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.142+0000 7fa6f7fff640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa6d806ae40 0x7fa6d806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8000f60 tx=0x7fa6e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.146+0000 7fa6f57fa640 1 -- 172.21.15.97:0/3698481203 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6e00777d0 con 0x7fa6f813e360 2023-11-24T08:07:50.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.339+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6f815e870 con 0x7fa6f813e360 2023-11-24T08:07:50.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.341+0000 7fa6f57fa640 1 -- 172.21.15.97:0/3698481203 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16754 (secure 0 0 0) 0x7fa6e007adf0 con 0x7fa6f813e360 2023-11-24T08:07:50.343 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:50.343 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:29.172258+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:06:39.685561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:06:41.081821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa6d806ae40 msgr2=0x7fa6d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa6d806ae40 0x7fa6d806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8000f60 tx=0x7fa6e8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6f813e360 msgr2=0x7fa6f80b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6f813e360 0x7fa6f80b0050 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0000c00 tx=0x7fa6e0004730 comp rx=0 tx=0).stop 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 shutdown_connections 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa6d806ae40 0x7fa6d806d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6f815f9c0 0x7fa6f814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6f813e360 0x7fa6f80b0050 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 --2- 172.21.15.97:0/3698481203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6f813df80 0x7fa6f81e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 >> 172.21.15.97:0/3698481203 conn(0x7fa6f806a800 msgr2=0x7fa6f815eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 shutdown_connections 2023-11-24T08:07:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.344+0000 7fa6fe415640 1 -- 172.21.15.97:0/3698481203 wait complete. 2023-11-24T08:07:50.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:07:50.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.578+0000 7f8cbcb06640 1 Processor -- start 2023-11-24T08:07:50.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.578+0000 7f8cbcb06640 1 -- start start 2023-11-24T08:07:50.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.580+0000 7f8cbcb06640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cb815afb0 0x7f8cb813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.580+0000 7f8cbcb06640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813fae0 0x7f8cb80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.580+0000 7f8cbcb06640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb813ff30 con 0x7f8cb813cfa0 2023-11-24T08:07:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.580+0000 7f8cbcb06640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80cdc40 con 0x7f8cb815afb0 2023-11-24T08:07:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.580+0000 7f8cbcb06640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80cdec0 con 0x7f8cb813fae0 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb6ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cb815afb0 0x7f8cb813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb6ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cb815afb0 0x7f8cb813f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:46116/0 (socket says 172.21.15.97:46116) 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/3519904853 learned_addr learned my addr 172.21.15.97:0/3519904853 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb7fff640 1 --2- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813fae0 0x7f8cb80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813fae0 msgr2=0x7f8cb80b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb6ffd640 1 --2- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813fae0 0x7f8cb80b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/3519904853 >> v1:172.21.15.183:6789/0 conn(0x7f8cb813cfa0 legacy=0x7f8cb80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.581+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/3519904853 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80ce1a0 con 0x7f8cb815afb0 2023-11-24T08:07:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.582+0000 7f8cb6ffd640 1 --2- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 0x7f8cb813f5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1dc7d5c7dfbc62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.583+0000 7f8cb67fc640 1 -- 172.21.15.97:0/3519904853 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac031640 con 0x7f8cb815afb0 2023-11-24T08:07:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.583+0000 7f8cb67fc640 1 -- 172.21.15.97:0/3519904853 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac0317a0 con 0x7f8cb815afb0 2023-11-24T08:07:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.583+0000 7f8cb67fc640 1 -- 172.21.15.97:0/3519904853 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac031b30 con 0x7f8cb815afb0 2023-11-24T08:07:50.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 -- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 msgr2=0x7f8cb813f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 0x7f8cb813f5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 -- 172.21.15.97:0/3519904853 shutdown_connections 2023-11-24T08:07:50.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813fae0 0x7f8cb80b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/3519904853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 0x7f8cb813f5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 -- 172.21.15.97:0/3519904853 >> 172.21.15.97:0/3519904853 conn(0x7f8cb806a800 msgr2=0x7f8cb806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 -- 172.21.15.97:0/3519904853 shutdown_connections 2023-11-24T08:07:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.584+0000 7f8cbcb06640 1 -- 172.21.15.97:0/3519904853 wait complete. 2023-11-24T08:07:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.586+0000 7f8cbcb06640 1 Processor -- start 2023-11-24T08:07:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.586+0000 7f8cbcb06640 1 -- start start 2023-11-24T08:07:50.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cbcb06640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813cfa0 0x7f8cb8158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cbcb06640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb813fae0 0x7f8cb8153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cbcb06640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 0x7f8cb8155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cbcb06640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8158d90 con 0x7f8cb813fae0 2023-11-24T08:07:50.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cbcb06640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb81541c0 con 0x7f8cb815afb0 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cbcb06640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8157830 con 0x7f8cb813cfa0 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb813fae0 0x7f8cb8153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb813fae0 0x7f8cb8153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41528/0 (socket says 172.21.15.97:41528) 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/457083825 learned_addr learned my addr 172.21.15.97:0/457083825 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb77fe640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813cfa0 0x7f8cb8158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813cfa0 msgr2=0x7f8cb8158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813cfa0 0x7f8cb8158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb7fff640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 0x7f8cb8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 msgr2=0x7f8cb8155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 0x7f8cb8155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.588+0000 7f8cb6ffd640 1 -- 172.21.15.97:0/457083825 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0094d0 con 0x7f8cb813fae0 2023-11-24T08:07:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.589+0000 7f8cb77fe640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813cfa0 0x7f8cb8158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.589+0000 7f8cb6ffd640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb813fae0 0x7f8cb8153c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8cac000c00 tx=0x7f8cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.589+0000 7f8c9ffff640 1 -- 172.21.15.97:0/457083825 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac03a930 con 0x7f8cb813fae0 2023-11-24T08:07:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.589+0000 7f8c9ffff640 1 -- 172.21.15.97:0/457083825 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac03aa90 con 0x7f8cb813fae0 2023-11-24T08:07:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.589+0000 7f8c9ffff640 1 -- 172.21.15.97:0/457083825 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac03ae40 con 0x7f8cb813fae0 2023-11-24T08:07:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.589+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb8157550 con 0x7f8cb813fae0 2023-11-24T08:07:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.589+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb81589b0 con 0x7f8cb813fae0 2023-11-24T08:07:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.591+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb8158b40 con 0x7f8cb813fae0 2023-11-24T08:07:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.591+0000 7f8c9ffff640 1 -- 172.21.15.97:0/457083825 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cac02f050 con 0x7f8cb813fae0 2023-11-24T08:07:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.592+0000 7f8c9ffff640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8ca406ae40 0x7f8ca406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.592+0000 7f8c9ffff640 1 -- 172.21.15.97:0/457083825 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8cac0ab450 con 0x7f8cb813fae0 2023-11-24T08:07:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.593+0000 7f8cb77fe640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8ca406ae40 0x7f8ca406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.593+0000 7f8cb77fe640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8ca406ae40 0x7f8ca406d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000f60 tx=0x7f8ca8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.597+0000 7f8c9ffff640 1 -- 172.21.15.97:0/457083825 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cac076470 con 0x7f8cb813fae0 2023-11-24T08:07:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.823+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8cb8067450 con 0x7f8cb813fae0 2023-11-24T08:07:50.826 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-11-24T08:07:50.824+0000 7fe28353b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:07:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.827+0000 7f8c9ffff640 1 -- 172.21.15.97:0/457083825 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8cac079a90 con 0x7f8cb813fae0 2023-11-24T08:07:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:07:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.830+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8ca406ae40 msgr2=0x7f8ca406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.830+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8ca406ae40 0x7f8ca406d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000f60 tx=0x7f8ca8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.830+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb813fae0 msgr2=0x7f8cb8153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.830+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb813fae0 0x7f8cb8153c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8cac000c00 tx=0x7f8cac0046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.831+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 shutdown_connections 2023-11-24T08:07:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.831+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8ca406ae40 0x7f8ca406d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.831+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb815afb0 0x7f8cb8155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.831+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb813fae0 0x7f8cb8153c80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.831+0000 7f8cbcb06640 1 --2- 172.21.15.97:0/457083825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb813cfa0 0x7f8cb8158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.831+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 >> 172.21.15.97:0/457083825 conn(0x7f8cb806a800 msgr2=0x7f8cb806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.831+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 shutdown_connections 2023-11-24T08:07:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:50.832+0000 7f8cbcb06640 1 -- 172.21.15.97:0/457083825 wait complete. 2023-11-24T08:07:50.851 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:07:50.858 INFO:tasks.ceph.mds.b.smithi183.stderr: -3639> 2023-11-24T08:06:45.689+0000 7f8bc6b3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:07:50.931 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-11-24T08:07:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.043+0000 7f51ac890640 1 Processor -- start 2023-11-24T08:07:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.043+0000 7f51ac890640 1 -- start start 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f51ac890640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80ae5a0 0x7f51a815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f51ac890640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f51a80b3ae0 0x7f51a806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f51ac890640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a8070c40 con 0x7f51a806d120 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f51ac890640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a8071450 con 0x7f51a80b3ae0 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f51ac890640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a806c470 con 0x7f51a80ae5a0 2023-11-24T08:07:51.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f519ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f51a80b3ae0 0x7f51a806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f519ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f51a80b3ae0 0x7f51a806cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41530/0 (socket says 172.21.15.97:41530) 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f519ffff640 1 -- 172.21.15.97:0/13013213 learned_addr learned my addr 172.21.15.97:0/13013213 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:51.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.045+0000 7f51a659c640 1 --2- 172.21.15.97:0/13013213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80ae5a0 0x7f51a815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.046+0000 7f519ffff640 1 -- 172.21.15.97:0/13013213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80ae5a0 msgr2=0x7f51a815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.046+0000 7f519ffff640 1 --2- 172.21.15.97:0/13013213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80ae5a0 0x7f51a815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.046+0000 7f519ffff640 1 -- 172.21.15.97:0/13013213 >> v1:172.21.15.97:6789/0 conn(0x7f51a806d120 legacy=0x7f51a80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.046+0000 7f519ffff640 1 -- 172.21.15.97:0/13013213 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a806c750 con 0x7f51a80b3ae0 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.046+0000 7f51a5d9b640 1 -- 172.21.15.97:0/13013213 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379413870 0 0) 0x7f51a8070c40 con 0x7f51a806d120 2023-11-24T08:07:51.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.047+0000 7f519ffff640 1 --2- 172.21.15.97:0/13013213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80b3ae0 0x7f51a806cbe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5190009870 tx=0x7f519002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d4c46a32055662 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.047+0000 7f51a5d9b640 1 -- 172.21.15.97:0/13013213 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190030840 con 0x7f51a80b3ae0 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.047+0000 7f51a5d9b640 1 -- 172.21.15.97:0/13013213 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51900309a0 con 0x7f51a80b3ae0 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.047+0000 7f51a5d9b640 1 -- 172.21.15.97:0/13013213 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190030d30 con 0x7f51a80b3ae0 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 -- 172.21.15.97:0/13013213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80b3ae0 msgr2=0x7f51a806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 --2- 172.21.15.97:0/13013213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80b3ae0 0x7f51a806cbe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5190009870 tx=0x7f519002b980 comp rx=0 tx=0).stop 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 -- 172.21.15.97:0/13013213 shutdown_connections 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 --2- 172.21.15.97:0/13013213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80b3ae0 0x7f51a806cbe0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 --2- 172.21.15.97:0/13013213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80ae5a0 0x7f51a815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 -- 172.21.15.97:0/13013213 >> 172.21.15.97:0/13013213 conn(0x7f51a806a800 msgr2=0x7f51a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 -- 172.21.15.97:0/13013213 shutdown_connections 2023-11-24T08:07:51.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.048+0000 7f51ac890640 1 -- 172.21.15.97:0/13013213 wait complete. 2023-11-24T08:07:51.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.050+0000 7f51ac890640 1 Processor -- start 2023-11-24T08:07:51.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.050+0000 7f51ac890640 1 -- start start 2023-11-24T08:07:51.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f51ac890640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a806d120 0x7f51a80ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f51ac890640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80ae5a0 0x7f51a80cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f51ac890640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80b3ae0 0x7f51a8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f51ac890640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a81f2d00 con 0x7f51a80ae5a0 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f51ac890640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80cc240 con 0x7f51a806d120 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f51ac890640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80cc510 con 0x7f51a80b3ae0 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f519ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80ae5a0 0x7f51a80cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f519ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80ae5a0 0x7f51a80cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41536/0 (socket says 172.21.15.97:41536) 2023-11-24T08:07:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.051+0000 7f519ffff640 1 -- 172.21.15.97:0/2675876893 learned_addr learned my addr 172.21.15.97:0/2675876893 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f51a659c640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a806d120 0x7f51a80ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519ffff640 1 -- 172.21.15.97:0/2675876893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80b3ae0 msgr2=0x7f51a8157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519ffff640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80b3ae0 0x7f51a8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519ffff640 1 -- 172.21.15.97:0/2675876893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a806d120 msgr2=0x7f51a80ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519ffff640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a806d120 0x7f51a80ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519ffff640 1 -- 172.21.15.97:0/2675876893 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900094d0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519ffff640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80ae5a0 0x7f51a80cbd00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5190009870 tx=0x7f5190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519effd640 1 -- 172.21.15.97:0/2675876893 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190039c90 con 0x7f51a80ae5a0 2023-11-24T08:07:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519effd640 1 -- 172.21.15.97:0/2675876893 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190039df0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f519effd640 1 -- 172.21.15.97:0/2675876893 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190043640 con 0x7f51a80ae5a0 2023-11-24T08:07:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.052+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a80cc7f0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.053+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a80ccdb0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.053+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a81f2eb0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.054+0000 7f519effd640 1 -- 172.21.15.97:0/2675876893 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51900437a0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.055+0000 7f519effd640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f518806ae40 0x7f518806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.055+0000 7f519effd640 1 -- 172.21.15.97:0/2675876893 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f519003e070 con 0x7f51a80ae5a0 2023-11-24T08:07:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.056+0000 7f51a659c640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f518806ae40 0x7f518806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.056+0000 7f51a659c640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f518806ae40 0x7f518806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5198006fd0 tx=0x7f5198008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.060+0000 7f519effd640 1 -- 172.21.15.97:0/2675876893 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51a81f2eb0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.281+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f51a80675d0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.837+0000 7f519effd640 1 -- 172.21.15.97:0/2675876893 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51900777a0 con 0x7f51a80ae5a0 2023-11-24T08:07:51.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.840+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f518806ae40 msgr2=0x7f518806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.840+0000 7f51ac890640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f518806ae40 0x7f518806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5198006fd0 tx=0x7f5198008040 comp rx=0 tx=0).stop 2023-11-24T08:07:51.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.840+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80ae5a0 msgr2=0x7f51a80cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:51.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.840+0000 7f51ac890640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80ae5a0 0x7f51a80cbd00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5190009870 tx=0x7f5190004730 comp rx=0 tx=0).stop 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 shutdown_connections 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f518806ae40 0x7f518806d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51a80b3ae0 0x7f51a8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51a80ae5a0 0x7f51a80cbd00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 --2- 172.21.15.97:0/2675876893 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51a806d120 0x7f51a80ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 >> 172.21.15.97:0/2675876893 conn(0x7f51a806a800 msgr2=0x7f51a806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 shutdown_connections 2023-11-24T08:07:51.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:51.841+0000 7f51ac890640 1 -- 172.21.15.97:0/2675876893 wait complete. 2023-11-24T08:07:51.864 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:07:52.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.082+0000 7faedb09b640 1 Processor -- start 2023-11-24T08:07:52.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.082+0000 7faedb09b640 1 -- start start 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.083+0000 7faedb09b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faed4143ae0 0x7faed40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.084+0000 7faedb09b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.084+0000 7faedb09b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40cfc30 con 0x7faed40cf7d0 2023-11-24T08:07:52.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.084+0000 7faedb09b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed40b1ee0 con 0x7faed4143ae0 2023-11-24T08:07:52.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.084+0000 7faedb09b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40b2780 con 0x7faed415e3b0 2023-11-24T08:07:52.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.084+0000 7faed9638640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.084+0000 7faed9638640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:47266/0 (socket says 172.21.15.97:47266) 2023-11-24T08:07:52.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.084+0000 7faed9638640 1 -- 172.21.15.97:0/3751508556 learned_addr learned my addr 172.21.15.97:0/3751508556 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:52.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.085+0000 7faed8e37640 1 --2- 172.21.15.97:0/3751508556 >> v2:172.21.15.183:3300/0 conn(0x7faed4143ae0 0x7faed40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.085+0000 7faed37fe640 1 -- 172.21.15.97:0/3751508556 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175528164 0 0) 0x7faed40cfc30 con 0x7faed40cf7d0 2023-11-24T08:07:52.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.085+0000 7faed37fe640 1 -- 172.21.15.97:0/3751508556 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec4003520 con 0x7faed40cf7d0 2023-11-24T08:07:52.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.085+0000 7faed9638640 1 -- 172.21.15.97:0/3751508556 >> v2:172.21.15.183:3300/0 conn(0x7faed4143ae0 msgr2=0x7faed40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:52.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.085+0000 7faed9638640 1 --2- 172.21.15.97:0/3751508556 >> v2:172.21.15.183:3300/0 conn(0x7faed4143ae0 0x7faed40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.085+0000 7faed9638640 1 -- 172.21.15.97:0/3751508556 >> v1:172.21.15.183:6789/0 conn(0x7faed40cf7d0 legacy=0x7faed415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.085+0000 7faed9638640 1 -- 172.21.15.97:0/3751508556 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed415e990 con 0x7faed415e3b0 2023-11-24T08:07:52.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.087+0000 7faed9638640 1 --2- 172.21.15.97:0/3751508556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40702c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faecc009e50 tx=0x7faecc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60e2c7d80dd5ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.087+0000 7faed37fe640 1 -- 172.21.15.97:0/3751508556 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc02cb00 con 0x7faed415e3b0 2023-11-24T08:07:52.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.087+0000 7faed37fe640 1 -- 172.21.15.97:0/3751508556 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc02cc60 con 0x7faed415e3b0 2023-11-24T08:07:52.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.087+0000 7faed37fe640 1 -- 172.21.15.97:0/3751508556 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0343f0 con 0x7faed415e3b0 2023-11-24T08:07:52.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 -- 172.21.15.97:0/3751508556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 msgr2=0x7faed40702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 --2- 172.21.15.97:0/3751508556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40702c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faecc009e50 tx=0x7faecc02bf60 comp rx=0 tx=0).stop 2023-11-24T08:07:52.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 -- 172.21.15.97:0/3751508556 shutdown_connections 2023-11-24T08:07:52.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 --2- 172.21.15.97:0/3751508556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40702c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 --2- 172.21.15.97:0/3751508556 >> v2:172.21.15.183:3300/0 conn(0x7faed4143ae0 0x7faed40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 -- 172.21.15.97:0/3751508556 >> 172.21.15.97:0/3751508556 conn(0x7faed406a800 msgr2=0x7faed406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 -- 172.21.15.97:0/3751508556 shutdown_connections 2023-11-24T08:07:52.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.088+0000 7faedb09b640 1 -- 172.21.15.97:0/3751508556 wait complete. 2023-11-24T08:07:52.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.090+0000 7faedb09b640 1 Processor -- start 2023-11-24T08:07:52.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.090+0000 7faedb09b640 1 -- start start 2023-11-24T08:07:52.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faedb09b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faed40cf7d0 0x7faed413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faedb09b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed4143ae0 0x7faed40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faedb09b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faedb09b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40aa3c0 con 0x7faed40cf7d0 2023-11-24T08:07:52.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faedb09b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed413f060 con 0x7faed4143ae0 2023-11-24T08:07:52.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faedb09b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40a97b0 con 0x7faed415e3b0 2023-11-24T08:07:52.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faed8e37640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faed40cf7d0 0x7faed413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faed8e37640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faed40cf7d0 0x7faed413eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41540/0 (socket says 172.21.15.97:41540) 2023-11-24T08:07:52.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.091+0000 7faed8e37640 1 -- 172.21.15.97:0/1899592305 learned_addr learned my addr 172.21.15.97:0/1899592305 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:52.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed3fff640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed4143ae0 0x7faed40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed9638640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed8e37640 1 -- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 msgr2=0x7faed40ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed8e37640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed8e37640 1 -- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed4143ae0 msgr2=0x7faed40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed8e37640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed4143ae0 0x7faed40adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed8e37640 1 -- 172.21.15.97:0/1899592305 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009b30 con 0x7faed40cf7d0 2023-11-24T08:07:52.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed3fff640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed4143ae0 0x7faed40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:52.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed8e37640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faed40cf7d0 0x7faed413eb20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faec800e9b0 tx=0x7faec800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed17fa640 1 -- 172.21.15.97:0/1899592305 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8009670 con 0x7faed40cf7d0 2023-11-24T08:07:52.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed17fa640 1 -- 172.21.15.97:0/1899592305 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800c9a0 con 0x7faed40cf7d0 2023-11-24T08:07:52.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed40a9a90 con 0x7faed40cf7d0 2023-11-24T08:07:52.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faed17fa640 1 -- 172.21.15.97:0/1899592305 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800cd50 con 0x7faed40cf7d0 2023-11-24T08:07:52.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.092+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed40aa050 con 0x7faed40cf7d0 2023-11-24T08:07:52.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.093+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed40675d0 con 0x7faed40cf7d0 2023-11-24T08:07:52.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.094+0000 7faed17fa640 1 -- 172.21.15.97:0/1899592305 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faec8013470 con 0x7faed40cf7d0 2023-11-24T08:07:52.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.095+0000 7faed17fa640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faeb806ae70 0x7faeb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.095+0000 7faed17fa640 1 -- 172.21.15.97:0/1899592305 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7faec80898b0 con 0x7faed40cf7d0 2023-11-24T08:07:52.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.096+0000 7faed3fff640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faeb806ae70 0x7faeb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.096+0000 7faed3fff640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faeb806ae70 0x7faeb806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faed415da80 tx=0x7faec0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.099+0000 7faed17fa640 1 -- 172.21.15.97:0/1899592305 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faec8054880 con 0x7faed40cf7d0 2023-11-24T08:07:52.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:52.288+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faed40ae7b0 con 0x7faed40cf7d0 2023-11-24T08:07:53.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.105+0000 7faed17fa640 1 -- 172.21.15.97:0/1899592305 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7faec80170d0 con 0x7faed40cf7d0 2023-11-24T08:07:53.108 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:07:53.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.110+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faeb806ae70 msgr2=0x7faeb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.110+0000 7faedb09b640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faeb806ae70 0x7faeb806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faed415da80 tx=0x7faec0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:53.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.110+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faed40cf7d0 msgr2=0x7faed413eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.110+0000 7faedb09b640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faed40cf7d0 0x7faed413eb20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faec800e9b0 tx=0x7faec800ee70 comp rx=0 tx=0).stop 2023-11-24T08:07:53.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.111+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 shutdown_connections 2023-11-24T08:07:53.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.111+0000 7faedb09b640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7faeb806ae70 0x7faeb806d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.111+0000 7faedb09b640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faed415e3b0 0x7faed40ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.111+0000 7faedb09b640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faed4143ae0 0x7faed40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.111+0000 7faedb09b640 1 --2- 172.21.15.97:0/1899592305 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faed40cf7d0 0x7faed413eb20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.111+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 >> 172.21.15.97:0/1899592305 conn(0x7faed406a800 msgr2=0x7faed413f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.112+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 shutdown_connections 2023-11-24T08:07:53.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.112+0000 7faedb09b640 1 -- 172.21.15.97:0/1899592305 wait complete. 2023-11-24T08:07:53.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:07:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.347+0000 7f5cb5e94640 1 Processor -- start 2023-11-24T08:07:53.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.347+0000 7f5cb5e94640 1 -- start start 2023-11-24T08:07:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.348+0000 7f5cb5e94640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cb0143ae0 0x7f5cb00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.348+0000 7f5cb5e94640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb00cf7d0 0x7f5cb015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.348+0000 7f5cb5e94640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5cb015e1e0 0x7f5cb015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5cb5e94640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb00cfc30 con 0x7f5cb0143ae0 2023-11-24T08:07:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5cb5e94640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb00b1ee0 con 0x7f5cb015e1e0 2023-11-24T08:07:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5cb5e94640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb00b2780 con 0x7f5cb00cf7d0 2023-11-24T08:07:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cb0143ae0 0x7f5cb00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cb0143ae0 0x7f5cb00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41554/0 (socket says 172.21.15.97:41554) 2023-11-24T08:07:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 -- 172.21.15.97:0/4047505627 learned_addr learned my addr 172.21.15.97:0/4047505627 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:53.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caeffd640 1 --2- 172.21.15.97:0/4047505627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb00cf7d0 0x7f5cb015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 -- 172.21.15.97:0/4047505627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb00cf7d0 msgr2=0x7f5cb015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:53.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 --2- 172.21.15.97:0/4047505627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb00cf7d0 0x7f5cb015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caffff640 1 --2- 172.21.15.97:0/4047505627 >> v2:172.21.15.183:3300/0 conn(0x7f5cb015e1e0 0x7f5cb015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 -- 172.21.15.97:0/4047505627 >> v2:172.21.15.183:3300/0 conn(0x7f5cb015e1e0 msgr2=0x7f5cb015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 --2- 172.21.15.97:0/4047505627 >> v2:172.21.15.183:3300/0 conn(0x7f5cb015e1e0 0x7f5cb015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.349+0000 7f5caf7fe640 1 -- 172.21.15.97:0/4047505627 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb015e990 con 0x7f5cb0143ae0 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.351+0000 7f5caf7fe640 1 --2- 172.21.15.97:0/4047505627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb0143ae0 0x7f5cb00cf290 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0072160 tx=0x7f5ca002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbf5cb0e5c1bb1b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.351+0000 7f5cae7fc640 1 -- 172.21.15.97:0/4047505627 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca002ee90 con 0x7f5cb0143ae0 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.351+0000 7f5cae7fc640 1 -- 172.21.15.97:0/4047505627 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca0036440 con 0x7f5cb0143ae0 2023-11-24T08:07:53.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.351+0000 7f5cae7fc640 1 -- 172.21.15.97:0/4047505627 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00367d0 con 0x7f5cb0143ae0 2023-11-24T08:07:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.351+0000 7f5cb5e94640 1 -- 172.21.15.97:0/4047505627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb0143ae0 msgr2=0x7f5cb00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.351+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/4047505627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb0143ae0 0x7f5cb00cf290 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0072160 tx=0x7f5ca002e0e0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.352+0000 7f5cb5e94640 1 -- 172.21.15.97:0/4047505627 shutdown_connections 2023-11-24T08:07:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.352+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/4047505627 >> v2:172.21.15.183:3300/0 conn(0x7f5cb015e1e0 0x7f5cb015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.352+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/4047505627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb00cf7d0 0x7f5cb015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.352+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/4047505627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb0143ae0 0x7f5cb00cf290 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.352+0000 7f5cb5e94640 1 -- 172.21.15.97:0/4047505627 >> 172.21.15.97:0/4047505627 conn(0x7f5cb006a800 msgr2=0x7f5cb006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.352+0000 7f5cb5e94640 1 -- 172.21.15.97:0/4047505627 shutdown_connections 2023-11-24T08:07:53.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.352+0000 7f5cb5e94640 1 -- 172.21.15.97:0/4047505627 wait complete. 2023-11-24T08:07:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.353+0000 7f5cb5e94640 1 Processor -- start 2023-11-24T08:07:53.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.354+0000 7f5cb5e94640 1 -- start start 2023-11-24T08:07:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.354+0000 7f5cb5e94640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cb00cf7d0 0x7f5cb00cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.354+0000 7f5cb5e94640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb0143ae0 0x7f5cb0133710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5cb5e94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb015e1e0 0x7f5cb0133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5cb5e94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0140bb0 con 0x7f5cb015e1e0 2023-11-24T08:07:53.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5cb5e94640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0140e90 con 0x7f5cb00cf7d0 2023-11-24T08:07:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5cb5e94640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0131760 con 0x7f5cb0143ae0 2023-11-24T08:07:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb015e1e0 0x7f5cb0133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb015e1e0 0x7f5cb0133c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41570/0 (socket says 172.21.15.97:41570) 2023-11-24T08:07:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 -- 172.21.15.97:0/137195079 learned_addr learned my addr 172.21.15.97:0/137195079 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 -- 172.21.15.97:0/137195079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb0143ae0 msgr2=0x7f5cb0133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb0143ae0 0x7f5cb0133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 -- 172.21.15.97:0/137195079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cb00cf7d0 msgr2=0x7f5cb00cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cb00cf7d0 0x7f5cb00cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 -- 172.21.15.97:0/137195079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca000b770 con 0x7f5cb015e1e0 2023-11-24T08:07:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.355+0000 7f5caffff640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb015e1e0 0x7f5cb0133c50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800cc30 tx=0x7f5ca800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.356+0000 7f5c97fff640 1 -- 172.21.15.97:0/137195079 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800ce40 con 0x7f5cb015e1e0 2023-11-24T08:07:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.356+0000 7f5c97fff640 1 -- 172.21.15.97:0/137195079 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8003990 con 0x7f5cb015e1e0 2023-11-24T08:07:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.356+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb0131a40 con 0x7f5cb015e1e0 2023-11-24T08:07:53.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.356+0000 7f5c97fff640 1 -- 172.21.15.97:0/137195079 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8003d20 con 0x7f5cb015e1e0 2023-11-24T08:07:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.356+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb013fdf0 con 0x7f5cb015e1e0 2023-11-24T08:07:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.357+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb00b2bf0 con 0x7f5cb015e1e0 2023-11-24T08:07:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.358+0000 7f5c97fff640 1 -- 172.21.15.97:0/137195079 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ca8003e80 con 0x7f5cb015e1e0 2023-11-24T08:07:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.359+0000 7f5c97fff640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9c06ae40 0x7f5c9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.359+0000 7f5c97fff640 1 -- 172.21.15.97:0/137195079 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f5ca8089960 con 0x7f5cb015e1e0 2023-11-24T08:07:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.359+0000 7f5caf7fe640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9c06ae40 0x7f5c9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.360+0000 7f5caf7fe640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9c06ae40 0x7f5c9c06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0038000 tx=0x7f5ca0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.363+0000 7f5c97fff640 1 -- 172.21.15.97:0/137195079 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5cb00b2bf0 con 0x7f5cb015e1e0 2023-11-24T08:07:53.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:53.551+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5cb0131f60 con 0x7f5cb015e1e0 2023-11-24T08:07:54.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.118+0000 7f5c97fff640 1 -- 172.21.15.97:0/137195079 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5cb0131f60 con 0x7f5cb015e1e0 2023-11-24T08:07:54.123 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' removed 2023-11-24T08:07:54.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.122+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9c06ae40 msgr2=0x7f5c9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.122+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9c06ae40 0x7f5c9c06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0038000 tx=0x7f5ca0030000 comp rx=0 tx=0).stop 2023-11-24T08:07:54.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.122+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb015e1e0 msgr2=0x7f5cb0133c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.122+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb015e1e0 0x7f5cb0133c50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800cc30 tx=0x7f5ca800a5c0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.123+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 shutdown_connections 2023-11-24T08:07:54.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.123+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5c9c06ae40 0x7f5c9c06d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.123+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cb015e1e0 0x7f5cb0133c50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.123+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cb0143ae0 0x7f5cb0133710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.123+0000 7f5cb5e94640 1 --2- 172.21.15.97:0/137195079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cb00cf7d0 0x7f5cb00cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.123+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 >> 172.21.15.97:0/137195079 conn(0x7f5cb006a800 msgr2=0x7f5cb00702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.126+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 shutdown_connections 2023-11-24T08:07:54.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.127+0000 7f5cb5e94640 1 -- 172.21.15.97:0/137195079 wait complete. 2023-11-24T08:07:54.154 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:07:54.154 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:07:54.154 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:07:54.154 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:54.155 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:07:54.155 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:07:54.155 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:07:54.155 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:54.156 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:07:54.156 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:07:54.156 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:07:54.157 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:54.157 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:07:54.157 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:07:54.158 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:07:54.158 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:54.173 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:07:54.174 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:07:54.176 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:07:54.176 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:07:54.177 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:07:54.177 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:07:54.179 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:07:54.179 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:07:54.225 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:07:54.225 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:54.227 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:07:54.228 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:54.231 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:07:54.232 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:54.235 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:07:54.235 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:54.236 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:07:54.395 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-11-24T08:07:54.395 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-11-24T08:07:54.396 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-11-24T08:07:54.399 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-11-24T08:07:54.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.443+0000 7f1ad3fff640 1 Processor -- start 2023-11-24T08:07:54.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.443+0000 7f1ad3fff640 1 -- start start 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.444+0000 7f1ad3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1ad40cc960 0x7f1ad4168080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.444+0000 7f1ad3fff640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40d1d10 con 0x7f1ad415d440 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.444+0000 7f1ad3fff640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad406c520 con 0x7f1ad40d1900 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.444+0000 7f1ad3fff640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40cfaf0 con 0x7f1ad40cc960 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.444+0000 7f1ad2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1ad415d440 0x7f1ad406b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60298/0 (socket says 172.21.15.97:60298) 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.444+0000 7f1ad2ffd640 1 -- 172.21.15.97:0/3084044621 learned_addr learned my addr 172.21.15.97:0/3084044621 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.444+0000 7f1ad37fe640 1 --2- 172.21.15.97:0/3084044621 >> v2:172.21.15.97:3300/0 conn(0x7f1ad40cc960 0x7f1ad4168080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.445+0000 7f1ad1ffb640 1 -- 172.21.15.97:0/3084044621 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275824774 0 0) 0x7f1ad40d1d10 con 0x7f1ad415d440 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.445+0000 7f1ad1ffb640 1 -- 172.21.15.97:0/3084044621 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1abc003520 con 0x7f1ad415d440 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.445+0000 7f1ad1ffb640 1 -- 172.21.15.97:0/3084044621 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750916938 0 0) 0x7f1ad406c520 con 0x7f1ad40d1900 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.445+0000 7f1ad37fe640 1 -- 172.21.15.97:0/3084044621 >> v1:172.21.15.183:6789/0 conn(0x7f1ad40d1900 legacy=0x7f1ad406be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.445+0000 7f1ad37fe640 1 -- 172.21.15.97:0/3084044621 >> v1:172.21.15.97:6789/0 conn(0x7f1ad415d440 legacy=0x7f1ad406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.445+0000 7f1ad37fe640 1 -- 172.21.15.97:0/3084044621 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40cfd00 con 0x7f1ad40cc960 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.446+0000 7f1ad37fe640 1 --2- 172.21.15.97:0/3084044621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad40cc960 0x7f1ad4168080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d90 tx=0x7f1acc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf480517c5a3f31 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.446+0000 7f1ad1ffb640 1 -- 172.21.15.97:0/3084044621 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc02cd00 con 0x7f1ad40cc960 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.446+0000 7f1ad1ffb640 1 -- 172.21.15.97:0/3084044621 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc02ce60 con 0x7f1ad40cc960 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.446+0000 7f1ad1ffb640 1 -- 172.21.15.97:0/3084044621 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc034660 con 0x7f1ad40cc960 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.447+0000 7f1ad3fff640 1 -- 172.21.15.97:0/3084044621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad40cc960 msgr2=0x7f1ad4168080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.447+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/3084044621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad40cc960 0x7f1ad4168080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d90 tx=0x7f1acc02bf50 comp rx=0 tx=0).stop 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.447+0000 7f1ad3fff640 1 -- 172.21.15.97:0/3084044621 shutdown_connections 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.447+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/3084044621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad40cc960 0x7f1ad4168080 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.447+0000 7f1ad3fff640 1 -- 172.21.15.97:0/3084044621 >> 172.21.15.97:0/3084044621 conn(0x7f1ad40d0de0 msgr2=0x7f1ad40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.447+0000 7f1ad3fff640 1 -- 172.21.15.97:0/3084044621 shutdown_connections 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.447+0000 7f1ad3fff640 1 -- 172.21.15.97:0/3084044621 wait complete. 2023-11-24T08:07:54.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.449+0000 7f1ad3fff640 1 Processor -- start 2023-11-24T08:07:54.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.449+0000 7f1ad3fff640 1 -- start start 2023-11-24T08:07:54.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ad40cc960 0x7f1ad414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ad40d1900 0x7f1ad40c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad415d440 0x7f1ad40c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad3fff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c63d0 con 0x7f1ad415d440 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad3fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c66a0 con 0x7f1ad40d1900 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad3fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c6980 con 0x7f1ad40cc960 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad415d440 0x7f1ad40c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad415d440 0x7f1ad40c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41624/0 (socket says 172.21.15.97:41624) 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 -- 172.21.15.97:0/532035155 learned_addr learned my addr 172.21.15.97:0/532035155 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad27fc640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ad40d1900 0x7f1ad40c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad2ffd640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ad40cc960 0x7f1ad414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 -- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ad40cc960 msgr2=0x7f1ad414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ad40cc960 0x7f1ad414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 -- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ad40d1900 msgr2=0x7f1ad40c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ad40d1900 0x7f1ad40c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad37fe640 1 -- 172.21.15.97:0/532035155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009a70 con 0x7f1ad415d440 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad27fc640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ad40d1900 0x7f1ad40c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.450+0000 7f1ad2ffd640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ad40cc960 0x7f1ad414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.451+0000 7f1ad37fe640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad415d440 0x7f1ad40c5e90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1acc037040 tx=0x7f1acc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.451+0000 7f1abb7fe640 1 -- 172.21.15.97:0/532035155 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc03d600 con 0x7f1ad415d440 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.451+0000 7f1abb7fe640 1 -- 172.21.15.97:0/532035155 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc03d7a0 con 0x7f1ad415d440 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.451+0000 7f1abb7fe640 1 -- 172.21.15.97:0/532035155 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc03db50 con 0x7f1ad415d440 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.451+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad40c6c60 con 0x7f1ad415d440 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.451+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41f2a80 con 0x7f1ad415d440 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.452+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad41f2ce0 con 0x7f1ad415d440 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.453+0000 7f1abb7fe640 1 -- 172.21.15.97:0/532035155 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1acc03b040 con 0x7f1ad415d440 2023-11-24T08:07:54.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.454+0000 7f1abb7fe640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1ac006ae40 0x7f1ac006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.454+0000 7f1abb7fe640 1 -- 172.21.15.97:0/532035155 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1acc0ab590 con 0x7f1ad415d440 2023-11-24T08:07:54.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.454+0000 7f1ad2ffd640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1ac006ae40 0x7f1ac006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.455+0000 7f1ad2ffd640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1ac006ae40 0x7f1ac006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40011e0 tx=0x7f1ac4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.458+0000 7f1abb7fe640 1 -- 172.21.15.97:0/532035155 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ad41f2ce0 con 0x7f1ad415d440 2023-11-24T08:07:54.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:54.669+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1ad41f2ce0 con 0x7f1ad415d440 2023-11-24T08:07:55.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.145+0000 7f1abb7fe640 1 -- 172.21.15.97:0/532035155 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1ad41f2ce0 con 0x7f1ad415d440 2023-11-24T08:07:55.147 INFO:teuthology.orchestra.run.smithi097.stderr: removed all blocklist entries 2023-11-24T08:07:55.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1ac006ae40 msgr2=0x7f1ac006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1ac006ae40 0x7f1ac006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40011e0 tx=0x7f1ac4009040 comp rx=0 tx=0).stop 2023-11-24T08:07:55.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad415d440 msgr2=0x7f1ad40c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad415d440 0x7f1ad40c5e90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1acc037040 tx=0x7f1acc004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:55.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 shutdown_connections 2023-11-24T08:07:55.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1ac006ae40 0x7f1ac006d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ad415d440 0x7f1ad40c5e90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ad40d1900 0x7f1ad40c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 --2- 172.21.15.97:0/532035155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ad40cc960 0x7f1ad414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 >> 172.21.15.97:0/532035155 conn(0x7f1ad40d0de0 msgr2=0x7f1ad415c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 shutdown_connections 2023-11-24T08:07:55.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.149+0000 7f1ad3fff640 1 -- 172.21.15.97:0/532035155 wait complete. 2023-11-24T08:07:55.172 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:07:55.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.373+0000 7f5282423640 1 Processor -- start 2023-11-24T08:07:55.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.373+0000 7f5282423640 1 -- start start 2023-11-24T08:07:55.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f5282423640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 0x7f527c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f5282423640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f527c15f9c0 0x7f527c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f5282423640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c15c5f0 con 0x7f527c13df80 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f5282423640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c06c470 con 0x7f527c15f9c0 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f5282423640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c06c750 con 0x7f527c13e360 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f52809c0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f527c15f9c0 0x7f527c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f52809c0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f527c15f9c0 0x7f527c0cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41638/0 (socket says 172.21.15.97:41638) 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f52809c0640 1 -- 172.21.15.97:0/1178216070 learned_addr learned my addr 172.21.15.97:0/1178216070 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:55.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.375+0000 7f5273fff640 1 --2- 172.21.15.97:0/1178216070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 0x7f527c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.376+0000 7f52809c0640 1 -- 172.21.15.97:0/1178216070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 msgr2=0x7f527c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.376+0000 7f52809c0640 1 --2- 172.21.15.97:0/1178216070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 0x7f527c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.376+0000 7f52809c0640 1 -- 172.21.15.97:0/1178216070 >> v1:172.21.15.183:6789/0 conn(0x7f527c13df80 legacy=0x7f527c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.376+0000 7f52809c0640 1 -- 172.21.15.97:0/1178216070 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c06ca30 con 0x7f527c15f9c0 2023-11-24T08:07:55.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.377+0000 7f52809c0640 1 --2- 172.21.15.97:0/1178216070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c0cf7d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5274009e50 tx=0x7f527402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4fb77683f24d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.377+0000 7f527b7fe640 1 -- 172.21.15.97:0/1178216070 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527402ca70 con 0x7f527c15f9c0 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.377+0000 7f527b7fe640 1 -- 172.21.15.97:0/1178216070 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527402cbd0 con 0x7f527c15f9c0 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.377+0000 7f527b7fe640 1 -- 172.21.15.97:0/1178216070 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740343f0 con 0x7f527c15f9c0 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 -- 172.21.15.97:0/1178216070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 msgr2=0x7f527c0cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 --2- 172.21.15.97:0/1178216070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c0cf7d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5274009e50 tx=0x7f527402bed0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 -- 172.21.15.97:0/1178216070 shutdown_connections 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 --2- 172.21.15.97:0/1178216070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c0cf7d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 --2- 172.21.15.97:0/1178216070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 0x7f527c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 -- 172.21.15.97:0/1178216070 >> 172.21.15.97:0/1178216070 conn(0x7f527c06a800 msgr2=0x7f527c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 -- 172.21.15.97:0/1178216070 shutdown_connections 2023-11-24T08:07:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.378+0000 7f5282423640 1 -- 172.21.15.97:0/1178216070 wait complete. 2023-11-24T08:07:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.379+0000 7f5282423640 1 Processor -- start 2023-11-24T08:07:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.380+0000 7f5282423640 1 -- start start 2023-11-24T08:07:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.380+0000 7f5282423640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f527c13df80 0x7f527c138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.380+0000 7f5282423640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 0x7f527c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.380+0000 7f5282423640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f5282423640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c138bc0 con 0x7f527c15f9c0 2023-11-24T08:07:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f5282423640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c155150 con 0x7f527c13df80 2023-11-24T08:07:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f5282423640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c13cd30 con 0x7f527c13e360 2023-11-24T08:07:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c15d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41654/0 (socket says 172.21.15.97:41654) 2023-11-24T08:07:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 -- 172.21.15.97:0/1308335756 learned_addr learned my addr 172.21.15.97:0/1308335756 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 -- 172.21.15.97:0/1308335756 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 msgr2=0x7f527c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 0x7f527c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 -- 172.21.15.97:0/1308335756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f527c13df80 msgr2=0x7f527c138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f527c13df80 0x7f527c138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.381+0000 7f52809c0640 1 -- 172.21.15.97:0/1308335756 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5274009b30 con 0x7f527c15f9c0 2023-11-24T08:07:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.382+0000 7f52809c0640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c15d4f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5274036040 tx=0x7f5274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.382+0000 7f52797fa640 1 -- 172.21.15.97:0/1308335756 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274009510 con 0x7f527c15f9c0 2023-11-24T08:07:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.382+0000 7f52797fa640 1 -- 172.21.15.97:0/1308335756 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527403e450 con 0x7f527c15f9c0 2023-11-24T08:07:55.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.382+0000 7f52797fa640 1 -- 172.21.15.97:0/1308335756 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527403e7e0 con 0x7f527c15f9c0 2023-11-24T08:07:55.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.382+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c13d010 con 0x7f527c15f9c0 2023-11-24T08:07:55.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.382+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c13d5d0 con 0x7f527c15f9c0 2023-11-24T08:07:55.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.383+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c0675d0 con 0x7f527c15f9c0 2023-11-24T08:07:55.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.384+0000 7f52797fa640 1 -- 172.21.15.97:0/1308335756 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f527403e940 con 0x7f527c15f9c0 2023-11-24T08:07:55.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.385+0000 7f52797fa640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f525c06ae40 0x7f525c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.385+0000 7f52797fa640 1 -- 172.21.15.97:0/1308335756 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f52740ac110 con 0x7f527c15f9c0 2023-11-24T08:07:55.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.385+0000 7f527bfff640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f525c06ae40 0x7f525c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.386+0000 7f527bfff640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f525c06ae40 0x7f525c06d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f526c006fd0 tx=0x7f526c006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.389+0000 7f52797fa640 1 -- 172.21.15.97:0/1308335756 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5274077470 con 0x7f527c15f9c0 2023-11-24T08:07:55.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.646+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f527c06df00 con 0x7f527c15f9c0 2023-11-24T08:07:55.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.647+0000 7f52797fa640 1 -- 172.21.15.97:0/1308335756 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f527407aa90 con 0x7f527c15f9c0 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_dump": [ 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.a", 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBKWWBla6HUJxAAmnmOMozOIiFQLQUkTIKk4A==", 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.b", 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBLWWBlPuK6DBAAJ+xdUoSuQYWaNB5fxT+KUg==", 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.650 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.c", 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBKWWBlc4ntNhAA8Oy8ILhxD8YB1sJLM0mM9g==", 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.d", 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBLWWBlFYGSHRAAADRrXLoK48hPklxyW1WzcA==", 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.652 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.0", 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBQWWBlV77EFRAApa17yGQxKKISFGl9bEzKaw==", 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.1", 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBTWWBlXcnIIBAAozoESPVBgIBa+QJ/49tKfQ==", 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.654 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.2", 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBWWWBlvSCDNxAAzL+FUVH5G6TJIo7rlMZg2g==", 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.3", 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBaWWBlBwSEBhAA5xnhi7CwH1wlOsB4MCCb+g==", 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.4", 2023-11-24T08:07:55.656 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBhWWBlkjyiGhAAL/ol7qrulBQIf8GyydKJsA==", 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.657 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.5", 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBkWWBlanS2MhAA4xcYdLcg+8q9nM/951rQlQ==", 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.6", 2023-11-24T08:07:55.658 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBnWWBlCbSAOxAAWc6xWwjfXZYPqnLl9hWeoA==", 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.7", 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBrWWBlsuI9ChAAHhaUrqmwPt/1+a0DdURzcw==", 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.659 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.0", 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBLWWBlRHFuKhAAF85SZrFh9cWe6ZO4yGMg/A==", 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow r", 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow rw", 2023-11-24T08:07:55.660 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rwx" 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.1", 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBMWWBli+FvAxAA6aQ/G1LZRmLYopDOy07vaA==", 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow r", 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow rw", 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rwx" 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.2", 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBLWWBlI7y0MxAAv+f8hJsc4vckfKJkvIA64A==", 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow r", 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow rw", 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rwx" 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.3", 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBMWWBl1LOmDRAASwF1bEb4YJvEVJKc0zxJkw==", 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow r", 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow rw", 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rwx" 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.663 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.admin", 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBJWWBlcW05HRAA5eJFIh6IvP75PeD2/0Jx8Q==", 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-mds", 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQB+WWBldURnExAAKO7qP77TL/ML+i5YfLJRtQ==", 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQB+WWBl22FnExAAgkTKHfBuQe3QSijs3F7pIg==", 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.665 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-osd", 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQB+WWBlbntnExAAlmcOKBCHmlPvmMHm87uVwQ==", 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T08:07:55.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQB+WWBlMZdnExAAz9+SIIN+xklDKRsxldGurw==", 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQB+WWBljrBnExAAB5ihfVvK+xynduXTRdXbSg==", 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQB+WWBlEMpnExAA/JQtZrdJ4a8/7dY2B3E7vA==", 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.668 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.x", 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBKWWBlhUsXHRAA+M4Xqk/1IST3GdY3StZ6BA==", 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.669 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.y", 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBKWWBllCuPERAArK2zl8RIPMkTlAhzLNlmFA==", 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-11-24T08:07:55.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:55.671 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:07:55.671 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:07:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.649+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f525c06ae40 msgr2=0x7f525c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.649+0000 7f5282423640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f525c06ae40 0x7f525c06d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f526c006fd0 tx=0x7f526c006bc0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.649+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 msgr2=0x7f527c15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.649+0000 7f5282423640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c15d4f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5274036040 tx=0x7f5274004a40 comp rx=0 tx=0).stop 2023-11-24T08:07:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 shutdown_connections 2023-11-24T08:07:55.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f525c06ae40 0x7f525c06d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f527c15f9c0 0x7f527c15d4f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f527c13e360 0x7f527c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 --2- 172.21.15.97:0/1308335756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f527c13df80 0x7f527c138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 >> 172.21.15.97:0/1308335756 conn(0x7f527c06a800 msgr2=0x7f527c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 shutdown_connections 2023-11-24T08:07:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.650+0000 7f5282423640 1 -- 172.21.15.97:0/1308335756 wait complete. 2023-11-24T08:07:55.673 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T08:07:55.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.890+0000 7f0f01b9e640 1 Processor -- start 2023-11-24T08:07:55.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.890+0000 7f0f01b9e640 1 -- start start 2023-11-24T08:07:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f01b9e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0efc13cda0 0x7f0efc15da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f01b9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc15dfa0 0x7f0efc0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f01b9e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0efc0cdef0 0x7f0efc15a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f01b9e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0700f0 con 0x7f0efc13cda0 2023-11-24T08:07:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f01b9e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc15e3e0 con 0x7f0efc0cdef0 2023-11-24T08:07:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f01b9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0ce720 con 0x7f0efc15dfa0 2023-11-24T08:07:55.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0efc13cda0 0x7f0efc15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0efc13cda0 0x7f0efc15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41664/0 (socket says 172.21.15.97:41664) 2023-11-24T08:07:55.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 -- 172.21.15.97:0/1566408692 learned_addr learned my addr 172.21.15.97:0/1566408692 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:55.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 -- 172.21.15.97:0/1566408692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc15dfa0 msgr2=0x7f0efc0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 --2- 172.21.15.97:0/1566408692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc15dfa0 0x7f0efc0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 -- 172.21.15.97:0/1566408692 >> v2:172.21.15.183:3300/0 conn(0x7f0efc0cdef0 msgr2=0x7f0efc15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 --2- 172.21.15.97:0/1566408692 >> v2:172.21.15.183:3300/0 conn(0x7f0efc0cdef0 0x7f0efc15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.892+0000 7f0f00b9c640 1 -- 172.21.15.97:0/1566408692 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0cea00 con 0x7f0efc13cda0 2023-11-24T08:07:55.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.894+0000 7f0f00b9c640 1 --2- 172.21.15.97:0/1566408692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc13cda0 0x7f0efc15da60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0efc151530 tx=0x7f0ef002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1c856e9688cdd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.894+0000 7f0efb7fe640 1 -- 172.21.15.97:0/1566408692 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef002ee00 con 0x7f0efc13cda0 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.894+0000 7f0efb7fe640 1 -- 172.21.15.97:0/1566408692 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0036440 con 0x7f0efc13cda0 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.894+0000 7f0efb7fe640 1 -- 172.21.15.97:0/1566408692 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00367d0 con 0x7f0efc13cda0 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.894+0000 7f0f01b9e640 1 -- 172.21.15.97:0/1566408692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc13cda0 msgr2=0x7f0efc15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.894+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/1566408692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc13cda0 0x7f0efc15da60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0efc151530 tx=0x7f0ef002e050 comp rx=0 tx=0).stop 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.895+0000 7f0f01b9e640 1 -- 172.21.15.97:0/1566408692 shutdown_connections 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.895+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/1566408692 >> v2:172.21.15.183:3300/0 conn(0x7f0efc0cdef0 0x7f0efc15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.895+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/1566408692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc15dfa0 0x7f0efc0cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.895+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/1566408692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc13cda0 0x7f0efc15da60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.895+0000 7f0f01b9e640 1 -- 172.21.15.97:0/1566408692 >> 172.21.15.97:0/1566408692 conn(0x7f0efc06a3e0 msgr2=0x7f0efc06a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.895+0000 7f0f01b9e640 1 -- 172.21.15.97:0/1566408692 shutdown_connections 2023-11-24T08:07:55.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.895+0000 7f0f01b9e640 1 -- 172.21.15.97:0/1566408692 wait complete. 2023-11-24T08:07:55.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.896+0000 7f0f01b9e640 1 Processor -- start 2023-11-24T08:07:55.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.897+0000 7f0f01b9e640 1 -- start start 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f01b9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc0cdef0 0x7f0efc13c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f01b9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc13cda0 0x7f0efc154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f01b9e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc15dfa0 0x7f0efc13e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f01b9e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc13e070 con 0x7f0efc15dfa0 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f01b9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc157230 con 0x7f0efc0cdef0 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f01b9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc13d480 con 0x7f0efc13cda0 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc15dfa0 0x7f0efc13e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc15dfa0 0x7f0efc13e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:41674/0 (socket says 172.21.15.97:41674) 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 -- 172.21.15.97:0/3547976372 learned_addr learned my addr 172.21.15.97:0/3547976372 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 -- 172.21.15.97:0/3547976372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc13cda0 msgr2=0x7f0efc154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc13cda0 0x7f0efc154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 -- 172.21.15.97:0/3547976372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc0cdef0 msgr2=0x7f0efc13c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc0cdef0 0x7f0efc13c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.898+0000 7f0f0139d640 1 -- 172.21.15.97:0/3547976372 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef000b770 con 0x7f0efc15dfa0 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.899+0000 7f0f0139d640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc15dfa0 0x7f0efc13e500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400b970 tx=0x7f0ef400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.899+0000 7f0ef97fa640 1 -- 172.21.15.97:0/3547976372 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef400cb40 con 0x7f0efc15dfa0 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.899+0000 7f0ef97fa640 1 -- 172.21.15.97:0/3547976372 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef400ccc0 con 0x7f0efc15dfa0 2023-11-24T08:07:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.899+0000 7f0ef97fa640 1 -- 172.21.15.97:0/3547976372 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4014680 con 0x7f0efc15dfa0 2023-11-24T08:07:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.899+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc13d740 con 0x7f0efc15dfa0 2023-11-24T08:07:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.899+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc13dd00 con 0x7f0efc15dfa0 2023-11-24T08:07:55.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.900+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0efc067450 con 0x7f0efc15dfa0 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.901+0000 7f0ef97fa640 1 -- 172.21.15.97:0/3547976372 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ef401d3b0 con 0x7f0efc15dfa0 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.902+0000 7f0ef97fa640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ee006ae40 0x7f0ee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.902+0000 7f0ef97fa640 1 -- 172.21.15.97:0/3547976372 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ef4089260 con 0x7f0efc15dfa0 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.902+0000 7f0f00b9c640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ee006ae40 0x7f0ee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.903+0000 7f0f00b9c640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ee006ae40 0x7f0ee006d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0038000 tx=0x7f0ef0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:55.907+0000 7f0ef97fa640 1 -- 172.21.15.97:0/3547976372 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ef4054640 con 0x7f0efc15dfa0 2023-11-24T08:07:56.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.160+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f0efc0cdb40 con 0x7f0efc15dfa0 2023-11-24T08:07:56.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.165+0000 7f0ef97fa640 1 -- 172.21.15.97:0/3547976372 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0ef4057c60 con 0x7f0efc15dfa0 2023-11-24T08:07:56.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ee006ae40 msgr2=0x7f0ee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ee006ae40 0x7f0ee006d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0038000 tx=0x7f0ef0008040 comp rx=0 tx=0).stop 2023-11-24T08:07:56.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc15dfa0 msgr2=0x7f0efc13e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc15dfa0 0x7f0efc13e500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400b970 tx=0x7f0ef400be30 comp rx=0 tx=0).stop 2023-11-24T08:07:56.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 shutdown_connections 2023-11-24T08:07:56.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ee006ae40 0x7f0ee006d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0efc15dfa0 0x7f0efc13e500 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0efc13cda0 0x7f0efc154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 --2- 172.21.15.97:0/3547976372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0efc0cdef0 0x7f0efc13c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 >> 172.21.15.97:0/3547976372 conn(0x7f0efc06a3e0 msgr2=0x7f0efc15b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 shutdown_connections 2023-11-24T08:07:56.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.169+0000 7f0f01b9e640 1 -- 172.21.15.97:0/3547976372 wait complete. 2023-11-24T08:07:56.191 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T08:07:56.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.385+0000 7f8246761640 1 Processor -- start 2023-11-24T08:07:56.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.386+0000 7f8246761640 1 -- start start 2023-11-24T08:07:56.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.387+0000 7f8246761640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f824015e880 0x7f824006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.387+0000 7f8246761640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f824009a170 0x7f824006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.387+0000 7f8246761640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82400cfa70 con 0x7f8240070490 2023-11-24T08:07:56.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.387+0000 7f8246761640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82400cff00 con 0x7f824009a170 2023-11-24T08:07:56.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.387+0000 7f8246761640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824006fc70 con 0x7f824015e880 2023-11-24T08:07:56.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.387+0000 7f8244cfe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f824009a170 0x7f824006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.388+0000 7f8244cfe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f824009a170 0x7f824006e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46334/0 (socket says 172.21.15.97:46334) 2023-11-24T08:07:56.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.388+0000 7f8244cfe640 1 -- 172.21.15.97:0/3123580003 learned_addr learned my addr 172.21.15.97:0/3123580003 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:56.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.388+0000 7f823ffff640 1 --2- 172.21.15.97:0/3123580003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f824015e880 0x7f824006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.388+0000 7f8244cfe640 1 -- 172.21.15.97:0/3123580003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f824015e880 msgr2=0x7f824006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.388+0000 7f8244cfe640 1 --2- 172.21.15.97:0/3123580003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f824015e880 0x7f824006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.388+0000 7f8244cfe640 1 -- 172.21.15.97:0/3123580003 >> v1:172.21.15.183:6789/0 conn(0x7f8240070490 legacy=0x7f8240099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.388+0000 7f8244cfe640 1 -- 172.21.15.97:0/3123580003 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82400cf420 con 0x7f824009a170 2023-11-24T08:07:56.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.389+0000 7f8244cfe640 1 --2- 172.21.15.97:0/3123580003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824009a170 0x7f824006e7c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8238009870 tx=0x7f823802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97536a3e6d7d1855 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.389+0000 7f823effd640 1 -- 172.21.15.97:0/3123580003 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238030840 con 0x7f824009a170 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.389+0000 7f823effd640 1 -- 172.21.15.97:0/3123580003 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82380309a0 con 0x7f824009a170 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.389+0000 7f823effd640 1 -- 172.21.15.97:0/3123580003 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238030d30 con 0x7f824009a170 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 -- 172.21.15.97:0/3123580003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824009a170 msgr2=0x7f824006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 --2- 172.21.15.97:0/3123580003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824009a170 0x7f824006e7c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8238009870 tx=0x7f823802b980 comp rx=0 tx=0).stop 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 -- 172.21.15.97:0/3123580003 shutdown_connections 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 --2- 172.21.15.97:0/3123580003 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824009a170 0x7f824006e7c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 --2- 172.21.15.97:0/3123580003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f824015e880 0x7f824006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 -- 172.21.15.97:0/3123580003 >> 172.21.15.97:0/3123580003 conn(0x7f82400b2d00 msgr2=0x7f82400b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 -- 172.21.15.97:0/3123580003 shutdown_connections 2023-11-24T08:07:56.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.390+0000 7f8246761640 1 -- 172.21.15.97:0/3123580003 wait complete. 2023-11-24T08:07:56.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.392+0000 7f8246761640 1 Processor -- start 2023-11-24T08:07:56.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.392+0000 7f8246761640 1 -- start start 2023-11-24T08:07:56.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8246761640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8240070490 0x7f824009cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8246761640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f824009a170 0x7f824009b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8246761640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824015e880 0x7f82400c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8246761640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82401f7cb0 con 0x7f824015e880 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8246761640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824009dff0 con 0x7f824009a170 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8246761640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824009d3e0 con 0x7f8240070490 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8244cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824015e880 0x7f82400c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8244cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824015e880 0x7f82400c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46344/0 (socket says 172.21.15.97:46344) 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.393+0000 7f8244cfe640 1 -- 172.21.15.97:0/1173291800 learned_addr learned my addr 172.21.15.97:0/1173291800 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f823f7fe640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f824009a170 0x7f824009b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8244cfe640 1 -- 172.21.15.97:0/1173291800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8240070490 msgr2=0x7f824009cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8244cfe640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8240070490 0x7f824009cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8244cfe640 1 -- 172.21.15.97:0/1173291800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f824009a170 msgr2=0x7f824009b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8244cfe640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f824009a170 0x7f824009b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8244cfe640 1 -- 172.21.15.97:0/1173291800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82380094d0 con 0x7f824015e880 2023-11-24T08:07:56.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8244cfe640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824015e880 0x7f82400c88b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8238009870 tx=0x7f8238004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f823cff9640 1 -- 172.21.15.97:0/1173291800 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238043400 con 0x7f824015e880 2023-11-24T08:07:56.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f823cff9640 1 -- 172.21.15.97:0/1173291800 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8238043580 con 0x7f824015e880 2023-11-24T08:07:56.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f823cff9640 1 -- 172.21.15.97:0/1173291800 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238043930 con 0x7f824015e880 2023-11-24T08:07:56.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824009d6c0 con 0x7f824015e880 2023-11-24T08:07:56.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.394+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824009dc80 con 0x7f824015e880 2023-11-24T08:07:56.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.396+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82400675d0 con 0x7f824015e880 2023-11-24T08:07:56.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.396+0000 7f823cff9640 1 -- 172.21.15.97:0/1173291800 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8238043a90 con 0x7f824015e880 2023-11-24T08:07:56.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.397+0000 7f823cff9640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f822006ae40 0x7f822006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.397+0000 7f823cff9640 1 -- 172.21.15.97:0/1173291800 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f823803e070 con 0x7f824015e880 2023-11-24T08:07:56.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.398+0000 7f823ffff640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f822006ae40 0x7f822006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.398+0000 7f823ffff640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f822006ae40 0x7f822006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8230007dc0 tx=0x7f82300072f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.401+0000 7f823cff9640 1 -- 172.21.15.97:0/1173291800 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8238077b60 con 0x7f824015e880 2023-11-24T08:07:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.659+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f824009e130 con 0x7f824015e880 2023-11-24T08:07:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.663+0000 7f823cff9640 1 -- 172.21.15.97:0/1173291800 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f824009e130 con 0x7f824015e880 2023-11-24T08:07:56.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f822006ae40 msgr2=0x7f822006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f822006ae40 0x7f822006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8230007dc0 tx=0x7f82300072f0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824015e880 msgr2=0x7f82400c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824015e880 0x7f82400c88b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8238009870 tx=0x7f8238004730 comp rx=0 tx=0).stop 2023-11-24T08:07:56.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 shutdown_connections 2023-11-24T08:07:56.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f822006ae40 0x7f822006d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f824015e880 0x7f82400c88b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f824009a170 0x7f824009b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 --2- 172.21.15.97:0/1173291800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8240070490 0x7f824009cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.665+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 >> 172.21.15.97:0/1173291800 conn(0x7f82400b2d00 msgr2=0x7f824006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.666+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 shutdown_connections 2023-11-24T08:07:56.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.666+0000 7f8246761640 1 -- 172.21.15.97:0/1173291800 wait complete. 2023-11-24T08:07:56.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T08:07:56.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.879+0000 7f06a1573640 1 Processor -- start 2023-11-24T08:07:56.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.880+0000 7f06a1573640 1 -- start start 2023-11-24T08:07:56.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f06a1573640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f069c099a60 0x7f069c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f06a1573640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f069c06e7c0 0x7f069c06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f06a1573640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0cfa70 con 0x7f069c15e880 2023-11-24T08:07:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f06a1573640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c09a3e0 con 0x7f069c06e7c0 2023-11-24T08:07:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f06a1573640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c0cff00 con 0x7f069c099a60 2023-11-24T08:07:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f069b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f069c06e7c0 0x7f069c06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f069b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f069c06e7c0 0x7f069c06ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46352/0 (socket says 172.21.15.97:46352) 2023-11-24T08:07:56.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f069b7fe640 1 -- 172.21.15.97:0/691233182 learned_addr learned my addr 172.21.15.97:0/691233182 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f069b7fe640 1 -- 172.21.15.97:0/691233182 >> v2:172.21.15.183:3300/0 conn(0x7f069c099a60 msgr2=0x7f069c099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f069b7fe640 1 --2- 172.21.15.97:0/691233182 >> v2:172.21.15.183:3300/0 conn(0x7f069c099a60 0x7f069c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f069b7fe640 1 -- 172.21.15.97:0/691233182 >> v1:172.21.15.183:6789/0 conn(0x7f069c15e880 legacy=0x7f069c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.882+0000 7f069b7fe640 1 -- 172.21.15.97:0/691233182 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c06fc70 con 0x7f069c06e7c0 2023-11-24T08:07:56.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.883+0000 7f069b7fe640 1 --2- 172.21.15.97:0/691233182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c06e7c0 0x7f069c06ec10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f069c071800 tx=0x7f069402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a619618d005f401 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.884+0000 7f069a7fc640 1 -- 172.21.15.97:0/691233182 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694030860 con 0x7f069c06e7c0 2023-11-24T08:07:56.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.884+0000 7f069a7fc640 1 -- 172.21.15.97:0/691233182 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06940309c0 con 0x7f069c06e7c0 2023-11-24T08:07:56.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.884+0000 7f069a7fc640 1 -- 172.21.15.97:0/691233182 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694030d50 con 0x7f069c06e7c0 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.884+0000 7f06a1573640 1 -- 172.21.15.97:0/691233182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c06e7c0 msgr2=0x7f069c06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.884+0000 7f06a1573640 1 --2- 172.21.15.97:0/691233182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c06e7c0 0x7f069c06ec10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f069c071800 tx=0x7f069402b9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.885+0000 7f06a1573640 1 -- 172.21.15.97:0/691233182 shutdown_connections 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.885+0000 7f06a1573640 1 --2- 172.21.15.97:0/691233182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c06e7c0 0x7f069c06ec10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.885+0000 7f06a1573640 1 --2- 172.21.15.97:0/691233182 >> v2:172.21.15.183:3300/0 conn(0x7f069c099a60 0x7f069c099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.885+0000 7f06a1573640 1 -- 172.21.15.97:0/691233182 >> 172.21.15.97:0/691233182 conn(0x7f069c0b2d00 msgr2=0x7f069c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.885+0000 7f06a1573640 1 -- 172.21.15.97:0/691233182 shutdown_connections 2023-11-24T08:07:56.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.885+0000 7f06a1573640 1 -- 172.21.15.97:0/691233182 wait complete. 2023-11-24T08:07:56.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.886+0000 7f06a1573640 1 Processor -- start 2023-11-24T08:07:56.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.887+0000 7f06a1573640 1 -- start start 2023-11-24T08:07:56.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.887+0000 7f06a1573640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c06e7c0 0x7f069c153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.887+0000 7f06a1573640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c099a60 0x7f069c0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.887+0000 7f06a1573640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c15e880 0x7f069c0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.887+0000 7f06a1573640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1f2e30 con 0x7f069c15e880 2023-11-24T08:07:56.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.887+0000 7f06a1573640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c153c80 con 0x7f069c06e7c0 2023-11-24T08:07:56.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.887+0000 7f06a1573640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1f4080 con 0x7f069c099a60 2023-11-24T08:07:56.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c15e880 0x7f069c0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c15e880 0x7f069c0c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46356/0 (socket says 172.21.15.97:46356) 2023-11-24T08:07:56.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 -- 172.21.15.97:0/947905137 learned_addr learned my addr 172.21.15.97:0/947905137 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 -- 172.21.15.97:0/947905137 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c099a60 msgr2=0x7f069c0c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c099a60 0x7f069c0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 -- 172.21.15.97:0/947905137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c06e7c0 msgr2=0x7f069c153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c06e7c0 0x7f069c153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 -- 172.21.15.97:0/947905137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940094d0 con 0x7f069c15e880 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.888+0000 7f069b7fe640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c15e880 0x7f069c0c5930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0694009960 tx=0x7f0694004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.889+0000 7f0693fff640 1 -- 172.21.15.97:0/947905137 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694039e20 con 0x7f069c15e880 2023-11-24T08:07:56.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.889+0000 7f0693fff640 1 -- 172.21.15.97:0/947905137 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0694043400 con 0x7f069c15e880 2023-11-24T08:07:56.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.889+0000 7f0693fff640 1 -- 172.21.15.97:0/947905137 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940437b0 con 0x7f069c15e880 2023-11-24T08:07:56.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.889+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c1f3020 con 0x7f069c15e880 2023-11-24T08:07:56.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.889+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c1f35a0 con 0x7f069c15e880 2023-11-24T08:07:56.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.890+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c0675d0 con 0x7f069c15e880 2023-11-24T08:07:56.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.891+0000 7f0693fff640 1 -- 172.21.15.97:0/947905137 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0694043910 con 0x7f069c15e880 2023-11-24T08:07:56.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.892+0000 7f0693fff640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067c06ae40 0x7f067c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.892+0000 7f0693fff640 1 -- 172.21.15.97:0/947905137 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f069403e070 con 0x7f069c15e880 2023-11-24T08:07:56.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.892+0000 7f069affd640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067c06ae40 0x7f067c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.893+0000 7f069affd640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067c06ae40 0x7f067c06d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f068c00abb0 tx=0x7f068c009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.896 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:56.901 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:56.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:56.896+0000 7f0693fff640 1 -- 172.21.15.97:0/947905137 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0694077bc0 con 0x7f069c15e880 2023-11-24T08:07:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.146+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f069c0ccc20 con 0x7f069c15e880 2023-11-24T08:07:57.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.151+0000 7f0693fff640 1 -- 172.21.15.97:0/947905137 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f069407b1e0 con 0x7f069c15e880 2023-11-24T08:07:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.153+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067c06ae40 msgr2=0x7f067c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.153+0000 7f06a1573640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067c06ae40 0x7f067c06d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f068c00abb0 tx=0x7f068c009250 comp rx=0 tx=0).stop 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.153+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c15e880 msgr2=0x7f069c0c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.153+0000 7f06a1573640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c15e880 0x7f069c0c5930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0694009960 tx=0x7f0694004730 comp rx=0 tx=0).stop 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 shutdown_connections 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067c06ae40 0x7f067c06d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f069c15e880 0x7f069c0c5930 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c099a60 0x7f069c0c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 --2- 172.21.15.97:0/947905137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c06e7c0 0x7f069c153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 >> 172.21.15.97:0/947905137 conn(0x7f069c0b2d00 msgr2=0x7f069c0cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 shutdown_connections 2023-11-24T08:07:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.154+0000 7f06a1573640 1 -- 172.21.15.97:0/947905137 wait complete. 2023-11-24T08:07:57.172 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T08:07:57.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.377+0000 7f40b99ef640 1 Processor -- start 2023-11-24T08:07:57.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.378+0000 7f40b99ef640 1 -- start start 2023-11-24T08:07:57.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.379+0000 7f40b99ef640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40b40d0100 0x7f40b40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.379+0000 7f40b99ef640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f40b40d0f40 0x7f40b40d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.379+0000 7f40b99ef640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b40d0a10 con 0x7f40b4160920 2023-11-24T08:07:57.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.379+0000 7f40b99ef640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40cf080 con 0x7f40b40d0100 2023-11-24T08:07:57.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.379+0000 7f40b99ef640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40c6be0 con 0x7f40b40d0f40 2023-11-24T08:07:57.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.379+0000 7f40b3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40b40d0100 0x7f40b40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40b40d0100 0x7f40b40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46366/0 (socket says 172.21.15.97:46366) 2023-11-24T08:07:57.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b3fff640 1 -- 172.21.15.97:0/162373283 learned_addr learned my addr 172.21.15.97:0/162373283 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:57.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b91ee640 1 --2- 172.21.15.97:0/162373283 >> v2:172.21.15.183:3300/0 conn(0x7f40b40d0f40 0x7f40b40d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b3fff640 1 -- 172.21.15.97:0/162373283 >> v2:172.21.15.183:3300/0 conn(0x7f40b40d0f40 msgr2=0x7f40b40d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:57.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b3fff640 1 --2- 172.21.15.97:0/162373283 >> v2:172.21.15.183:3300/0 conn(0x7f40b40d0f40 0x7f40b40d1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b3fff640 1 -- 172.21.15.97:0/162373283 >> v1:172.21.15.183:6789/0 conn(0x7f40b4160920 legacy=0x7f40b40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:57.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b3fff640 1 -- 172.21.15.97:0/162373283 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40ce7e0 con 0x7f40b40d0100 2023-11-24T08:07:57.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.380+0000 7f40b91ee640 1 --2- 172.21.15.97:0/162373283 >> v2:172.21.15.183:3300/0 conn(0x7f40b40d0f40 0x7f40b40d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:57.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.381+0000 7f40b3fff640 1 --2- 172.21.15.97:0/162373283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40b3f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f40b41620b0 tx=0x7f40a402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a75c9e74c5ee4bf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:57.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.381+0000 7f40b37fe640 1 -- 172.21.15.97:0/162373283 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a402ca80 con 0x7f40b40d0100 2023-11-24T08:07:57.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.381+0000 7f40b37fe640 1 -- 172.21.15.97:0/162373283 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a402cbe0 con 0x7f40b40d0100 2023-11-24T08:07:57.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.381+0000 7f40b37fe640 1 -- 172.21.15.97:0/162373283 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a40343f0 con 0x7f40b40d0100 2023-11-24T08:07:57.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 -- 172.21.15.97:0/162373283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 msgr2=0x7f40b40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 --2- 172.21.15.97:0/162373283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40b3f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f40b41620b0 tx=0x7f40a402bee0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 -- 172.21.15.97:0/162373283 shutdown_connections 2023-11-24T08:07:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 --2- 172.21.15.97:0/162373283 >> v2:172.21.15.183:3300/0 conn(0x7f40b40d0f40 0x7f40b40d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 --2- 172.21.15.97:0/162373283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40b3f30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 -- 172.21.15.97:0/162373283 >> 172.21.15.97:0/162373283 conn(0x7f40b40d3090 msgr2=0x7f40b40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 -- 172.21.15.97:0/162373283 shutdown_connections 2023-11-24T08:07:57.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.382+0000 7f40b99ef640 1 -- 172.21.15.97:0/162373283 wait complete. 2023-11-24T08:07:57.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.384+0000 7f40b99ef640 1 Processor -- start 2023-11-24T08:07:57.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.384+0000 7f40b99ef640 1 -- start start 2023-11-24T08:07:57.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b99ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b99ef640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b40d0f40 0x7f40b415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b99ef640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40b4160920 0x7f40b41f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b99ef640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40cb1b0 con 0x7f40b40d0100 2023-11-24T08:07:57.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b99ef640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40caed0 con 0x7f40b40d0f40 2023-11-24T08:07:57.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b99ef640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40ca300 con 0x7f40b4160920 2023-11-24T08:07:57.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b89ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b89ed640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46380/0 (socket says 172.21.15.97:46380) 2023-11-24T08:07:57.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.385+0000 7f40b89ed640 1 -- 172.21.15.97:0/2183201486 learned_addr learned my addr 172.21.15.97:0/2183201486 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:57.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b3fff640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b40d0f40 0x7f40b415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b91ee640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40b4160920 0x7f40b41f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b89ed640 1 -- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40b4160920 msgr2=0x7f40b41f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b89ed640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40b4160920 0x7f40b41f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b89ed640 1 -- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b40d0f40 msgr2=0x7f40b415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b89ed640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b40d0f40 0x7f40b415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b89ed640 1 -- 172.21.15.97:0/2183201486 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4009b30 con 0x7f40b40d0100 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b3fff640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b40d0f40 0x7f40b415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b89ed640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40cd100 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b3f0 tx=0x7f409c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.386+0000 7f40b17fa640 1 -- 172.21.15.97:0/2183201486 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011830 con 0x7f40b40d0100 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.387+0000 7f40b17fa640 1 -- 172.21.15.97:0/2183201486 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c011990 con 0x7f40b40d0100 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.387+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b40ca5e0 con 0x7f40b40d0100 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.387+0000 7f40b17fa640 1 -- 172.21.15.97:0/2183201486 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011d40 con 0x7f40b40d0100 2023-11-24T08:07:57.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.387+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b415e6c0 con 0x7f40b40d0100 2023-11-24T08:07:57.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.388+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b40ca140 con 0x7f40b40d0100 2023-11-24T08:07:57.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.389+0000 7f40b17fa640 1 -- 172.21.15.97:0/2183201486 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f409c01a400 con 0x7f40b40d0100 2023-11-24T08:07:57.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.390+0000 7f40b17fa640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f409406ae40 0x7f409406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.390+0000 7f40b17fa640 1 -- 172.21.15.97:0/2183201486 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f409c089180 con 0x7f40b40d0100 2023-11-24T08:07:57.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.390+0000 7f40b3fff640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f409406ae40 0x7f409406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.390+0000 7f40b3fff640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f409406ae40 0x7f409406d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f40a4035000 tx=0x7f40a4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:57.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.395+0000 7f40b17fa640 1 -- 172.21.15.97:0/2183201486 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f409c054570 con 0x7f40b40d0100 2023-11-24T08:07:57.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.634+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f40b4067450 con 0x7f40b40d0100 2023-11-24T08:07:57.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.638+0000 7f40b17fa640 1 -- 172.21.15.97:0/2183201486 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f409c057b90 con 0x7f40b40d0100 2023-11-24T08:07:57.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.640+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f409406ae40 msgr2=0x7f409406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.640+0000 7f40b99ef640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f409406ae40 0x7f409406d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f40a4035000 tx=0x7f40a4030000 comp rx=0 tx=0).stop 2023-11-24T08:07:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.640+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 msgr2=0x7f40b40cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.640+0000 7f40b99ef640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40cd100 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f409c00b3f0 tx=0x7f409c00b8b0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 shutdown_connections 2023-11-24T08:07:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f409406ae40 0x7f409406d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40b4160920 0x7f40b41f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b40d0f40 0x7f40b415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 --2- 172.21.15.97:0/2183201486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40b40d0100 0x7f40b40cd100 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 >> 172.21.15.97:0/2183201486 conn(0x7f40b40d3090 msgr2=0x7f40b4160e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:57.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 shutdown_connections 2023-11-24T08:07:57.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.641+0000 7f40b99ef640 1 -- 172.21.15.97:0/2183201486 wait complete. 2023-11-24T08:07:57.659 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T08:07:57.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.862+0000 7f8485762640 1 Processor -- start 2023-11-24T08:07:57.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.863+0000 7f8485762640 1 -- start start 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.864+0000 7f8485762640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8480071410 0x7f8480146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.864+0000 7f8485762640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8480071f00 0x7f8480166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.864+0000 7f8485762640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84800b2e10 con 0x7f848006c7c0 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.864+0000 7f8485762640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848006cc50 con 0x7f8480071f00 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.864+0000 7f8485762640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848006cec0 con 0x7f8480071410 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.864+0000 7f8484f61640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8480071f00 0x7f8480166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.865+0000 7f8484f61640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8480071f00 0x7f8480166cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46384/0 (socket says 172.21.15.97:46384) 2023-11-24T08:07:57.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.865+0000 7f8484f61640 1 -- 172.21.15.97:0/639885096 learned_addr learned my addr 172.21.15.97:0/639885096 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:57.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.865+0000 7f8484f61640 1 -- 172.21.15.97:0/639885096 >> v2:172.21.15.183:3300/0 conn(0x7f8480071410 msgr2=0x7f8480146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:57.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.865+0000 7f8484f61640 1 --2- 172.21.15.97:0/639885096 >> v2:172.21.15.183:3300/0 conn(0x7f8480071410 0x7f8480146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.865+0000 7f8484f61640 1 -- 172.21.15.97:0/639885096 >> v1:172.21.15.183:6789/0 conn(0x7f848006c7c0 legacy=0x7f84800717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:57.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.865+0000 7f8484f61640 1 -- 172.21.15.97:0/639885096 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848006d1a0 con 0x7f8480071f00 2023-11-24T08:07:57.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.866+0000 7f8484f61640 1 --2- 172.21.15.97:0/639885096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8480071f00 0x7f8480166cf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f84800ad5f0 tx=0x7f847802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e022d66c1dcef743 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:57.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.866+0000 7f847effd640 1 -- 172.21.15.97:0/639885096 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478031870 con 0x7f8480071f00 2023-11-24T08:07:57.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.866+0000 7f847effd640 1 -- 172.21.15.97:0/639885096 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84780319d0 con 0x7f8480071f00 2023-11-24T08:07:57.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.866+0000 7f847effd640 1 -- 172.21.15.97:0/639885096 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478031d60 con 0x7f8480071f00 2023-11-24T08:07:57.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 -- 172.21.15.97:0/639885096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8480071f00 msgr2=0x7f8480166cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 --2- 172.21.15.97:0/639885096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8480071f00 0x7f8480166cf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f84800ad5f0 tx=0x7f847802b910 comp rx=0 tx=0).stop 2023-11-24T08:07:57.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 -- 172.21.15.97:0/639885096 shutdown_connections 2023-11-24T08:07:57.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 --2- 172.21.15.97:0/639885096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8480071f00 0x7f8480166cf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 --2- 172.21.15.97:0/639885096 >> v2:172.21.15.183:3300/0 conn(0x7f8480071410 0x7f8480146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 -- 172.21.15.97:0/639885096 >> 172.21.15.97:0/639885096 conn(0x7f848006a800 msgr2=0x7f848006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:57.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 -- 172.21.15.97:0/639885096 shutdown_connections 2023-11-24T08:07:57.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.867+0000 7f8485762640 1 -- 172.21.15.97:0/639885096 wait complete. 2023-11-24T08:07:57.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.869+0000 7f8485762640 1 Processor -- start 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.869+0000 7f8485762640 1 -- start start 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f8485762640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f848006c7c0 0x7f8480134590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f8485762640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8480071410 0x7f84801602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f8485762640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8480071f00 0x7f84800c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f8485762640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848015fe10 con 0x7f848006c7c0 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f8485762640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848015f200 con 0x7f8480071410 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f8485762640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848015f4e0 con 0x7f8480071f00 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f847ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f848006c7c0 0x7f8480134590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f847ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f848006c7c0 0x7f8480134590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46398/0 (socket says 172.21.15.97:46398) 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.870+0000 7f847ffff640 1 -- 172.21.15.97:0/1186281257 learned_addr learned my addr 172.21.15.97:0/1186281257 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:57.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847ffff640 1 -- 172.21.15.97:0/1186281257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8480071f00 msgr2=0x7f84800c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847ffff640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8480071f00 0x7f84800c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847ffff640 1 -- 172.21.15.97:0/1186281257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8480071410 msgr2=0x7f84801602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847ffff640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8480071410 0x7f84801602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847ffff640 1 -- 172.21.15.97:0/1186281257 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84780094d0 con 0x7f848006c7c0 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847ffff640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f848006c7c0 0x7f8480134590 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f847000ba50 tx=0x7f847000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847cff9640 1 -- 172.21.15.97:0/1186281257 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847000cbe0 con 0x7f848006c7c0 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847cff9640 1 -- 172.21.15.97:0/1186281257 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847000cd60 con 0x7f848006c7c0 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848015f7c0 con 0x7f848006c7c0 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f847cff9640 1 -- 172.21.15.97:0/1186281257 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470014680 con 0x7f848006c7c0 2023-11-24T08:07:57.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.871+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84801607e0 con 0x7f848006c7c0 2023-11-24T08:07:57.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.872+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8480067450 con 0x7f848006c7c0 2023-11-24T08:07:57.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.873+0000 7f847cff9640 1 -- 172.21.15.97:0/1186281257 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f847001d3b0 con 0x7f848006c7c0 2023-11-24T08:07:57.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.874+0000 7f847cff9640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f846c06ae40 0x7f846c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:57.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.874+0000 7f847cff9640 1 -- 172.21.15.97:0/1186281257 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8470089350 con 0x7f848006c7c0 2023-11-24T08:07:57.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.874+0000 7f847f7fe640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f846c06ae40 0x7f846c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:57.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.875+0000 7f847f7fe640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f846c06ae40 0x7f846c06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84800b22b0 tx=0x7f8474007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:57.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:57.878+0000 7f847cff9640 1 -- 172.21.15.97:0/1186281257 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84700546b0 con 0x7f848006c7c0 2023-11-24T08:07:58.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.138+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f84800b22e0 con 0x7f848006c7c0 2023-11-24T08:07:58.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.143+0000 7f847cff9640 1 -- 172.21.15.97:0/1186281257 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8470057cd0 con 0x7f848006c7c0 2023-11-24T08:07:58.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f846c06ae40 msgr2=0x7f846c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f846c06ae40 0x7f846c06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84800b22b0 tx=0x7f8474007990 comp rx=0 tx=0).stop 2023-11-24T08:07:58.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f848006c7c0 msgr2=0x7f8480134590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f848006c7c0 0x7f8480134590 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f847000ba50 tx=0x7f847000bf10 comp rx=0 tx=0).stop 2023-11-24T08:07:58.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 shutdown_connections 2023-11-24T08:07:58.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f846c06ae40 0x7f846c06d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8480071f00 0x7f84800c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8480071410 0x7f84801602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 --2- 172.21.15.97:0/1186281257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f848006c7c0 0x7f8480134590 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.145+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 >> 172.21.15.97:0/1186281257 conn(0x7f848006a800 msgr2=0x7f848006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:58.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.146+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 shutdown_connections 2023-11-24T08:07:58.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.146+0000 7f8485762640 1 -- 172.21.15.97:0/1186281257 wait complete. 2023-11-24T08:07:58.167 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T08:07:58.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.376+0000 7f1685553640 1 Processor -- start 2023-11-24T08:07:58.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.376+0000 7f1685553640 1 -- start start 2023-11-24T08:07:58.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.377+0000 7f1685553640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f168013e360 0x7f16800cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.377+0000 7f1685553640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f168015f9c0 0x7f16800cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.377+0000 7f1685553640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168015c5f0 con 0x7f168013df80 2023-11-24T08:07:58.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1685553640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168006c470 con 0x7f168013e360 2023-11-24T08:07:58.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1685553640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168006c750 con 0x7f168015f9c0 2023-11-24T08:07:58.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1677fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f168013e360 0x7f16800cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1677fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f168013e360 0x7f16800cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46400/0 (socket says 172.21.15.97:46400) 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1677fff640 1 -- 172.21.15.97:0/2057741110 learned_addr learned my addr 172.21.15.97:0/2057741110 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f167f7fe640 1 --2- 172.21.15.97:0/2057741110 >> v2:172.21.15.183:3300/0 conn(0x7f168015f9c0 0x7f16800cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1677fff640 1 -- 172.21.15.97:0/2057741110 >> v2:172.21.15.183:3300/0 conn(0x7f168015f9c0 msgr2=0x7f16800cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1677fff640 1 --2- 172.21.15.97:0/2057741110 >> v2:172.21.15.183:3300/0 conn(0x7f168015f9c0 0x7f16800cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1677fff640 1 -- 172.21.15.97:0/2057741110 >> v1:172.21.15.183:6789/0 conn(0x7f168013df80 legacy=0x7f168015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f1677fff640 1 -- 172.21.15.97:0/2057741110 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168006ca30 con 0x7f168013e360 2023-11-24T08:07:58.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.378+0000 7f167f7fe640 1 --2- 172.21.15.97:0/2057741110 >> v2:172.21.15.183:3300/0 conn(0x7f168015f9c0 0x7f16800cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:58.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.380+0000 7f1677fff640 1 --2- 172.21.15.97:0/2057741110 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800cf290 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f168006ded0 tx=0x7f166802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749db395e87d6b39 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.380+0000 7f167e7fc640 1 -- 172.21.15.97:0/2057741110 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668031640 con 0x7f168013e360 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.380+0000 7f167e7fc640 1 -- 172.21.15.97:0/2057741110 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16680317a0 con 0x7f168013e360 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.380+0000 7f167e7fc640 1 -- 172.21.15.97:0/2057741110 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668031b30 con 0x7f168013e360 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 -- 172.21.15.97:0/2057741110 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 msgr2=0x7f16800cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 --2- 172.21.15.97:0/2057741110 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800cf290 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f168006ded0 tx=0x7f166802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 -- 172.21.15.97:0/2057741110 shutdown_connections 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 --2- 172.21.15.97:0/2057741110 >> v2:172.21.15.183:3300/0 conn(0x7f168015f9c0 0x7f16800cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 --2- 172.21.15.97:0/2057741110 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800cf290 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 -- 172.21.15.97:0/2057741110 >> 172.21.15.97:0/2057741110 conn(0x7f168006a800 msgr2=0x7f168006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 -- 172.21.15.97:0/2057741110 shutdown_connections 2023-11-24T08:07:58.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.381+0000 7f1685553640 1 -- 172.21.15.97:0/2057741110 wait complete. 2023-11-24T08:07:58.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.383+0000 7f1685553640 1 Processor -- start 2023-11-24T08:07:58.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.383+0000 7f1685553640 1 -- start start 2023-11-24T08:07:58.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1685553640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168013df80 0x7f168013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1685553640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1685553640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168015f9c0 0x7f168015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1685553640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680071a70 con 0x7f168013e360 2023-11-24T08:07:58.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1685553640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800711d0 con 0x7f168015f9c0 2023-11-24T08:07:58.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1685553640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800714b0 con 0x7f168013df80 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46402/0 (socket says 172.21.15.97:46402) 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 -- 172.21.15.97:0/319329408 learned_addr learned my addr 172.21.15.97:0/319329408 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 -- 172.21.15.97:0/319329408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168013df80 msgr2=0x7f168013d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f167effd640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168013df80 0x7f168013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168013df80 0x7f168013d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 -- 172.21.15.97:0/319329408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168015f9c0 msgr2=0x7f168015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168015f9c0 0x7f168015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.384+0000 7f1677fff640 1 -- 172.21.15.97:0/319329408 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680094d0 con 0x7f168013e360 2023-11-24T08:07:58.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.385+0000 7f1677fff640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800afa50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1668000c00 tx=0x7f16680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:58.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.385+0000 7f16777fe640 1 -- 172.21.15.97:0/319329408 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166803ac60 con 0x7f168013e360 2023-11-24T08:07:58.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.385+0000 7f16777fe640 1 -- 172.21.15.97:0/319329408 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166803adc0 con 0x7f168013e360 2023-11-24T08:07:58.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.385+0000 7f16777fe640 1 -- 172.21.15.97:0/319329408 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668044630 con 0x7f168013e360 2023-11-24T08:07:58.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.385+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1680071790 con 0x7f168013e360 2023-11-24T08:07:58.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.385+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16801f3260 con 0x7f168013e360 2023-11-24T08:07:58.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.386+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168014aca0 con 0x7f168013e360 2023-11-24T08:07:58.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.387+0000 7f16777fe640 1 -- 172.21.15.97:0/319329408 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f166802f050 con 0x7f168013e360 2023-11-24T08:07:58.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.388+0000 7f16777fe640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f166006ae40 0x7f166006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.388+0000 7f16777fe640 1 -- 172.21.15.97:0/319329408 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f16680ab450 con 0x7f168013e360 2023-11-24T08:07:58.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.388+0000 7f167effd640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f166006ae40 0x7f166006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.389+0000 7f167effd640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f166006ae40 0x7f166006d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f167000a750 tx=0x7f1670008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:58.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.393+0000 7f16777fe640 1 -- 172.21.15.97:0/319329408 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f168014aca0 con 0x7f168013e360 2023-11-24T08:07:58.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.648+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f168014b080 con 0x7f168013e360 2023-11-24T08:07:58.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.652+0000 7f16777fe640 1 -- 172.21.15.97:0/319329408 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f168014b080 con 0x7f168013e360 2023-11-24T08:07:58.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.654+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f166006ae40 msgr2=0x7f166006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.654+0000 7f1685553640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f166006ae40 0x7f166006d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f167000a750 tx=0x7f1670008040 comp rx=0 tx=0).stop 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.654+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 msgr2=0x7f16800afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.654+0000 7f1685553640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800afa50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1668000c00 tx=0x7f16680046c0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 shutdown_connections 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f166006ae40 0x7f166006d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168015f9c0 0x7f168015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f168013e360 0x7f16800afa50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 --2- 172.21.15.97:0/319329408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168013df80 0x7f168013d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 >> 172.21.15.97:0/319329408 conn(0x7f168006a800 msgr2=0x7f168015df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 shutdown_connections 2023-11-24T08:07:58.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.655+0000 7f1685553640 1 -- 172.21.15.97:0/319329408 wait complete. 2023-11-24T08:07:58.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:58.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.877+0000 7f441a602640 1 Processor -- start 2023-11-24T08:07:58.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.877+0000 7f441a602640 1 -- start start 2023-11-24T08:07:58.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.879+0000 7f441a602640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f441415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.879+0000 7f441a602640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f44140b3ae0 0x7f441406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.879+0000 7f441a602640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4414070c40 con 0x7f441406d120 2023-11-24T08:07:58.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.879+0000 7f441a602640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4414071450 con 0x7f44140b3ae0 2023-11-24T08:07:58.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.879+0000 7f441a602640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441406c470 con 0x7f44140ae5a0 2023-11-24T08:07:58.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.879+0000 7f440bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f44140b3ae0 0x7f441406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.880+0000 7f440bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f44140b3ae0 0x7f441406cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46408/0 (socket says 172.21.15.97:46408) 2023-11-24T08:07:58.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.880+0000 7f440bfff640 1 -- 172.21.15.97:0/1936923421 learned_addr learned my addr 172.21.15.97:0/1936923421 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:58.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.880+0000 7f4413fff640 1 --2- 172.21.15.97:0/1936923421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f441415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.880+0000 7f440bfff640 1 -- 172.21.15.97:0/1936923421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 msgr2=0x7f441415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:58.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.880+0000 7f440bfff640 1 --2- 172.21.15.97:0/1936923421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f441415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.880+0000 7f440bfff640 1 -- 172.21.15.97:0/1936923421 >> v1:172.21.15.183:6789/0 conn(0x7f441406d120 legacy=0x7f44140cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.880+0000 7f440bfff640 1 -- 172.21.15.97:0/1936923421 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441406c750 con 0x7f44140b3ae0 2023-11-24T08:07:58.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.882+0000 7f440bfff640 1 --2- 172.21.15.97:0/1936923421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44140b3ae0 0x7f441406cbe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009870 tx=0x7f43fc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bce8f74bd1fbb97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:58.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.882+0000 7f44137fe640 1 -- 172.21.15.97:0/1936923421 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc030840 con 0x7f44140b3ae0 2023-11-24T08:07:58.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.882+0000 7f44137fe640 1 -- 172.21.15.97:0/1936923421 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc0309a0 con 0x7f44140b3ae0 2023-11-24T08:07:58.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.882+0000 7f44137fe640 1 -- 172.21.15.97:0/1936923421 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc030d30 con 0x7f44140b3ae0 2023-11-24T08:07:58.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.882+0000 7f441a602640 1 -- 172.21.15.97:0/1936923421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44140b3ae0 msgr2=0x7f441406cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.882+0000 7f441a602640 1 --2- 172.21.15.97:0/1936923421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44140b3ae0 0x7f441406cbe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009870 tx=0x7f43fc02b980 comp rx=0 tx=0).stop 2023-11-24T08:07:58.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.883+0000 7f441a602640 1 -- 172.21.15.97:0/1936923421 shutdown_connections 2023-11-24T08:07:58.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.883+0000 7f441a602640 1 --2- 172.21.15.97:0/1936923421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44140b3ae0 0x7f441406cbe0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.883+0000 7f441a602640 1 --2- 172.21.15.97:0/1936923421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f441415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.883+0000 7f441a602640 1 -- 172.21.15.97:0/1936923421 >> 172.21.15.97:0/1936923421 conn(0x7f441406a800 msgr2=0x7f441406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:58.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.883+0000 7f441a602640 1 -- 172.21.15.97:0/1936923421 shutdown_connections 2023-11-24T08:07:58.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.883+0000 7f441a602640 1 -- 172.21.15.97:0/1936923421 wait complete. 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.884+0000 7f441a602640 1 Processor -- start 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.884+0000 7f441a602640 1 -- start start 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.885+0000 7f441a602640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f441406d120 0x7f441414b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.885+0000 7f441a602640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f44141f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.885+0000 7f441a602640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44140b3ae0 0x7f44141f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.885+0000 7f441a602640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441415ca20 con 0x7f441406d120 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.885+0000 7f441a602640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441414be80 con 0x7f44140b3ae0 2023-11-24T08:07:58.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.885+0000 7f441a602640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44141f3b40 con 0x7f44140ae5a0 2023-11-24T08:07:58.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f441406d120 0x7f441414b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f441406d120 0x7f441414b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46416/0 (socket says 172.21.15.97:46416) 2023-11-24T08:07:58.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 -- 172.21.15.97:0/2845405155 learned_addr learned my addr 172.21.15.97:0/2845405155 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:58.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 -- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 msgr2=0x7f44141f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f440bfff640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f44141f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4418b9f640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44140b3ae0 0x7f44141f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f44141f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 -- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44140b3ae0 msgr2=0x7f44141f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:58.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44140b3ae0 0x7f44141f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:58.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 -- 172.21.15.97:0/2845405155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0094d0 con 0x7f441406d120 2023-11-24T08:07:58.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.886+0000 7f4413fff640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f441406d120 0x7f441414b940 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f440400d830 tx=0x7f440400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:58.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.887+0000 7f44117fa640 1 -- 172.21.15.97:0/2845405155 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400b6c0 con 0x7f441406d120 2023-11-24T08:07:58.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.887+0000 7f44117fa640 1 -- 172.21.15.97:0/2845405155 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440400b820 con 0x7f441406d120 2023-11-24T08:07:58.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.887+0000 7f44117fa640 1 -- 172.21.15.97:0/2845405155 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400bbb0 con 0x7f441406d120 2023-11-24T08:07:58.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.887+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441415c3d0 con 0x7f441406d120 2023-11-24T08:07:58.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.887+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44140ce690 con 0x7f441406d120 2023-11-24T08:07:58.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.888+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44140675d0 con 0x7f441406d120 2023-11-24T08:07:58.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.889+0000 7f44117fa640 1 -- 172.21.15.97:0/2845405155 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f440401e460 con 0x7f441406d120 2023-11-24T08:07:58.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.890+0000 7f44117fa640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f43f406ae40 0x7f43f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:58.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.890+0000 7f44117fa640 1 -- 172.21.15.97:0/2845405155 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4404089a40 con 0x7f441406d120 2023-11-24T08:07:58.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.890+0000 7f440bfff640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f43f406ae40 0x7f43f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:58.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.890+0000 7f440bfff640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f43f406ae40 0x7f43f406d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f43fc036000 tx=0x7f43fc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:58.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:58.894+0000 7f44117fa640 1 -- 172.21.15.97:0/2845405155 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f440408be60 con 0x7f441406d120 2023-11-24T08:07:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.084+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44140add50 con 0x7f441406d120 2023-11-24T08:07:59.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.085+0000 7f44117fa640 1 -- 172.21.15.97:0/2845405155 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f4404054e40 con 0x7f441406d120 2023-11-24T08:07:59.087 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:59.087 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":31,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:07:55.160190+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f43f406ae40 msgr2=0x7f43f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f43f406ae40 0x7f43f406d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f43fc036000 tx=0x7f43fc03b040 comp rx=0 tx=0).stop 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f441406d120 msgr2=0x7f441414b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f441406d120 0x7f441414b940 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f440400d830 tx=0x7f440400dcf0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 shutdown_connections 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f43f406ae40 0x7f43f406d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44140b3ae0 0x7f44141f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44140ae5a0 0x7f44141f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 --2- 172.21.15.97:0/2845405155 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f441406d120 0x7f441414b940 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 >> 172.21.15.97:0/2845405155 conn(0x7f441406a800 msgr2=0x7f44141617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 shutdown_connections 2023-11-24T08:07:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.088+0000 7f441a602640 1 -- 172.21.15.97:0/2845405155 wait complete. 2023-11-24T08:07:59.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:59.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:59.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.320+0000 7fa36aba9640 1 Processor -- start 2023-11-24T08:07:59.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.321+0000 7fa36aba9640 1 -- start start 2023-11-24T08:07:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.322+0000 7fa36aba9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413df80 0x7fa36415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.322+0000 7fa36aba9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3640cf9a0 0x7fa3640cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.322+0000 7fa36aba9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36406c470 con 0x7fa36413e360 2023-11-24T08:07:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.322+0000 7fa36aba9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36406c750 con 0x7fa3640cf9a0 2023-11-24T08:07:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.322+0000 7fa36aba9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36406ca30 con 0x7fa36413df80 2023-11-24T08:07:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.323+0000 7fa368945640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413df80 0x7fa36415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.323+0000 7fa368945640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413df80 0x7fa36415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:58528/0 (socket says 172.21.15.97:58528) 2023-11-24T08:07:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.323+0000 7fa368945640 1 -- 172.21.15.97:0/3215908538 learned_addr learned my addr 172.21.15.97:0/3215908538 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:59.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.323+0000 7fa369146640 1 --2- 172.21.15.97:0/3215908538 >> v2:172.21.15.183:3300/0 conn(0x7fa3640cf9a0 0x7fa3640cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.324+0000 7fa369146640 1 -- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413df80 msgr2=0x7fa36415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:59.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.324+0000 7fa369146640 1 --2- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413df80 0x7fa36415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.324+0000 7fa369146640 1 -- 172.21.15.97:0/3215908538 >> v1:172.21.15.183:6789/0 conn(0x7fa36413e360 legacy=0x7fa3640cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.324+0000 7fa369146640 1 -- 172.21.15.97:0/3215908538 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36406cd10 con 0x7fa3640cf9a0 2023-11-24T08:07:59.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.324+0000 7fa368945640 1 --2- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413df80 0x7fa36415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:59.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.326+0000 7fa369146640 1 --2- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3640cf9a0 0x7fa3640cd840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009d90 tx=0x7fa35c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555ab00014483e26 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:59.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.326+0000 7fa3637fe640 1 -- 172.21.15.97:0/3215908538 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c02cc50 con 0x7fa3640cf9a0 2023-11-24T08:07:59.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.326+0000 7fa3637fe640 1 -- 172.21.15.97:0/3215908538 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c02cdb0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.326+0000 7fa3637fe640 1 -- 172.21.15.97:0/3215908538 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c034660 con 0x7fa3640cf9a0 2023-11-24T08:07:59.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 -- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3640cf9a0 msgr2=0x7fa3640cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3640cf9a0 0x7fa3640cd840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009d90 tx=0x7fa35c02bea0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 -- 172.21.15.97:0/3215908538 shutdown_connections 2023-11-24T08:07:59.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3640cf9a0 0x7fa3640cd840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3215908538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413df80 0x7fa36415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 -- 172.21.15.97:0/3215908538 >> 172.21.15.97:0/3215908538 conn(0x7fa36406a800 msgr2=0x7fa36406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:59.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 -- 172.21.15.97:0/3215908538 shutdown_connections 2023-11-24T08:07:59.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.327+0000 7fa36aba9640 1 -- 172.21.15.97:0/3215908538 wait complete. 2023-11-24T08:07:59.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.328+0000 7fa36aba9640 1 Processor -- start 2023-11-24T08:07:59.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.329+0000 7fa36aba9640 1 -- start start 2023-11-24T08:07:59.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.329+0000 7fa36aba9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3640cf9a0 0x7fa364152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.329+0000 7fa36aba9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36413df80 0x7fa364158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.329+0000 7fa36aba9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413e360 0x7fa36415e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.329+0000 7fa36aba9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364159590 con 0x7fa3640cf9a0 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.329+0000 7fa36aba9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364159870 con 0x7fa36413df80 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.329+0000 7fa36aba9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa364159b50 con 0x7fa36413e360 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3640cf9a0 0x7fa364152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3640cf9a0 0x7fa364152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46418/0 (socket says 172.21.15.97:46418) 2023-11-24T08:07:59.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 -- 172.21.15.97:0/3208421352 learned_addr learned my addr 172.21.15.97:0/3208421352 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa363fff640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36413df80 0x7fa364158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 -- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413e360 msgr2=0x7fa36415e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa369146640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413e360 0x7fa36415e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413e360 0x7fa36415e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 -- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36413df80 msgr2=0x7fa364158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36413df80 0x7fa364158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa368945640 1 -- 172.21.15.97:0/3208421352 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580094d0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.330+0000 7fa363fff640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36413df80 0x7fa364158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:59.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.331+0000 7fa368945640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3640cf9a0 0x7fa364152960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e9d0 tx=0x7fa35800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:59.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.331+0000 7fa3617fa640 1 -- 172.21.15.97:0/3208421352 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800ca60 con 0x7fa3640cf9a0 2023-11-24T08:07:59.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.331+0000 7fa3617fa640 1 -- 172.21.15.97:0/3208421352 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35800cbc0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.331+0000 7fa3617fa640 1 -- 172.21.15.97:0/3208421352 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358013470 con 0x7fa3640cf9a0 2023-11-24T08:07:59.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.331+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c009a70 con 0x7fa3640cf9a0 2023-11-24T08:07:59.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.331+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa364152ea0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.332+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3640675d0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.333+0000 7fa3617fa640 1 -- 172.21.15.97:0/3208421352 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3580135d0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.334+0000 7fa3617fa640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa34806ae40 0x7fa34806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.334+0000 7fa3617fa640 1 -- 172.21.15.97:0/3208421352 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3580895a0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.334+0000 7fa363fff640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa34806ae40 0x7fa34806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.335+0000 7fa363fff640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa34806ae40 0x7fa34806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa36413b2e0 tx=0x7fa350009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:59.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.338+0000 7fa3617fa640 1 -- 172.21.15.97:0/3208421352 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa358054990 con 0x7fa3640cf9a0 2023-11-24T08:07:59.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.527+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa36406df00 con 0x7fa3640cf9a0 2023-11-24T08:07:59.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.528+0000 7fa3617fa640 1 -- 172.21.15.97:0/3208421352 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa358057fb0 con 0x7fa3640cf9a0 2023-11-24T08:07:59.530 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:07:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.530+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa34806ae40 msgr2=0x7fa34806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.530+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa34806ae40 0x7fa34806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa36413b2e0 tx=0x7fa350009040 comp rx=0 tx=0).stop 2023-11-24T08:07:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.530+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3640cf9a0 msgr2=0x7fa364152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.530+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3640cf9a0 0x7fa364152960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e9d0 tx=0x7fa35800ee90 comp rx=0 tx=0).stop 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 shutdown_connections 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa34806ae40 0x7fa34806d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa36413e360 0x7fa36415e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa36413df80 0x7fa364158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 --2- 172.21.15.97:0/3208421352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3640cf9a0 0x7fa364152960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 >> 172.21.15.97:0/3208421352 conn(0x7fa36406a800 msgr2=0x7fa36415bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 shutdown_connections 2023-11-24T08:07:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.531+0000 7fa36aba9640 1 -- 172.21.15.97:0/3208421352 wait complete. 2023-11-24T08:07:59.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:07:59.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.764+0000 7fb0327c5640 1 Processor -- start 2023-11-24T08:07:59.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.764+0000 7fb0327c5640 1 -- start start 2023-11-24T08:07:59.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.765+0000 7fb0327c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb02c13df80 0x7fb02c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.765+0000 7fb0327c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13e360 0x7fb02c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb0327c5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c06c470 con 0x7fb02c15f9c0 2023-11-24T08:07:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb0327c5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c06c750 con 0x7fb02c13df80 2023-11-24T08:07:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb0327c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06ca30 con 0x7fb02c13e360 2023-11-24T08:07:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb02c13df80 0x7fb02c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb02c13df80 0x7fb02c15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46428/0 (socket says 172.21.15.97:46428) 2023-11-24T08:07:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb030d62640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb02c15f9c0 0x7fb02c1408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40704/0 (socket says 172.21.15.97:40704) 2023-11-24T08:07:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02bfff640 1 -- 172.21.15.97:0/862244064 learned_addr learned my addr 172.21.15.97:0/862244064 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:59.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb023fff640 1 --2- 172.21.15.97:0/862244064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13e360 0x7fb02c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02bfff640 1 -- 172.21.15.97:0/862244064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13e360 msgr2=0x7fb02c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:59.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02bfff640 1 --2- 172.21.15.97:0/862244064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13e360 0x7fb02c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02bfff640 1 -- 172.21.15.97:0/862244064 >> v1:172.21.15.97:6789/0 conn(0x7fb02c15f9c0 legacy=0x7fb02c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02bfff640 1 -- 172.21.15.97:0/862244064 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c06cd10 con 0x7fb02c13df80 2023-11-24T08:07:59.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb023fff640 1 --2- 172.21.15.97:0/862244064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13e360 0x7fb02c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:59.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.766+0000 7fb02b7fe640 1 -- 172.21.15.97:0/862244064 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250306197 0 0) 0x7fb02c06c470 con 0x7fb02c15f9c0 2023-11-24T08:07:59.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.767+0000 7fb02bfff640 1 --2- 172.21.15.97:0/862244064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13df80 0x7fb02c15bee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009870 tx=0x7fb01c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ad10ad7b9203d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:59.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb02b7fe640 1 -- 172.21.15.97:0/862244064 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c030840 con 0x7fb02c13df80 2023-11-24T08:07:59.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb02b7fe640 1 -- 172.21.15.97:0/862244064 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c0309a0 con 0x7fb02c13df80 2023-11-24T08:07:59.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb02b7fe640 1 -- 172.21.15.97:0/862244064 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c030d30 con 0x7fb02c13df80 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb0327c5640 1 -- 172.21.15.97:0/862244064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13df80 msgr2=0x7fb02c15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb0327c5640 1 --2- 172.21.15.97:0/862244064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13df80 0x7fb02c15bee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009870 tx=0x7fb01c02b980 comp rx=0 tx=0).stop 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb0327c5640 1 -- 172.21.15.97:0/862244064 shutdown_connections 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb0327c5640 1 --2- 172.21.15.97:0/862244064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13e360 0x7fb02c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb0327c5640 1 --2- 172.21.15.97:0/862244064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13df80 0x7fb02c15bee0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.768+0000 7fb0327c5640 1 -- 172.21.15.97:0/862244064 >> 172.21.15.97:0/862244064 conn(0x7fb02c06a800 msgr2=0x7fb02c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.769+0000 7fb0327c5640 1 -- 172.21.15.97:0/862244064 shutdown_connections 2023-11-24T08:07:59.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.769+0000 7fb0327c5640 1 -- 172.21.15.97:0/862244064 wait complete. 2023-11-24T08:07:59.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.770+0000 7fb0327c5640 1 Processor -- start 2023-11-24T08:07:59.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.770+0000 7fb0327c5640 1 -- start start 2023-11-24T08:07:59.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.771+0000 7fb0327c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13df80 0x7fb02c1f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.771+0000 7fb0327c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13e360 0x7fb02c144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.771+0000 7fb0327c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c15f9c0 0x7fb02c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.771+0000 7fb0327c5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c142c60 con 0x7fb02c13e360 2023-11-24T08:07:59.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.771+0000 7fb0327c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1454d0 con 0x7fb02c15f9c0 2023-11-24T08:07:59.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.771+0000 7fb0327c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1457b0 con 0x7fb02c13df80 2023-11-24T08:07:59.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13e360 0x7fb02c144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13e360 0x7fb02c144ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46444/0 (socket says 172.21.15.97:46444) 2023-11-24T08:07:59.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 -- 172.21.15.97:0/2172068557 learned_addr learned my addr 172.21.15.97:0/2172068557 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:07:59.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 -- 172.21.15.97:0/2172068557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13df80 msgr2=0x7fb02c1f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13df80 0x7fb02c1f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 -- 172.21.15.97:0/2172068557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c15f9c0 msgr2=0x7fb02c0add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c15f9c0 0x7fb02c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 -- 172.21.15.97:0/2172068557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0094d0 con 0x7fb02c13e360 2023-11-24T08:07:59.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.772+0000 7fb023fff640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13e360 0x7fb02c144ca0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c7f0 tx=0x7fb01400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:59.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.773+0000 7fb0297fa640 1 -- 172.21.15.97:0/2172068557 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014007a30 con 0x7fb02c13e360 2023-11-24T08:07:59.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.773+0000 7fb0297fa640 1 -- 172.21.15.97:0/2172068557 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb014007b90 con 0x7fb02c13e360 2023-11-24T08:07:59.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.773+0000 7fb0297fa640 1 -- 172.21.15.97:0/2172068557 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400ce40 con 0x7fb02c13e360 2023-11-24T08:07:59.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.773+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c145a90 con 0x7fb02c13e360 2023-11-24T08:07:59.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.773+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c1451e0 con 0x7fb02c13e360 2023-11-24T08:07:59.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.774+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c1430b0 con 0x7fb02c13e360 2023-11-24T08:07:59.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.775+0000 7fb0297fa640 1 -- 172.21.15.97:0/2172068557 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0140113f0 con 0x7fb02c13e360 2023-11-24T08:07:59.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.776+0000 7fb0297fa640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb00c06ae70 0x7fb00c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:59.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.776+0000 7fb0297fa640 1 -- 172.21.15.97:0/2172068557 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb014089540 con 0x7fb02c13e360 2023-11-24T08:07:59.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.776+0000 7fb02bfff640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb00c06ae70 0x7fb00c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:59.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.777+0000 7fb02bfff640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb00c06ae70 0x7fb00c06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb01c036000 tx=0x7fb01c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:59.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.780+0000 7fb0297fa640 1 -- 172.21.15.97:0/2172068557 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb02c1430b0 con 0x7fb02c13e360 2023-11-24T08:07:59.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.971+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb02c1430b0 con 0x7fb02c13e360 2023-11-24T08:07:59.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.972+0000 7fb0297fa640 1 -- 172.21.15.97:0/2172068557 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb02c1430b0 con 0x7fb02c13e360 2023-11-24T08:07:59.974 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:07:59.974 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-11-24T08:07:59.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:07:59.974 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-11-24T08:07:59.974 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-11-24T08:07:59.974 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:07:59.975 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.974+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb00c06ae70 msgr2=0x7fb00c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.974+0000 7fb0327c5640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb00c06ae70 0x7fb00c06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb01c036000 tx=0x7fb01c03b040 comp rx=0 tx=0).stop 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.974+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13e360 msgr2=0x7fb02c144ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.974+0000 7fb0327c5640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13e360 0x7fb02c144ca0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c7f0 tx=0x7fb01400cbf0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 shutdown_connections 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb00c06ae70 0x7fb00c06d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb02c15f9c0 0x7fb02c0add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb02c13e360 0x7fb02c144ca0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 --2- 172.21.15.97:0/2172068557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb02c13df80 0x7fb02c1f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:59.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 >> 172.21.15.97:0/2172068557 conn(0x7fb02c06a800 msgr2=0x7fb02c0b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:59.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 shutdown_connections 2023-11-24T08:07:59.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:07:59.975+0000 7fb0327c5640 1 -- 172.21.15.97:0/2172068557 wait complete. 2023-11-24T08:07:59.995 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:07:59.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:08:00.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.211+0000 7f1f697dc640 1 Processor -- start 2023-11-24T08:08:00.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.211+0000 7f1f697dc640 1 -- start start 2023-11-24T08:08:00.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.212+0000 7f1f697dc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1f6413df80 0x7f1f6415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:00.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.212+0000 7f1f697dc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f6413e360 0x7f1f640cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:00.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.212+0000 7f1f697dc640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6406c470 con 0x7f1f6415f9c0 2023-11-24T08:08:00.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.212+0000 7f1f697dc640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6406c750 con 0x7f1f6413e360 2023-11-24T08:08:00.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.212+0000 7f1f697dc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6406ca30 con 0x7f1f6413df80 2023-11-24T08:08:00.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f627fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f6413e360 0x7f1f640cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:00.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f637fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1f6415f9c0 0x7f1f641408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40716/0 (socket says 172.21.15.97:40716) 2023-11-24T08:08:00.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f637fe640 1 -- 172.21.15.97:0/1961633614 learned_addr learned my addr 172.21.15.97:0/1961633614 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:00.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f62ffd640 1 --2- 172.21.15.97:0/1961633614 >> v2:172.21.15.183:3300/0 conn(0x7f1f6413df80 0x7f1f6415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:00.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f627fc640 1 -- 172.21.15.97:0/1961633614 >> v2:172.21.15.183:3300/0 conn(0x7f1f6413df80 msgr2=0x7f1f6415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:00.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f61ffb640 1 -- 172.21.15.97:0/1961633614 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158977098 0 0) 0x7f1f6406c470 con 0x7f1f6415f9c0 2023-11-24T08:08:00.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f627fc640 1 --2- 172.21.15.97:0/1961633614 >> v2:172.21.15.183:3300/0 conn(0x7f1f6413df80 0x7f1f6415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:00.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f627fc640 1 -- 172.21.15.97:0/1961633614 >> v1:172.21.15.97:6789/0 conn(0x7f1f6415f9c0 legacy=0x7f1f641408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:00.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f627fc640 1 -- 172.21.15.97:0/1961633614 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6406cd10 con 0x7f1f6413e360 2023-11-24T08:08:00.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.213+0000 7f1f62ffd640 1 --2- 172.21.15.97:0/1961633614 >> v2:172.21.15.183:3300/0 conn(0x7f1f6413df80 0x7f1f6415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:00.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.214+0000 7f1f627fc640 1 --2- 172.21.15.97:0/1961633614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413e360 0x7f1f640cf290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f64072770 tx=0x7f1f5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e277aef6b5247130 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:00.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f61ffb640 1 -- 172.21.15.97:0/1961633614 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58031830 con 0x7f1f6413e360 2023-11-24T08:08:00.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f61ffb640 1 -- 172.21.15.97:0/1961633614 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58031990 con 0x7f1f6413e360 2023-11-24T08:08:00.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f61ffb640 1 -- 172.21.15.97:0/1961633614 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58031d20 con 0x7f1f6413e360 2023-11-24T08:08:00.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f697dc640 1 -- 172.21.15.97:0/1961633614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413e360 msgr2=0x7f1f640cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:00.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f697dc640 1 --2- 172.21.15.97:0/1961633614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413e360 0x7f1f640cf290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f64072770 tx=0x7f1f5802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:08:00.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f697dc640 1 -- 172.21.15.97:0/1961633614 shutdown_connections 2023-11-24T08:08:00.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f697dc640 1 --2- 172.21.15.97:0/1961633614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413e360 0x7f1f640cf290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:00.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f697dc640 1 --2- 172.21.15.97:0/1961633614 >> v2:172.21.15.183:3300/0 conn(0x7f1f6413df80 0x7f1f6415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:00.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.215+0000 7f1f697dc640 1 -- 172.21.15.97:0/1961633614 >> 172.21.15.97:0/1961633614 conn(0x7f1f6406a800 msgr2=0x7f1f6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:00.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.216+0000 7f1f697dc640 1 -- 172.21.15.97:0/1961633614 shutdown_connections 2023-11-24T08:08:00.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.216+0000 7f1f697dc640 1 -- 172.21.15.97:0/1961633614 wait complete. 2023-11-24T08:08:00.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.217+0000 7f1f697dc640 1 Processor -- start 2023-11-24T08:08:00.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.217+0000 7f1f697dc640 1 -- start start 2023-11-24T08:08:00.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.218+0000 7f1f697dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413df80 0x7f1f6413abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:00.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.218+0000 7f1f697dc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f6413e360 0x7f1f64159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:00.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.218+0000 7f1f697dc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f6415f9c0 0x7f1f6415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:00.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.218+0000 7f1f697dc640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641523f0 con 0x7f1f6413df80 2023-11-24T08:08:00.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.218+0000 7f1f697dc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641526d0 con 0x7f1f6415f9c0 2023-11-24T08:08:00.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.218+0000 7f1f697dc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641529b0 con 0x7f1f6413e360 2023-11-24T08:08:00.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413df80 0x7f1f6413abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:00.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413df80 0x7f1f6413abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46458/0 (socket says 172.21.15.97:46458) 2023-11-24T08:08:00.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 -- 172.21.15.97:0/2907952620 learned_addr learned my addr 172.21.15.97:0/2907952620 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:00.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f627fc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f6413e360 0x7f1f64159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:00.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 -- 172.21.15.97:0/2907952620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f6413e360 msgr2=0x7f1f64159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:00.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f6413e360 0x7f1f64159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:00.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 -- 172.21.15.97:0/2907952620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f6415f9c0 msgr2=0x7f1f6415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:00.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f6415f9c0 0x7f1f6415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:00.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 -- 172.21.15.97:0/2907952620 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58009400 con 0x7f1f6413df80 2023-11-24T08:08:00.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.219+0000 7f1f62ffd640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413df80 0x7f1f6413abc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c7f0 tx=0x7f1f5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:00.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.220+0000 7f1f4b7fe640 1 -- 172.21.15.97:0/2907952620 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54007820 con 0x7f1f6413df80 2023-11-24T08:08:00.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.220+0000 7f1f4b7fe640 1 -- 172.21.15.97:0/2907952620 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f54007980 con 0x7f1f6413df80 2023-11-24T08:08:00.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.220+0000 7f1f4b7fe640 1 -- 172.21.15.97:0/2907952620 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54007cf0 con 0x7f1f6413df80 2023-11-24T08:08:00.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.220+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64152c90 con 0x7f1f6413df80 2023-11-24T08:08:00.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.220+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64151ef0 con 0x7f1f6413df80 2023-11-24T08:08:00.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.221+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f64152140 con 0x7f1f6413df80 2023-11-24T08:08:00.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.222+0000 7f1f4b7fe640 1 -- 172.21.15.97:0/2907952620 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f540113f0 con 0x7f1f6413df80 2023-11-24T08:08:00.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.223+0000 7f1f4b7fe640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1f5006ae40 0x7f1f5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:00.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.223+0000 7f1f4b7fe640 1 -- 172.21.15.97:0/2907952620 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f54089670 con 0x7f1f6413df80 2023-11-24T08:08:00.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.223+0000 7f1f627fc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1f5006ae40 0x7f1f5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:00.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.224+0000 7f1f627fc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1f5006ae40 0x7f1f5006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f58036000 tx=0x7f1f58008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:00.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.227+0000 7f1f4b7fe640 1 -- 172.21.15.97:0/2907952620 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f540549d0 con 0x7f1f6413df80 2023-11-24T08:08:00.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:00.419+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1f640675d0 con 0x7f1f6413df80 2023-11-24T08:08:01.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.177+0000 7f1f4b7fe640 1 -- 172.21.15.97:0/2907952620 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1f54057ff0 con 0x7f1f6413df80 2023-11-24T08:08:01.179 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2023-11-24T08:08:01.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1f5006ae40 msgr2=0x7f1f5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:01.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1f5006ae40 0x7f1f5006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f58036000 tx=0x7f1f58008030 comp rx=0 tx=0).stop 2023-11-24T08:08:01.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413df80 msgr2=0x7f1f6413abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:01.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413df80 0x7f1f6413abc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c7f0 tx=0x7f1f5400ccb0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 shutdown_connections 2023-11-24T08:08:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f1f5006ae40 0x7f1f5006d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f6415f9c0 0x7f1f6415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f6413e360 0x7f1f64159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 --2- 172.21.15.97:0/2907952620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f6413df80 0x7f1f6413abc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 >> 172.21.15.97:0/2907952620 conn(0x7f1f6406a800 msgr2=0x7f1f640b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.181+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 shutdown_connections 2023-11-24T08:08:01.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.182+0000 7f1f697dc640 1 -- 172.21.15.97:0/2907952620 wait complete. 2023-11-24T08:08:01.209 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:08:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.407+0000 7f24c5f33640 1 Processor -- start 2023-11-24T08:08:01.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.407+0000 7f24c5f33640 1 -- start start 2023-11-24T08:08:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24c5f33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c00d0200 0x7f24c00ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24c5f33640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f24c00ce670 0x7f24c00b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24c5f33640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00b66d0 con 0x7f24c015d510 2023-11-24T08:08:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24c5f33640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c00cf170 con 0x7f24c00ce670 2023-11-24T08:08:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24c5f33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00cee90 con 0x7f24c00d0200 2023-11-24T08:08:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24bf7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f24c015d510 0x7f24c00cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40724/0 (socket says 172.21.15.97:40724) 2023-11-24T08:08:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24bf7fe640 1 -- 172.21.15.97:0/3680020878 learned_addr learned my addr 172.21.15.97:0/3680020878 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24bffff640 1 --2- 172.21.15.97:0/3680020878 >> v2:172.21.15.97:3300/0 conn(0x7f24c00ce670 0x7f24c00b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24b7fff640 1 --2- 172.21.15.97:0/3680020878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c00d0200 0x7f24c00ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24beffd640 1 -- 172.21.15.97:0/3680020878 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826624109 0 0) 0x7f24c00b66d0 con 0x7f24c015d510 2023-11-24T08:08:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.409+0000 7f24beffd640 1 -- 172.21.15.97:0/3680020878 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ac003520 con 0x7f24c015d510 2023-11-24T08:08:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.410+0000 7f24bffff640 1 -- 172.21.15.97:0/3680020878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c00d0200 msgr2=0x7f24c00ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.410+0000 7f24bffff640 1 --2- 172.21.15.97:0/3680020878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c00d0200 0x7f24c00ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.410+0000 7f24bffff640 1 -- 172.21.15.97:0/3680020878 >> v1:172.21.15.97:6789/0 conn(0x7f24c015d510 legacy=0x7f24c00cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.410+0000 7f24bffff640 1 -- 172.21.15.97:0/3680020878 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00b6080 con 0x7f24c00ce670 2023-11-24T08:08:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.411+0000 7f24bffff640 1 --2- 172.21.15.97:0/3680020878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c00b6b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009d90 tx=0x7f24b802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f7a3fb1c81a06c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:01.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.411+0000 7f24beffd640 1 -- 172.21.15.97:0/3680020878 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b802cc50 con 0x7f24c00ce670 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.411+0000 7f24beffd640 1 -- 172.21.15.97:0/3680020878 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b802cdb0 con 0x7f24c00ce670 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.411+0000 7f24beffd640 1 -- 172.21.15.97:0/3680020878 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8034660 con 0x7f24c00ce670 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 -- 172.21.15.97:0/3680020878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 msgr2=0x7f24c00b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 --2- 172.21.15.97:0/3680020878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c00b6b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009d90 tx=0x7f24b802bea0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 -- 172.21.15.97:0/3680020878 shutdown_connections 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 --2- 172.21.15.97:0/3680020878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c00b6b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 --2- 172.21.15.97:0/3680020878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c00d0200 0x7f24c00ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 -- 172.21.15.97:0/3680020878 >> 172.21.15.97:0/3680020878 conn(0x7f24c009c4c0 msgr2=0x7f24c00d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 -- 172.21.15.97:0/3680020878 shutdown_connections 2023-11-24T08:08:01.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.412+0000 7f24c5f33640 1 -- 172.21.15.97:0/3680020878 wait complete. 2023-11-24T08:08:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.414+0000 7f24c5f33640 1 Processor -- start 2023-11-24T08:08:01.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.414+0000 7f24c5f33640 1 -- start start 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24c5f33640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c01f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24c5f33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24c00d0200 0x7f24c00c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24c5f33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c015d510 0x7f24c00b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24c5f33640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c01f2a70 con 0x7f24c00ce670 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24c5f33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c7e40 con 0x7f24c00d0200 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24c5f33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c0157480 con 0x7f24c015d510 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c01f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c01f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46482/0 (socket says 172.21.15.97:46482) 2023-11-24T08:08:01.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 -- 172.21.15.97:0/1255287038 learned_addr learned my addr 172.21.15.97:0/1255287038 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 -- 172.21.15.97:0/1255287038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c015d510 msgr2=0x7f24c00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c015d510 0x7f24c00b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 -- 172.21.15.97:0/1255287038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24c00d0200 msgr2=0x7f24c00c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24c00d0200 0x7f24c00c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:01.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.415+0000 7f24bf7fe640 1 -- 172.21.15.97:0/1255287038 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8009a70 con 0x7f24c00ce670 2023-11-24T08:08:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.416+0000 7f24bf7fe640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c01f2530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f24b000c410 tx=0x7f24b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.416+0000 7f24bcff9640 1 -- 172.21.15.97:0/1255287038 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0005ce0 con 0x7f24c00ce670 2023-11-24T08:08:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.416+0000 7f24bcff9640 1 -- 172.21.15.97:0/1255287038 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b0005e40 con 0x7f24c00ce670 2023-11-24T08:08:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.416+0000 7f24bcff9640 1 -- 172.21.15.97:0/1255287038 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b00072f0 con 0x7f24c00ce670 2023-11-24T08:08:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.416+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c0157760 con 0x7f24c00ce670 2023-11-24T08:08:01.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.416+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c0157d20 con 0x7f24c00ce670 2023-11-24T08:08:01.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.417+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c00675d0 con 0x7f24c00ce670 2023-11-24T08:08:01.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.419+0000 7f24bcff9640 1 -- 172.21.15.97:0/1255287038 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24b0007510 con 0x7f24c00ce670 2023-11-24T08:08:01.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.419+0000 7f24bcff9640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f24a006ae40 0x7f24a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:01.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.420+0000 7f24bcff9640 1 -- 172.21.15.97:0/1255287038 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f24b0088ae0 con 0x7f24c00ce670 2023-11-24T08:08:01.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.420+0000 7f24b7fff640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f24a006ae40 0x7f24a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:01.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.420+0000 7f24b7fff640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f24a006ae40 0x7f24a006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f24c009c950 tx=0x7f24a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:01.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.425+0000 7f24bcff9640 1 -- 172.21.15.97:0/1255287038 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24b0053e30 con 0x7f24c00ce670 2023-11-24T08:08:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:01.619+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f24c00cfb30 con 0x7f24c00ce670 2023-11-24T08:08:02.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.183+0000 7f24bcff9640 1 -- 172.21.15.97:0/1255287038 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f24b00170d0 con 0x7f24c00ce670 2023-11-24T08:08:02.185 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2023-11-24T08:08:02.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.186+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f24a006ae40 msgr2=0x7f24a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:02.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.186+0000 7f24c5f33640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f24a006ae40 0x7f24a006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f24c009c950 tx=0x7f24a8008040 comp rx=0 tx=0).stop 2023-11-24T08:08:02.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 msgr2=0x7f24c01f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c01f2530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f24b000c410 tx=0x7f24b000c8d0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 shutdown_connections 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f24a006ae40 0x7f24a006d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24c015d510 0x7f24c00b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24c00d0200 0x7f24c00c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 --2- 172.21.15.97:0/1255287038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f24c00ce670 0x7f24c01f2530 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.187+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 >> 172.21.15.97:0/1255287038 conn(0x7f24c009c4c0 msgr2=0x7f24c015fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.188+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 shutdown_connections 2023-11-24T08:08:02.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.189+0000 7f24c5f33640 1 -- 172.21.15.97:0/1255287038 wait complete. 2023-11-24T08:08:02.225 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:08:02.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.411+0000 7f832f59e640 1 Processor -- start 2023-11-24T08:08:02.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.411+0000 7f832f59e640 1 -- start start 2023-11-24T08:08:02.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.412+0000 7f832f59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f83300adf20 0x7f8330070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:02.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.412+0000 7f832f59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f83300ccb50 0x7f8330143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:02.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.412+0000 7f832f59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833015f4e0 con 0x7f833015bf10 2023-11-24T08:08:02.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832f59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833015f970 con 0x7f83300ccb50 2023-11-24T08:08:02.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832f59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8330071130 con 0x7f83300adf20 2023-11-24T08:08:02.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832ed9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f83300ccb50 0x7f8330143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:02.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832ed9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f83300ccb50 0x7f8330143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46488/0 (socket says 172.21.15.97:46488) 2023-11-24T08:08:02.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832ed9d640 1 -- 172.21.15.97:0/2440356830 learned_addr learned my addr 172.21.15.97:0/2440356830 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:02.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832ed9d640 1 -- 172.21.15.97:0/2440356830 >> v2:172.21.15.183:3300/0 conn(0x7f83300adf20 msgr2=0x7f8330070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:02.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832e59c640 1 --2- 172.21.15.97:0/2440356830 >> v2:172.21.15.183:3300/0 conn(0x7f83300adf20 0x7f8330070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:02.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832ed9d640 1 --2- 172.21.15.97:0/2440356830 >> v2:172.21.15.183:3300/0 conn(0x7f83300adf20 0x7f8330070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832ed9d640 1 -- 172.21.15.97:0/2440356830 >> v1:172.21.15.183:6789/0 conn(0x7f833015bf10 legacy=0x7f83300cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:02.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.413+0000 7f832ed9d640 1 -- 172.21.15.97:0/2440356830 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833015c390 con 0x7f83300ccb50 2023-11-24T08:08:02.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.415+0000 7f832ed9d640 1 --2- 172.21.15.97:0/2440356830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330143d30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f83300b4150 tx=0x7f832802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66689dd02300bf6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:02.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.415+0000 7f832d59a640 1 -- 172.21.15.97:0/2440356830 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832802c9f0 con 0x7f83300ccb50 2023-11-24T08:08:02.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.415+0000 7f832d59a640 1 -- 172.21.15.97:0/2440356830 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832802cb50 con 0x7f83300ccb50 2023-11-24T08:08:02.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.415+0000 7f832d59a640 1 -- 172.21.15.97:0/2440356830 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83280343f0 con 0x7f83300ccb50 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 -- 172.21.15.97:0/2440356830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 msgr2=0x7f8330143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 --2- 172.21.15.97:0/2440356830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330143d30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f83300b4150 tx=0x7f832802be50 comp rx=0 tx=0).stop 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 -- 172.21.15.97:0/2440356830 shutdown_connections 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 --2- 172.21.15.97:0/2440356830 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330143d30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 --2- 172.21.15.97:0/2440356830 >> v2:172.21.15.183:3300/0 conn(0x7f83300adf20 0x7f8330070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 -- 172.21.15.97:0/2440356830 >> 172.21.15.97:0/2440356830 conn(0x7f833006a7d0 msgr2=0x7f833006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 -- 172.21.15.97:0/2440356830 shutdown_connections 2023-11-24T08:08:02.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.416+0000 7f832f59e640 1 -- 172.21.15.97:0/2440356830 wait complete. 2023-11-24T08:08:02.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.418+0000 7f832f59e640 1 Processor -- start 2023-11-24T08:08:02.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.418+0000 7f832f59e640 1 -- start start 2023-11-24T08:08:02.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.419+0000 7f832f59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83300adf20 0x7f83300acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:02.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.419+0000 7f832f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:02.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.419+0000 7f832f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f833015bf10 0x7f83301394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:02.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.419+0000 7f832f59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8330139a20 con 0x7f83300ccb50 2023-11-24T08:08:02.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.419+0000 7f832f59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83301f3b10 con 0x7f83300adf20 2023-11-24T08:08:02.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.419+0000 7f832f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83300aea80 con 0x7f833015bf10 2023-11-24T08:08:02.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:02.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330138fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46504/0 (socket says 172.21.15.97:46504) 2023-11-24T08:08:02.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 -- 172.21.15.97:0/3202631241 learned_addr learned my addr 172.21.15.97:0/3202631241 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:02.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832e59c640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83300adf20 0x7f83300acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:02.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832ed9d640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f833015bf10 0x7f83301394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:02.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 -- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f833015bf10 msgr2=0x7f83301394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:02.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f833015bf10 0x7f83301394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 -- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83300adf20 msgr2=0x7f83300acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83300adf20 0x7f83300acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832dd9b640 1 -- 172.21.15.97:0/3202631241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328009b30 con 0x7f83300ccb50 2023-11-24T08:08:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832e59c640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83300adf20 0x7f83300acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.420+0000 7f832ed9d640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f833015bf10 0x7f83301394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.421+0000 7f832dd9b640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330138fa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f831800b3f0 tx=0x7f831800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.421+0000 7f8326ffd640 1 -- 172.21.15.97:0/3202631241 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318011830 con 0x7f83300ccb50 2023-11-24T08:08:02.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.421+0000 7f8326ffd640 1 -- 172.21.15.97:0/3202631241 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8318011990 con 0x7f83300ccb50 2023-11-24T08:08:02.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.421+0000 7f8326ffd640 1 -- 172.21.15.97:0/3202631241 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318011d40 con 0x7f83300ccb50 2023-11-24T08:08:02.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.421+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83300aed60 con 0x7f83300ccb50 2023-11-24T08:08:02.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.421+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83300af320 con 0x7f83300ccb50 2023-11-24T08:08:02.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.422+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83300af540 con 0x7f83300ccb50 2023-11-24T08:08:02.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.423+0000 7f8326ffd640 1 -- 172.21.15.97:0/3202631241 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f831801a400 con 0x7f83300ccb50 2023-11-24T08:08:02.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.425+0000 7f8326ffd640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f831006ae40 0x7f831006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:02.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.425+0000 7f8326ffd640 1 -- 172.21.15.97:0/3202631241 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8318089400 con 0x7f83300ccb50 2023-11-24T08:08:02.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.425+0000 7f832e59c640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f831006ae40 0x7f831006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:02.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.426+0000 7f832e59c640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f831006ae40 0x7f831006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8320008890 tx=0x7f8320008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:02.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.430+0000 7f8326ffd640 1 -- 172.21.15.97:0/3202631241 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8318054500 con 0x7f83300ccb50 2023-11-24T08:08:02.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:02.649+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8330067450 con 0x7f83300ccb50 2023-11-24T08:08:03.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.201+0000 7f8326ffd640 1 -- 172.21.15.97:0/3202631241 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8318057b20 con 0x7f83300ccb50 2023-11-24T08:08:03.203 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T08:08:03.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f831006ae40 msgr2=0x7f831006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f831006ae40 0x7f831006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8320008890 tx=0x7f8320008040 comp rx=0 tx=0).stop 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 msgr2=0x7f8330138fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330138fa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f831800b3f0 tx=0x7f831800b8b0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 shutdown_connections 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f831006ae40 0x7f831006d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f833015bf10 0x7f83301394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83300ccb50 0x7f8330138fa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 --2- 172.21.15.97:0/3202631241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83300adf20 0x7f83300acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.205+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 >> 172.21.15.97:0/3202631241 conn(0x7f833006a7d0 msgr2=0x7f833006abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:03.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.206+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 shutdown_connections 2023-11-24T08:08:03.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.206+0000 7f832f59e640 1 -- 172.21.15.97:0/3202631241 wait complete. 2023-11-24T08:08:03.248 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:03.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.427+0000 7f05858d4640 1 Processor -- start 2023-11-24T08:08:03.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.427+0000 7f05858d4640 1 -- start start 2023-11-24T08:08:03.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.428+0000 7f05858d4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f058013e360 0x7f05800cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.428+0000 7f05858d4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f058015f9c0 0x7f05800cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.428+0000 7f05858d4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058015c5f0 con 0x7f058013df80 2023-11-24T08:08:03.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.428+0000 7f05858d4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058006c470 con 0x7f058013e360 2023-11-24T08:08:03.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.428+0000 7f05858d4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058006c750 con 0x7f058015f9c0 2023-11-24T08:08:03.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.429+0000 7f0577fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f058013e360 0x7f05800cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.429+0000 7f0577fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f058013e360 0x7f05800cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46520/0 (socket says 172.21.15.97:46520) 2023-11-24T08:08:03.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.429+0000 7f0577fff640 1 -- 172.21.15.97:0/3458639833 learned_addr learned my addr 172.21.15.97:0/3458639833 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:03.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.429+0000 7f0577fff640 1 -- 172.21.15.97:0/3458639833 >> v2:172.21.15.183:3300/0 conn(0x7f058015f9c0 msgr2=0x7f05800cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:03.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.429+0000 7f0577fff640 1 --2- 172.21.15.97:0/3458639833 >> v2:172.21.15.183:3300/0 conn(0x7f058015f9c0 0x7f05800cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.429+0000 7f0577fff640 1 -- 172.21.15.97:0/3458639833 >> v1:172.21.15.183:6789/0 conn(0x7f058013df80 legacy=0x7f058015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:03.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.429+0000 7f0577fff640 1 -- 172.21.15.97:0/3458639833 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058006ca30 con 0x7f058013e360 2023-11-24T08:08:03.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.430+0000 7f0577fff640 1 --2- 172.21.15.97:0/3458639833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013e360 0x7f05800cf290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f058006ded0 tx=0x7f056802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706c45e7e7167ad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:03.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f057e7fc640 1 -- 172.21.15.97:0/3458639833 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568031640 con 0x7f058013e360 2023-11-24T08:08:03.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f057e7fc640 1 -- 172.21.15.97:0/3458639833 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680317a0 con 0x7f058013e360 2023-11-24T08:08:03.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f057e7fc640 1 -- 172.21.15.97:0/3458639833 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568031b30 con 0x7f058013e360 2023-11-24T08:08:03.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 -- 172.21.15.97:0/3458639833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013e360 msgr2=0x7f05800cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 --2- 172.21.15.97:0/3458639833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013e360 0x7f05800cf290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f058006ded0 tx=0x7f056802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 -- 172.21.15.97:0/3458639833 shutdown_connections 2023-11-24T08:08:03.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 --2- 172.21.15.97:0/3458639833 >> v2:172.21.15.183:3300/0 conn(0x7f058015f9c0 0x7f05800cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 --2- 172.21.15.97:0/3458639833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013e360 0x7f05800cf290 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 -- 172.21.15.97:0/3458639833 >> 172.21.15.97:0/3458639833 conn(0x7f058006a800 msgr2=0x7f058006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:03.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 -- 172.21.15.97:0/3458639833 shutdown_connections 2023-11-24T08:08:03.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.431+0000 7f05858d4640 1 -- 172.21.15.97:0/3458639833 wait complete. 2023-11-24T08:08:03.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.433+0000 7f05858d4640 1 Processor -- start 2023-11-24T08:08:03.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.433+0000 7f05858d4640 1 -- start start 2023-11-24T08:08:03.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.434+0000 7f05858d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013df80 0x7f05801503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.434+0000 7f05858d4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f058013e360 0x7f05800a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.434+0000 7f05858d4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f058015f9c0 0x7f05800a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.434+0000 7f05858d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580152220 con 0x7f058013df80 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.434+0000 7f05858d4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580152500 con 0x7f058013e360 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.434+0000 7f05858d4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05801527e0 con 0x7f058015f9c0 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013df80 0x7f05801503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013df80 0x7f05801503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46534/0 (socket says 172.21.15.97:46534) 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 -- 172.21.15.97:0/222747643 learned_addr learned my addr 172.21.15.97:0/222747643 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:03.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 -- 172.21.15.97:0/222747643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f058015f9c0 msgr2=0x7f05800a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f058015f9c0 0x7f05800a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 -- 172.21.15.97:0/222747643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f058013e360 msgr2=0x7f05800a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f058013e360 0x7f05800a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 -- 172.21.15.97:0/222747643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05680094d0 con 0x7f058013df80 2023-11-24T08:08:03.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.435+0000 7f057effd640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013df80 0x7f05801503d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f057000b3f0 tx=0x7f057000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:03.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.436+0000 7f057cff9640 1 -- 172.21.15.97:0/222747643 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570011830 con 0x7f058013df80 2023-11-24T08:08:03.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.436+0000 7f057cff9640 1 -- 172.21.15.97:0/222747643 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570011990 con 0x7f058013df80 2023-11-24T08:08:03.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.436+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580152ac0 con 0x7f058013df80 2023-11-24T08:08:03.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.436+0000 7f057cff9640 1 -- 172.21.15.97:0/222747643 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570011d40 con 0x7f058013df80 2023-11-24T08:08:03.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.436+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580150910 con 0x7f058013df80 2023-11-24T08:08:03.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.437+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0580152fe0 con 0x7f058013df80 2023-11-24T08:08:03.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.438+0000 7f057cff9640 1 -- 172.21.15.97:0/222747643 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f057001a400 con 0x7f058013df80 2023-11-24T08:08:03.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.438+0000 7f057cff9640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f056006ae40 0x7f056006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.439+0000 7f057cff9640 1 -- 172.21.15.97:0/222747643 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0570089590 con 0x7f058013df80 2023-11-24T08:08:03.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.439+0000 7f0577fff640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f056006ae40 0x7f056006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.439+0000 7f0577fff640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f056006ae40 0x7f056006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0568036000 tx=0x7f0568030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:03.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.443+0000 7f057cff9640 1 -- 172.21.15.97:0/222747643 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05700545a0 con 0x7f058013df80 2023-11-24T08:08:03.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.627+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05800675d0 con 0x7f058013df80 2023-11-24T08:08:03.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.630+0000 7f057cff9640 1 -- 172.21.15.97:0/222747643 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f0570057bc0 con 0x7f058013df80 2023-11-24T08:08:03.632 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:03.633 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":34,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:02.651179+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:03.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f056006ae40 msgr2=0x7f056006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f056006ae40 0x7f056006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0568036000 tx=0x7f0568030000 comp rx=0 tx=0).stop 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013df80 msgr2=0x7f05801503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013df80 0x7f05801503d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f057000b3f0 tx=0x7f057000b8b0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 shutdown_connections 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f056006ae40 0x7f056006d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f058015f9c0 0x7f05800a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f058013e360 0x7f05800a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 --2- 172.21.15.97:0/222747643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f058013df80 0x7f05801503d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 >> 172.21.15.97:0/222747643 conn(0x7f058006a800 msgr2=0x7f0580070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:03.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 shutdown_connections 2023-11-24T08:08:03.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.633+0000 7f05858d4640 1 -- 172.21.15.97:0/222747643 wait complete. 2023-11-24T08:08:03.652 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:03.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.858+0000 7f2fa3c23640 1 Processor -- start 2023-11-24T08:08:03.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.858+0000 7f2fa3c23640 1 -- start start 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.859+0000 7f2fa3c23640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2f9c13df80 0x7f2f9c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.859+0000 7f2fa3c23640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2f9c13e360 0x7f2f9c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa3c23640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c06c470 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa3c23640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c06c750 con 0x7f2f9c13df80 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa3c23640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c06ca30 con 0x7f2f9c13e360 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa19bf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2f9c13df80 0x7f2f9c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa19bf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2f9c13df80 0x7f2f9c15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46544/0 (socket says 172.21.15.97:46544) 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa19bf640 1 -- 172.21.15.97:0/3747290572 learned_addr learned my addr 172.21.15.97:0/3747290572 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:03.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa19bf640 1 -- 172.21.15.97:0/3747290572 >> v2:172.21.15.183:3300/0 conn(0x7f2f9c13e360 msgr2=0x7f2f9c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:03.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa19bf640 1 --2- 172.21.15.97:0/3747290572 >> v2:172.21.15.183:3300/0 conn(0x7f2f9c13e360 0x7f2f9c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa19bf640 1 -- 172.21.15.97:0/3747290572 >> v1:172.21.15.183:6789/0 conn(0x7f2f9c15f9c0 legacy=0x7f2f9c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:03.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.860+0000 7f2fa19bf640 1 -- 172.21.15.97:0/3747290572 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c06cd10 con 0x7f2f9c13df80 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.861+0000 7f2fa19bf640 1 --2- 172.21.15.97:0/3747290572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c13df80 0x7f2f9c15bee0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c06ded0 tx=0x7f2f9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402d55143fa51c35 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa09bd640 1 -- 172.21.15.97:0/3747290572 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98031870 con 0x7f2f9c13df80 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa09bd640 1 -- 172.21.15.97:0/3747290572 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f980319d0 con 0x7f2f9c13df80 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa09bd640 1 -- 172.21.15.97:0/3747290572 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98031d60 con 0x7f2f9c13df80 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3747290572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c13df80 msgr2=0x7f2f9c15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3747290572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c13df80 0x7f2f9c15bee0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c06ded0 tx=0x7f2f9802b910 comp rx=0 tx=0).stop 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3747290572 shutdown_connections 2023-11-24T08:08:03.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3747290572 >> v2:172.21.15.183:3300/0 conn(0x7f2f9c13e360 0x7f2f9c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3747290572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c13df80 0x7f2f9c15bee0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3747290572 >> 172.21.15.97:0/3747290572 conn(0x7f2f9c06a800 msgr2=0x7f2f9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:03.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3747290572 shutdown_connections 2023-11-24T08:08:03.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.862+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3747290572 wait complete. 2023-11-24T08:08:03.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.864+0000 7f2fa3c23640 1 Processor -- start 2023-11-24T08:08:03.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.864+0000 7f2fa3c23640 1 -- start start 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa3c23640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f9c13df80 0x7f2f9c150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa3c23640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f9c13e360 0x7f2f9c13ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa3c23640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c15f9c0 0x7f2f9c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa3c23640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c1533e0 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa3c23640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c150950 con 0x7f2f9c13e360 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa3c23640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c1501d0 con 0x7f2f9c13df80 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa21c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c15f9c0 0x7f2f9c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.865+0000 7f2fa21c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c15f9c0 0x7f2f9c151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46552/0 (socket says 172.21.15.97:46552) 2023-11-24T08:08:03.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa21c0640 1 -- 172.21.15.97:0/3083777614 learned_addr learned my addr 172.21.15.97:0/3083777614 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa11be640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f9c13e360 0x7f2f9c13ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa19bf640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f9c13df80 0x7f2f9c150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa21c0640 1 -- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f9c13df80 msgr2=0x7f2f9c150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa21c0640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f9c13df80 0x7f2f9c150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa21c0640 1 -- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f9c13e360 msgr2=0x7f2f9c13ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa21c0640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f9c13e360 0x7f2f9c13ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa21c0640 1 -- 172.21.15.97:0/3083777614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980094d0 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2fa21c0640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c15f9c0 0x7f2f9c151de0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c780 tx=0x7f2f9400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.866+0000 7f2f927fc640 1 -- 172.21.15.97:0/3083777614 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94003d80 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.867+0000 7f2f927fc640 1 -- 172.21.15.97:0/3083777614 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9400ce30 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.867+0000 7f2f927fc640 1 -- 172.21.15.97:0/3083777614 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94005290 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.867+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c13d8f0 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.867+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c152d90 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.868+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c153550 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.869+0000 7f2f927fc640 1 -- 172.21.15.97:0/3083777614 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f940053f0 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.869+0000 7f2f927fc640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2f8006ae70 0x7f2f8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:03.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.870+0000 7f2f927fc640 1 -- 172.21.15.97:0/3083777614 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f94088aa0 con 0x7f2f9c15f9c0 2023-11-24T08:08:03.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.870+0000 7f2fa19bf640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2f8006ae70 0x7f2f8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:03.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.870+0000 7f2fa19bf640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2f8006ae70 0x7f2f8006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2f98036000 tx=0x7f2f9803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:03.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:03.874+0000 7f2f927fc640 1 -- 172.21.15.97:0/3083777614 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f94053b40 con 0x7f2f9c15f9c0 2023-11-24T08:08:04.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.048+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f9c0675d0 con 0x7f2f9c15f9c0 2023-11-24T08:08:04.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.050+0000 7f2f927fc640 1 -- 172.21.15.97:0/3083777614 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f2f94017020 con 0x7f2f9c15f9c0 2023-11-24T08:08:04.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:04.052 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":34,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:02.651179+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:04.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2f8006ae70 msgr2=0x7f2f8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:04.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2f8006ae70 0x7f2f8006d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2f98036000 tx=0x7f2f9803c040 comp rx=0 tx=0).stop 2023-11-24T08:08:04.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c15f9c0 msgr2=0x7f2f9c151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c15f9c0 0x7f2f9c151de0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c780 tx=0x7f2f9400cc40 comp rx=0 tx=0).stop 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 shutdown_connections 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2f8006ae70 0x7f2f8006d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f9c15f9c0 0x7f2f9c151de0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f9c13e360 0x7f2f9c13ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 --2- 172.21.15.97:0/3083777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f9c13df80 0x7f2f9c150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.052+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 >> 172.21.15.97:0/3083777614 conn(0x7f2f9c06a800 msgr2=0x7f2f9c0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.053+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 shutdown_connections 2023-11-24T08:08:04.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.053+0000 7f2fa3c23640 1 -- 172.21.15.97:0/3083777614 wait complete. 2023-11-24T08:08:04.072 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:08:04.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.281+0000 7f5c162e7640 1 Processor -- start 2023-11-24T08:08:04.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.281+0000 7f5c162e7640 1 -- start start 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c162e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c1015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c162e7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5c1015e1e0 0x7f5c100702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c162e7640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100b1ee0 con 0x7f5c10143ae0 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c162e7640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100b2780 con 0x7f5c1015e1e0 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c162e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1015e990 con 0x7f5c100cf9a0 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c0ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5c10143ae0 0x7f5c100cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40732/0 (socket says 172.21.15.97:40732) 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c0ffff640 1 -- 172.21.15.97:0/1517701970 learned_addr learned my addr 172.21.15.97:0/1517701970 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.282+0000 7f5c14884640 1 --2- 172.21.15.97:0/1517701970 >> v2:172.21.15.97:3300/0 conn(0x7f5c1015e1e0 0x7f5c100702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.283+0000 7f5c0f7fe640 1 -- 172.21.15.97:0/1517701970 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826815742 0 0) 0x7f5c100b1ee0 con 0x7f5c10143ae0 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.283+0000 7f5c0f7fe640 1 -- 172.21.15.97:0/1517701970 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bfc003520 con 0x7f5c10143ae0 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.283+0000 7f5c14884640 1 -- 172.21.15.97:0/1517701970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 msgr2=0x7f5c1015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.283+0000 7f5c07fff640 1 --2- 172.21.15.97:0/1517701970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c1015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.283+0000 7f5c14884640 1 --2- 172.21.15.97:0/1517701970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c1015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.283+0000 7f5c14884640 1 -- 172.21.15.97:0/1517701970 >> v1:172.21.15.97:6789/0 conn(0x7f5c10143ae0 legacy=0x7f5c100cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.283+0000 7f5c14884640 1 -- 172.21.15.97:0/1517701970 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100b2130 con 0x7f5c1015e1e0 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.284+0000 7f5c14884640 1 --2- 172.21.15.97:0/1517701970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c1015e1e0 0x7f5c100702c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009d90 tx=0x7f5c0802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08a99683493f676 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.284+0000 7f5c0f7fe640 1 -- 172.21.15.97:0/1517701970 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0802cc50 con 0x7f5c1015e1e0 2023-11-24T08:08:04.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.284+0000 7f5c0f7fe640 1 -- 172.21.15.97:0/1517701970 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0802cdb0 con 0x7f5c1015e1e0 2023-11-24T08:08:04.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.284+0000 7f5c0f7fe640 1 -- 172.21.15.97:0/1517701970 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08034640 con 0x7f5c1015e1e0 2023-11-24T08:08:04.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 -- 172.21.15.97:0/1517701970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c1015e1e0 msgr2=0x7f5c100702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:04.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 --2- 172.21.15.97:0/1517701970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c1015e1e0 0x7f5c100702c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009d90 tx=0x7f5c0802bea0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 -- 172.21.15.97:0/1517701970 shutdown_connections 2023-11-24T08:08:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 --2- 172.21.15.97:0/1517701970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c1015e1e0 0x7f5c100702c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 --2- 172.21.15.97:0/1517701970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c1015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 -- 172.21.15.97:0/1517701970 >> 172.21.15.97:0/1517701970 conn(0x7f5c1006a800 msgr2=0x7f5c1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 -- 172.21.15.97:0/1517701970 shutdown_connections 2023-11-24T08:08:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.285+0000 7f5c162e7640 1 -- 172.21.15.97:0/1517701970 wait complete. 2023-11-24T08:08:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.287+0000 7f5c162e7640 1 Processor -- start 2023-11-24T08:08:04.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.287+0000 7f5c162e7640 1 -- start start 2023-11-24T08:08:04.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c162e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c10159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:04.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c162e7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c10143ae0 0x7f5c1012df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:04.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c162e7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1015e1e0 0x7f5c100702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:04.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c162e7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1012f630 con 0x7f5c10143ae0 2023-11-24T08:08:04.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c162e7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1012ea20 con 0x7f5c1015e1e0 2023-11-24T08:08:04.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c162e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1012ed00 con 0x7f5c100cf9a0 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c10143ae0 0x7f5c1012df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c10143ae0 0x7f5c1012df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46570/0 (socket says 172.21.15.97:46570) 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 -- 172.21.15.97:0/2657379502 learned_addr learned my addr 172.21.15.97:0/2657379502 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 -- 172.21.15.97:0/2657379502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 msgr2=0x7f5c10159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c0ffff640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c10159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c10159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 -- 172.21.15.97:0/2657379502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1015e1e0 msgr2=0x7f5c100702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1015e1e0 0x7f5c100702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.288+0000 7f5c07fff640 1 -- 172.21.15.97:0/2657379502 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009a70 con 0x7f5c10143ae0 2023-11-24T08:08:04.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.289+0000 7f5c07fff640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c10143ae0 0x7f5c1012df80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800c7f0 tx=0x7f5bf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:04.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.289+0000 7f5c0d7fa640 1 -- 172.21.15.97:0/2657379502 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8004220 con 0x7f5c10143ae0 2023-11-24T08:08:04.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.289+0000 7f5c0d7fa640 1 -- 172.21.15.97:0/2657379502 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf80043a0 con 0x7f5c10143ae0 2023-11-24T08:08:04.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.289+0000 7f5c0d7fa640 1 -- 172.21.15.97:0/2657379502 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8007860 con 0x7f5c10143ae0 2023-11-24T08:08:04.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.289+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1012efe0 con 0x7f5c10143ae0 2023-11-24T08:08:04.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.289+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c100ca920 con 0x7f5c10143ae0 2023-11-24T08:08:04.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.290+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1012f7e0 con 0x7f5c10143ae0 2023-11-24T08:08:04.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.291+0000 7f5c0d7fa640 1 -- 172.21.15.97:0/2657379502 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5bf8007bd0 con 0x7f5c10143ae0 2023-11-24T08:08:04.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.292+0000 7f5c0d7fa640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5bf006ae40 0x7f5bf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:04.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.292+0000 7f5c0d7fa640 1 -- 172.21.15.97:0/2657379502 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bf80896a0 con 0x7f5c10143ae0 2023-11-24T08:08:04.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.292+0000 7f5c0ffff640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5bf006ae40 0x7f5bf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:04.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.293+0000 7f5c0ffff640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5bf006ae40 0x7f5bf006d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5c100cb900 tx=0x7f5c00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:04.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.297+0000 7f5c0d7fa640 1 -- 172.21.15.97:0/2657379502 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5bf80546b0 con 0x7f5c10143ae0 2023-11-24T08:08:04.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:04.522+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5c100675d0 con 0x7f5c10143ae0 2023-11-24T08:08:05.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.240+0000 7f5c0d7fa640 1 -- 172.21.15.97:0/2657379502 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5bf8057cd0 con 0x7f5c10143ae0 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5bf006ae40 msgr2=0x7f5bf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5bf006ae40 0x7f5bf006d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5c100cb900 tx=0x7f5c00009040 comp rx=0 tx=0).stop 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c10143ae0 msgr2=0x7f5c1012df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c10143ae0 0x7f5c1012df80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800c7f0 tx=0x7f5bf800ccb0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 shutdown_connections 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f5bf006ae40 0x7f5bf006d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c1015e1e0 0x7f5c100702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5c10143ae0 0x7f5c1012df80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 --2- 172.21.15.97:0/2657379502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c100cf9a0 0x7f5c10159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 >> 172.21.15.97:0/2657379502 conn(0x7f5c1006a800 msgr2=0x7f5c100cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:05.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 shutdown_connections 2023-11-24T08:08:05.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.244+0000 7f5c162e7640 1 -- 172.21.15.97:0/2657379502 wait complete. 2023-11-24T08:08:05.266 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:08:05.266 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:08:05.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.476+0000 7f7390901640 1 Processor -- start 2023-11-24T08:08:05.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.476+0000 7f7390901640 1 -- start start 2023-11-24T08:08:05.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.478+0000 7f7390901640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c143ae0 0x7f738c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.478+0000 7f7390901640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c0cfc30 con 0x7f738c0cf7d0 2023-11-24T08:08:05.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.478+0000 7f7390901640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c0b1ee0 con 0x7f738c15e3b0 2023-11-24T08:08:05.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.478+0000 7f7390901640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0b2780 con 0x7f738c143ae0 2023-11-24T08:08:05.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.478+0000 7f7383fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f738c0cf7d0 0x7f738c15dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40740/0 (socket says 172.21.15.97:40740) 2023-11-24T08:08:05.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.478+0000 7f7383fff640 1 -- 172.21.15.97:0/1319152130 learned_addr learned my addr 172.21.15.97:0/1319152130 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f738a59c640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c143ae0 0x7f738c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134219756 0 0) 0x7f738c0cfc30 con 0x7f738c0cf7d0 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7378003520 con 0x7f738c0cf7d0 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944283217 0 0) 0x7f7378003520 con 0x7f738c0cf7d0 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c143ae0 msgr2=0x7f738c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c143ae0 0x7f738c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 >> v1:172.21.15.183:6789/0 conn(0x7f738c15e3b0 legacy=0x7f738c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c15e990 con 0x7f738c0cf7d0 2023-11-24T08:08:05.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f7374001670 con 0x7f738c0cf7d0 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 >> v1:172.21.15.97:6789/0 conn(0x7f738c0cf7d0 legacy=0x7f738c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c143ae0 0x7f73780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7378003f20 0x7f73780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378004d00 0x7f7378005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0b2780 con 0x7f7378003f20 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737800ba60 con 0x7f7378004d00 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737800de30 con 0x7f738c143ae0 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.479+0000 7f7383fff640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7378003f20 0x7f73780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.480+0000 7f7383fff640 1 -- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c143ae0 msgr2=0x7f73780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.480+0000 7f7383fff640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c143ae0 0x7f73780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.480+0000 7f7383fff640 1 -- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378004d00 msgr2=0x7f7378005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.480+0000 7f7383fff640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378004d00 0x7f7378005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.480+0000 7f7383fff640 1 -- 172.21.15.97:0/1319152130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378003520 con 0x7f7378003f20 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.481+0000 7f7383fff640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7378003f20 0x7f73780047c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f737400c190 tx=0x7f73780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4099e8f8eeb5ca31 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.481+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374005ad0 con 0x7f7378003f20 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.481+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7374005c30 con 0x7f7378003f20 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.481+0000 7f7389d9b640 1 -- 172.21.15.97:0/1319152130 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737402cae0 con 0x7f7378003f20 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.482+0000 7f7390901640 1 -- 172.21.15.97:0/1319152130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7378003f20 msgr2=0x7f73780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.482+0000 7f7390901640 1 --2- 172.21.15.97:0/1319152130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7378003f20 0x7f73780047c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f737400c190 tx=0x7f73780057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.482+0000 7f738ad9d640 1 -- 172.21.15.97:0/1319152130 reap_dead start 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.482+0000 7f7390901640 1 -- 172.21.15.97:0/1319152130 shutdown_connections 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.482+0000 7f7390901640 1 -- 172.21.15.97:0/1319152130 >> 172.21.15.97:0/1319152130 conn(0x7f738c06a800 msgr2=0x7f738c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.482+0000 7f7390901640 1 -- 172.21.15.97:0/1319152130 shutdown_connections 2023-11-24T08:08:05.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.482+0000 7f7390901640 1 -- 172.21.15.97:0/1319152130 wait complete. 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.484+0000 7f7390901640 1 Processor -- start 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.484+0000 7f7390901640 1 -- start start 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7390901640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378003f20 0x7f738c13c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7390901640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c13cb30 0x7f738c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7390901640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f738c13cf90 0x7f738c0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7390901640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0cce00 con 0x7f738c13cf90 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7390901640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c137360 con 0x7f7378003f20 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7390901640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c13a910 con 0x7f738c13cb30 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f738c13cf90 0x7f738c0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f738c13cf90 0x7f738c0cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46580/0 (socket says 172.21.15.97:46580) 2023-11-24T08:08:05.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 -- 172.21.15.97:0/4082915774 learned_addr learned my addr 172.21.15.97:0/4082915774 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738a59c640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378003f20 0x7f738c13c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7383fff640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c13cb30 0x7f738c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 -- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c13cb30 msgr2=0x7f738c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c13cb30 0x7f738c0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 -- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378003f20 msgr2=0x7f738c13c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378003f20 0x7f738c13c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738ad9d640 1 -- 172.21.15.97:0/4082915774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c13a630 con 0x7f738c13cf90 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f738a59c640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378003f20 0x7f738c13c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.485+0000 7f7383fff640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c13cb30 0x7f738c0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.486+0000 7f738ad9d640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f738c13cf90 0x7f738c0cd760 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7378003970 tx=0x7f738400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.486+0000 7f7382ffd640 1 -- 172.21.15.97:0/4082915774 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384005d40 con 0x7f738c13cf90 2023-11-24T08:08:05.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.486+0000 7f7382ffd640 1 -- 172.21.15.97:0/4082915774 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400ced0 con 0x7f738c13cf90 2023-11-24T08:08:05.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.486+0000 7f7382ffd640 1 -- 172.21.15.97:0/4082915774 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400a7f0 con 0x7f738c13cf90 2023-11-24T08:08:05.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.486+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c0cc740 con 0x7f738c13cf90 2023-11-24T08:08:05.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.486+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c1482c0 con 0x7f738c13cf90 2023-11-24T08:08:05.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.487+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0ccf40 con 0x7f738c13cf90 2023-11-24T08:08:05.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.488+0000 7f7382ffd640 1 -- 172.21.15.97:0/4082915774 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f738400a950 con 0x7f738c13cf90 2023-11-24T08:08:05.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.489+0000 7f7382ffd640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f736c06ae70 0x7f736c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:05.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.489+0000 7f7382ffd640 1 -- 172.21.15.97:0/4082915774 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7384088740 con 0x7f738c13cf90 2023-11-24T08:08:05.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.489+0000 7f738a59c640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f736c06ae70 0x7f736c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:05.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.490+0000 7f738a59c640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f736c06ae70 0x7f736c06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f737c0099e0 tx=0x7f737c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:05.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.493+0000 7f7382ffd640 1 -- 172.21.15.97:0/4082915774 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f738c0ccf40 con 0x7f738c13cf90 2023-11-24T08:08:05.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:05.724+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f738c0ccf40 con 0x7f738c13cf90 2023-11-24T08:08:06.148 INFO:tasks.ceph.mds.c.smithi097.stderr:2023-11-24T08:08:06.147+0000 7f1958984640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:08:06.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.250+0000 7f7382ffd640 1 -- 172.21.15.97:0/4082915774 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f738c0ccf40 con 0x7f738c13cf90 2023-11-24T08:08:06.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f736c06ae70 msgr2=0x7f736c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f736c06ae70 0x7f736c06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f737c0099e0 tx=0x7f737c008040 comp rx=0 tx=0).stop 2023-11-24T08:08:06.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f738c13cf90 msgr2=0x7f738c0cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f738c13cf90 0x7f738c0cd760 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7378003970 tx=0x7f738400cb90 comp rx=0 tx=0).stop 2023-11-24T08:08:06.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 shutdown_connections 2023-11-24T08:08:06.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f736c06ae70 0x7f736c06d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f738c13cf90 0x7f738c0cd760 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f738c13cb30 0x7f738c0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 --2- 172.21.15.97:0/4082915774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7378003f20 0x7f738c13c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 >> 172.21.15.97:0/4082915774 conn(0x7f738c06a800 msgr2=0x7f738c0cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:06.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 shutdown_connections 2023-11-24T08:08:06.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.254+0000 7f7390901640 1 -- 172.21.15.97:0/4082915774 wait complete. 2023-11-24T08:08:06.277 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:08:06.277 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:06.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.485+0000 7f40e76bb640 1 Processor -- start 2023-11-24T08:08:06.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.485+0000 7f40e76bb640 1 -- start start 2023-11-24T08:08:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.486+0000 7f40e76bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40e013df80 0x7f40e015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.486+0000 7f40e76bb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f40e00cf9a0 0x7f40e00cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e76bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e006c470 con 0x7f40e013e360 2023-11-24T08:08:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e76bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e006c750 con 0x7f40e013df80 2023-11-24T08:08:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e76bb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e006ca30 con 0x7f40e00cf9a0 2023-11-24T08:08:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e5457640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40e013df80 0x7f40e015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e4c56640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f40e013e360 0x7f40e00cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45374/0 (socket says 172.21.15.97:45374) 2023-11-24T08:08:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e4c56640 1 -- 172.21.15.97:0/2104824143 learned_addr learned my addr 172.21.15.97:0/2104824143 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e5c58640 1 --2- 172.21.15.97:0/2104824143 >> v2:172.21.15.183:3300/0 conn(0x7f40e00cf9a0 0x7f40e00cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e5457640 1 -- 172.21.15.97:0/2104824143 >> v2:172.21.15.183:3300/0 conn(0x7f40e00cf9a0 msgr2=0x7f40e00cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e5457640 1 --2- 172.21.15.97:0/2104824143 >> v2:172.21.15.183:3300/0 conn(0x7f40e00cf9a0 0x7f40e00cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e5457640 1 -- 172.21.15.97:0/2104824143 >> v1:172.21.15.97:6789/0 conn(0x7f40e013e360 legacy=0x7f40e00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.487+0000 7f40e5457640 1 -- 172.21.15.97:0/2104824143 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e006cd10 con 0x7f40e013df80 2023-11-24T08:08:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.489+0000 7f40e5457640 1 --2- 172.21.15.97:0/2104824143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e013df80 0x7f40e015bee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f40e00ccb10 tx=0x7f40dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa19439fb8ec3eed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.489+0000 7f40d7fff640 1 -- 172.21.15.97:0/2104824143 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc031830 con 0x7f40e013df80 2023-11-24T08:08:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.489+0000 7f40d7fff640 1 -- 172.21.15.97:0/2104824143 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc031990 con 0x7f40e013df80 2023-11-24T08:08:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.489+0000 7f40d7fff640 1 -- 172.21.15.97:0/2104824143 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc031d20 con 0x7f40e013df80 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.489+0000 7f40e76bb640 1 -- 172.21.15.97:0/2104824143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e013df80 msgr2=0x7f40e015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.489+0000 7f40e76bb640 1 --2- 172.21.15.97:0/2104824143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e013df80 0x7f40e015bee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f40e00ccb10 tx=0x7f40dc02b8d0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.490+0000 7f40e76bb640 1 -- 172.21.15.97:0/2104824143 shutdown_connections 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.490+0000 7f40e76bb640 1 --2- 172.21.15.97:0/2104824143 >> v2:172.21.15.183:3300/0 conn(0x7f40e00cf9a0 0x7f40e00cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.490+0000 7f40e76bb640 1 --2- 172.21.15.97:0/2104824143 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e013df80 0x7f40e015bee0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.490+0000 7f40e76bb640 1 -- 172.21.15.97:0/2104824143 >> 172.21.15.97:0/2104824143 conn(0x7f40e006a800 msgr2=0x7f40e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.490+0000 7f40e76bb640 1 -- 172.21.15.97:0/2104824143 shutdown_connections 2023-11-24T08:08:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.490+0000 7f40e76bb640 1 -- 172.21.15.97:0/2104824143 wait complete. 2023-11-24T08:08:06.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.491+0000 7f40e76bb640 1 Processor -- start 2023-11-24T08:08:06.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.492+0000 7f40e76bb640 1 -- start start 2023-11-24T08:08:06.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.492+0000 7f40e76bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e00cf9a0 0x7f40e00aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.492+0000 7f40e76bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40e013df80 0x7f40e0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.492+0000 7f40e76bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e013e360 0x7f40e0133370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.492+0000 7f40e76bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00a9e50 con 0x7f40e00cf9a0 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.492+0000 7f40e76bb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00a9240 con 0x7f40e013e360 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.492+0000 7f40e76bb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00a9520 con 0x7f40e013df80 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e00cf9a0 0x7f40e00aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e00cf9a0 0x7f40e00aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42156/0 (socket says 172.21.15.97:42156) 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 -- 172.21.15.97:0/3009311495 learned_addr learned my addr 172.21.15.97:0/3009311495 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 -- 172.21.15.97:0/3009311495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40e013df80 msgr2=0x7f40e0159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40e013df80 0x7f40e0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 -- 172.21.15.97:0/3009311495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e013e360 msgr2=0x7f40e0133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e013e360 0x7f40e0133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.493+0000 7f40e5457640 1 -- 172.21.15.97:0/3009311495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc009400 con 0x7f40e00cf9a0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.494+0000 7f40e5457640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e00cf9a0 0x7f40e00aa2e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009890 tx=0x7f40dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.494+0000 7f40d5ffb640 1 -- 172.21.15.97:0/3009311495 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc03ba70 con 0x7f40e00cf9a0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.494+0000 7f40d5ffb640 1 -- 172.21.15.97:0/3009311495 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc03bbd0 con 0x7f40e00cf9a0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.494+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e00a9800 con 0x7f40e00cf9a0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.494+0000 7f40d5ffb640 1 -- 172.21.15.97:0/3009311495 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc045400 con 0x7f40e00cf9a0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.494+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e00a8ed0 con 0x7f40e00cf9a0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.495+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e00675d0 con 0x7f40e00cf9a0 2023-11-24T08:08:06.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.496+0000 7f40d5ffb640 1 -- 172.21.15.97:0/3009311495 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40dc04e440 con 0x7f40e00cf9a0 2023-11-24T08:08:06.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.497+0000 7f40d5ffb640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f40c406ae40 0x7f40c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.497+0000 7f40d5ffb640 1 -- 172.21.15.97:0/3009311495 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40dc0abae0 con 0x7f40e00cf9a0 2023-11-24T08:08:06.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.497+0000 7f40e4c56640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f40c406ae40 0x7f40c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.498+0000 7f40e4c56640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f40c406ae40 0x7f40c406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f40e00cc410 tx=0x7f40d0007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:06.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.501+0000 7f40d5ffb640 1 -- 172.21.15.97:0/3009311495 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40dc076a60 con 0x7f40e00cf9a0 2023-11-24T08:08:06.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.731+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e006df00 con 0x7f40e00cf9a0 2023-11-24T08:08:06.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.732+0000 7f40d5ffb640 1 -- 172.21.15.97:0/3009311495 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f40dc035020 con 0x7f40e00cf9a0 2023-11-24T08:08:06.734 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:06.735 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3619089631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3619089631},{"type":"v1","addr":"172.21.15.183:6834","nonce":3619089631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1237344944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1237344944},{"type":"v1","addr":"172.21.15.97:6837","nonce":1237344944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1425639784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1425639784},{"type":"v1","addr":"172.21.15.183:6835","nonce":1425639784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:08:02.652077+0000","modified":"2023-11-24T08:08:05.725467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5244":{"gid":5244,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.97:6835/4116734497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4116734497},{"type":"v1","addr":"172.21.15.97:6835","nonce":4116734497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:08:06.735 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 17 2023-11-24T08:08:06.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f40c406ae40 msgr2=0x7f40c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f40c406ae40 0x7f40c406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f40e00cc410 tx=0x7f40d0007a40 comp rx=0 tx=0).stop 2023-11-24T08:08:06.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e00cf9a0 msgr2=0x7f40e00aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e00cf9a0 0x7f40e00aa2e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009890 tx=0x7f40dc0046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 shutdown_connections 2023-11-24T08:08:06.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f40c406ae40 0x7f40c406d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40e013e360 0x7f40e0133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40e013df80 0x7f40e0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 --2- 172.21.15.97:0/3009311495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40e00cf9a0 0x7f40e00aa2e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.735+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 >> 172.21.15.97:0/3009311495 conn(0x7f40e006a800 msgr2=0x7f40e006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:06.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.736+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 shutdown_connections 2023-11-24T08:08:06.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.736+0000 7f40e76bb640 1 -- 172.21.15.97:0/3009311495 wait complete. 2023-11-24T08:08:06.755 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:06.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.964+0000 7fd3bcb01640 1 Processor -- start 2023-11-24T08:08:06.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.964+0000 7fd3bcb01640 1 -- start start 2023-11-24T08:08:06.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3bcb01640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 0x7fd3b80b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3bcb01640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd3b80b31b0 0x7fd3b80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3bcb01640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80b3610 con 0x7fd3b80b5380 2023-11-24T08:08:06.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3bcb01640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80d0780 con 0x7fd3b80b31b0 2023-11-24T08:08:06.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3bcb01640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80cf8f0 con 0x7fd3b815b030 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3b6d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd3b80b5380 0x7fd3b815ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45390/0 (socket says 172.21.15.97:45390) 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3b6d9d640 1 -- 172.21.15.97:0/1978200876 learned_addr learned my addr 172.21.15.97:0/1978200876 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3b659c640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 0x7fd3b80b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.966+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/1978200876 >> v2:172.21.15.183:3300/0 conn(0x7fd3b80b31b0 0x7fd3b80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628191160 0 0) 0x7fd3b80b3610 con 0x7fd3b80b5380 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a4003520 con 0x7fd3b80b5380 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909976043 0 0) 0x7fd3a4003520 con 0x7fd3b80b5380 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 msgr2=0x7fd3b80b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 0x7fd3b80b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 >> v2:172.21.15.183:3300/0 conn(0x7fd3b80b31b0 msgr2=0x7fd3b80b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 --2- 172.21.15.97:0/1978200876 >> v2:172.21.15.183:3300/0 conn(0x7fd3b80b31b0 0x7fd3b80b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80b5810 con 0x7fd3b80b5380 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fd3b0001670 con 0x7fd3b80b5380 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 >> v1:172.21.15.97:6789/0 conn(0x7fd3b80b5380 legacy=0x7fd3b815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 0x7fd3a4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3a4003ef0 0x7fd3a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3a4004d00 0x7fd3a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80d0780 con 0x7fd3a4003ef0 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80cf8f0 con 0x7fd3a4004d00 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a400b980 con 0x7fd3b815b030 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.967+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3a4003ef0 0x7fd3a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.968+0000 7fd3b659c640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 0x7fd3a4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.968+0000 7fd3b6d9d640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3a4004d00 0x7fd3a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.968+0000 7fd3b5d9b640 1 -- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 msgr2=0x7fd3a4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:06.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.968+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3b815b030 0x7fd3a4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.968+0000 7fd3b5d9b640 1 -- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3a4004d00 msgr2=0x7fd3a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:06.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.968+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3a4004d00 0x7fd3a4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.968+0000 7fd3b5d9b640 1 -- 172.21.15.97:0/1978200876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4003520 con 0x7fd3a4003ef0 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.969+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3a4003ef0 0x7fd3a40047c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009ac0 tx=0x7fd3a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b8d9549ca86e4e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.969+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a002c6d0 con 0x7fd3a4003ef0 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.969+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a002c830 con 0x7fd3a4003ef0 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.969+0000 7fd3b559a640 1 -- 172.21.15.97:0/1978200876 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a002cbc0 con 0x7fd3a4003ef0 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.970+0000 7fd3bcb01640 1 -- 172.21.15.97:0/1978200876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3a4003ef0 msgr2=0x7fd3a40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.970+0000 7fd3bcb01640 1 --2- 172.21.15.97:0/1978200876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3a4003ef0 0x7fd3a40047c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009ac0 tx=0x7fd3a40057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.970+0000 7fd3b6d9d640 1 -- 172.21.15.97:0/1978200876 reap_dead start 2023-11-24T08:08:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.970+0000 7fd3bcb01640 1 -- 172.21.15.97:0/1978200876 shutdown_connections 2023-11-24T08:08:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.970+0000 7fd3bcb01640 1 -- 172.21.15.97:0/1978200876 >> 172.21.15.97:0/1978200876 conn(0x7fd3b806a3e0 msgr2=0x7fd3b806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.970+0000 7fd3bcb01640 1 -- 172.21.15.97:0/1978200876 shutdown_connections 2023-11-24T08:08:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.970+0000 7fd3bcb01640 1 -- 172.21.15.97:0/1978200876 wait complete. 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.972+0000 7fd3bcb01640 1 Processor -- start 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.972+0000 7fd3bcb01640 1 -- start start 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3bcb01640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3a4003ef0 0x7fd3b8154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3bcb01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b81f6ba0 0x7fd3b814bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3bcb01640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b814e470 0x7fd3b814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3bcb01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814c180 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3bcb01640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814ee30 con 0x7fd3b814e470 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3bcb01640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814f3f0 con 0x7fd3a4003ef0 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3b5d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b81f6ba0 0x7fd3b814bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3b5d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b81f6ba0 0x7fd3b814bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42166/0 (socket says 172.21.15.97:42166) 2023-11-24T08:08:06.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.973+0000 7fd3b5d9b640 1 -- 172.21.15.97:0/4267564811 learned_addr learned my addr 172.21.15.97:0/4267564811 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:06.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3b5d9b640 1 -- 172.21.15.97:0/4267564811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3a4003ef0 msgr2=0x7fd3b8154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3a4003ef0 0x7fd3b8154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3b5d9b640 1 -- 172.21.15.97:0/4267564811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b814e470 msgr2=0x7fd3b814e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b814e470 0x7fd3b814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3b5d9b640 1 -- 172.21.15.97:0/4267564811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b81f2ba0 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3b5d9b640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b81f6ba0 0x7fd3b814bc40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd3a002c2d0 tx=0x7fd3a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3aeffd640 1 -- 172.21.15.97:0/4267564811 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003810 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3aeffd640 1 -- 172.21.15.97:0/4267564811 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0003970 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3aeffd640 1 -- 172.21.15.97:0/4267564811 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003ce0 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b81f7020 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.974+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b81f3100 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.976+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b80675d0 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.976+0000 7fd3aeffd640 1 -- 172.21.15.97:0/4267564811 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3a0040450 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.977+0000 7fd3aeffd640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd39806ae40 0x7fd39806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.977+0000 7fd3aeffd640 1 -- 172.21.15.97:0/4267564811 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3a00abad0 con 0x7fd3b81f6ba0 2023-11-24T08:08:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.978+0000 7fd3b659c640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd39806ae40 0x7fd39806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.978+0000 7fd3b659c640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd39806ae40 0x7fd39806d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009f80 tx=0x7fd3a8009750 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:06.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:06.982+0000 7fd3aeffd640 1 -- 172.21.15.97:0/4267564811 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3a007a720 con 0x7fd3b81f6ba0 2023-11-24T08:08:07.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.172+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3b8070a00 con 0x7fd3b81f6ba0 2023-11-24T08:08:07.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.174+0000 7fd3aeffd640 1 -- 172.21.15.97:0/4267564811 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fd3a00044e0 con 0x7fd3b81f6ba0 2023-11-24T08:08:07.176 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:07.177 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:04.217727+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:07.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd39806ae40 msgr2=0x7fd39806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd39806ae40 0x7fd39806d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009f80 tx=0x7fd3a8009750 comp rx=0 tx=0).stop 2023-11-24T08:08:07.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b81f6ba0 msgr2=0x7fd3b814bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b81f6ba0 0x7fd3b814bc40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd3a002c2d0 tx=0x7fd3a0004730 comp rx=0 tx=0).stop 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 shutdown_connections 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd39806ae40 0x7fd39806d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd3b814e470 0x7fd3b814e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3b81f6ba0 0x7fd3b814bc40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 --2- 172.21.15.97:0/4267564811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd3a4003ef0 0x7fd3b8154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.177+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 >> 172.21.15.97:0/4267564811 conn(0x7fd3b806a3e0 msgr2=0x7fd3b80b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.178+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 shutdown_connections 2023-11-24T08:08:07.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.178+0000 7fd3bcb01640 1 -- 172.21.15.97:0/4267564811 wait complete. 2023-11-24T08:08:07.199 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:08:07.199 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:07.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.405+0000 7fbb59761640 1 Processor -- start 2023-11-24T08:08:07.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.405+0000 7fbb59761640 1 -- start start 2023-11-24T08:08:07.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.407+0000 7fbb59761640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 0x7fbb5415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.407+0000 7fbb59761640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbb540cf9a0 0x7fbb540cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.407+0000 7fbb59761640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5406c470 con 0x7fbb5413e360 2023-11-24T08:08:07.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.407+0000 7fbb59761640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5406c750 con 0x7fbb540cf9a0 2023-11-24T08:08:07.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.407+0000 7fbb59761640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5406ca30 con 0x7fbb5413df80 2023-11-24T08:08:07.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.407+0000 7fbb527fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbb5413e360 0x7fbb540cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45406/0 (socket says 172.21.15.97:45406) 2023-11-24T08:08:07.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.407+0000 7fbb527fc640 1 -- 172.21.15.97:0/2517840190 learned_addr learned my addr 172.21.15.97:0/2517840190 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:07.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb52ffd640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 0x7fbb5415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb537fe640 1 --2- 172.21.15.97:0/2517840190 >> v2:172.21.15.183:3300/0 conn(0x7fbb540cf9a0 0x7fbb540cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977515643 0 0) 0x7fbb5406c470 con 0x7fbb5413e360 2023-11-24T08:08:07.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb3c003520 con 0x7fbb5413e360 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366400729 0 0) 0x7fbb3c003520 con 0x7fbb5413e360 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 msgr2=0x7fbb5415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 0x7fbb5415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 >> v2:172.21.15.183:3300/0 conn(0x7fbb540cf9a0 msgr2=0x7fbb540cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 --2- 172.21.15.97:0/2517840190 >> v2:172.21.15.183:3300/0 conn(0x7fbb540cf9a0 0x7fbb540cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5406cd10 con 0x7fbb5413e360 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fbb48001670 con 0x7fbb5413e360 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 >> v1:172.21.15.97:6789/0 conn(0x7fbb5413e360 legacy=0x7fbb540cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 0x7fbb3c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb3c003ef0 0x7fbb3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c004d00 0x7fbb3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5406c750 con 0x7fbb3c003ef0 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5406ca30 con 0x7fbb3c004d00 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.408+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c00b9d0 con 0x7fbb5413df80 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb537fe640 1 --2- 172.21.15.97:0/2517840190 >> v2:172.21.15.183:3300/0 conn(0x7fbb540cf9a0 0x7fbb540cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb527fc640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb3c003ef0 0x7fbb3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb52ffd640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 0x7fbb3c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb527fc640 1 -- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 msgr2=0x7fbb3c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb527fc640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb5413df80 0x7fbb3c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb527fc640 1 -- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c004d00 msgr2=0x7fbb3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb527fc640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c004d00 0x7fbb3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.409+0000 7fbb527fc640 1 -- 172.21.15.97:0/2517840190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c003520 con 0x7fbb3c003ef0 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.410+0000 7fbb527fc640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb3c003ef0 0x7fbb3c0047c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c240 tx=0x7fbb3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c73abc4aa6dcef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.410+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4802cb00 con 0x7fbb3c003ef0 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.410+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4802cc60 con 0x7fbb3c003ef0 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.410+0000 7fbb51ffb640 1 -- 172.21.15.97:0/2517840190 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48005af0 con 0x7fbb3c003ef0 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.411+0000 7fbb59761640 1 -- 172.21.15.97:0/2517840190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb3c003ef0 msgr2=0x7fbb3c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.411+0000 7fbb59761640 1 --2- 172.21.15.97:0/2517840190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb3c003ef0 0x7fbb3c0047c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c240 tx=0x7fbb3c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.411+0000 7fbb537fe640 1 -- 172.21.15.97:0/2517840190 reap_dead start 2023-11-24T08:08:07.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.411+0000 7fbb59761640 1 -- 172.21.15.97:0/2517840190 shutdown_connections 2023-11-24T08:08:07.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.411+0000 7fbb59761640 1 -- 172.21.15.97:0/2517840190 >> 172.21.15.97:0/2517840190 conn(0x7fbb5406a800 msgr2=0x7fbb5406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:07.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.411+0000 7fbb59761640 1 -- 172.21.15.97:0/2517840190 shutdown_connections 2023-11-24T08:08:07.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.411+0000 7fbb59761640 1 -- 172.21.15.97:0/2517840190 wait complete. 2023-11-24T08:08:07.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.413+0000 7fbb59761640 1 Processor -- start 2023-11-24T08:08:07.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.413+0000 7fbb59761640 1 -- start start 2023-11-24T08:08:07.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb59761640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c003ef0 0x7fbb5413d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb59761640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb54153b00 0x7fbb54155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb59761640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb541534a0 0x7fbb540ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb59761640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb541521f0 con 0x7fbb541534a0 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb59761640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54156ee0 con 0x7fbb54153b00 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb59761640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54153920 con 0x7fbb3c003ef0 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb537fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb541534a0 0x7fbb540ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb537fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb541534a0 0x7fbb540ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42192/0 (socket says 172.21.15.97:42192) 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.414+0000 7fbb537fe640 1 -- 172.21.15.97:0/3723173394 learned_addr learned my addr 172.21.15.97:0/3723173394 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb52ffd640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c003ef0 0x7fbb5413d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb527fc640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb54153b00 0x7fbb54155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb537fe640 1 -- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c003ef0 msgr2=0x7fbb5413d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb537fe640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c003ef0 0x7fbb5413d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb537fe640 1 -- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb54153b00 msgr2=0x7fbb54155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb537fe640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb54153b00 0x7fbb54155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb537fe640 1 -- 172.21.15.97:0/3723173394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54152400 con 0x7fbb541534a0 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb527fc640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb54153b00 0x7fbb54155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb537fe640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb541534a0 0x7fbb540ad750 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbb5415b6b0 tx=0x7fbb4c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb3b7fe640 1 -- 172.21.15.97:0/3723173394 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00de60 con 0x7fbb541534a0 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb3b7fe640 1 -- 172.21.15.97:0/3723173394 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c00f040 con 0x7fbb541534a0 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb3b7fe640 1 -- 172.21.15.97:0/3723173394 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c003bd0 con 0x7fbb541534a0 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.415+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb541526e0 con 0x7fbb541534a0 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.416+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb54152ca0 con 0x7fbb541534a0 2023-11-24T08:08:07.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.417+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb540675d0 con 0x7fbb541534a0 2023-11-24T08:08:07.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.418+0000 7fbb3b7fe640 1 -- 172.21.15.97:0/3723173394 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb4c003d30 con 0x7fbb541534a0 2023-11-24T08:08:07.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.418+0000 7fbb3b7fe640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbb4006ae40 0x7fbb4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.419+0000 7fbb3b7fe640 1 -- 172.21.15.97:0/3723173394 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb4c089640 con 0x7fbb541534a0 2023-11-24T08:08:07.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.419+0000 7fbb52ffd640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbb4006ae40 0x7fbb4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.419+0000 7fbb52ffd640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbb4006ae40 0x7fbb4006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009930 tx=0x7fbb44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:07.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.423+0000 7fbb3b7fe640 1 -- 172.21.15.97:0/3723173394 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb4c054650 con 0x7fbb541534a0 2023-11-24T08:08:07.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.609+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb5415bee0 con 0x7fbb4006ae40 2023-11-24T08:08:07.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.636+0000 7fbb3b7fe640 1 -- 172.21.15.97:0/3723173394 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287725 (secure 0 0 0) 0x7fbb440095c0 con 0x7fbb4006ae40 2023-11-24T08:08:07.641 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:07.643 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:08:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbb4006ae40 msgr2=0x7fbb4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbb4006ae40 0x7fbb4006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009930 tx=0x7fbb44008040 comp rx=0 tx=0).stop 2023-11-24T08:08:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb541534a0 msgr2=0x7fbb540ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb541534a0 0x7fbb540ad750 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbb5415b6b0 tx=0x7fbb4c00d4a0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 shutdown_connections 2023-11-24T08:08:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbb4006ae40 0x7fbb4006d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb541534a0 0x7fbb540ad750 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb54153b00 0x7fbb54155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 --2- 172.21.15.97:0/3723173394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c003ef0 0x7fbb5413d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 >> 172.21.15.97:0/3723173394 conn(0x7fbb5406a800 msgr2=0x7fbb5406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 shutdown_connections 2023-11-24T08:08:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.642+0000 7fbb59761640 1 -- 172.21.15.97:0/3723173394 wait complete. 2023-11-24T08:08:07.664 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-11-24T08:08:07.293679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224528,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750192,"statfs":{"total":773094113280,"available":772864196608,"internally_reserved":0,"allocated":4300800,"data_stored":2371556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001745"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.254004+0000","last_change":"2023-11-24T08:08:03.250450+0000","last_active":"2023-11-24T08:08:03.254004+0000","last_peered":"2023-11-24T08:08:03.254004+0000","last_clean":"2023-11-24T08:08:03.254004+0000","last_became_active":"2023-11-24T08:08:03.250097+0000","last_became_peered":"2023-11-24T08:08:03.250097+0000","last_unstale":"2023-11-24T08:08:03.254004+0000","last_undegraded":"2023-11-24T08:08:03.254004+0000","last_fullsized":"2023-11-24T08:08:03.254004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:24.953452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233554+0000","last_change":"2023-11-24T08:08:03.230438+0000","last_active":"2023-11-24T08:08:04.233554+0000","last_peered":"2023-11-24T08:08:04.233554+0000","last_clean":"2023-11-24T08:08:04.233554+0000","last_became_active":"2023-11-24T08:08:03.229929+0000","last_became_peered":"2023-11-24T08:08:03.229929+0000","last_unstale":"2023-11-24T08:08:04.233554+0000","last_undegraded":"2023-11-24T08:08:04.233554+0000","last_fullsized":"2023-11-24T08:08:04.233554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:22:45.935441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.251958+0000","last_change":"2023-11-24T08:08:03.247594+0000","last_active":"2023-11-24T08:08:03.251958+0000","last_peered":"2023-11-24T08:08:03.251958+0000","last_clean":"2023-11-24T08:08:03.251958+0000","last_became_active":"2023-11-24T08:08:03.247289+0000","last_became_peered":"2023-11-24T08:08:03.247289+0000","last_unstale":"2023-11-24T08:08:03.251958+0000","last_undegraded":"2023-11-24T08:08:03.251958+0000","last_fullsized":"2023-11-24T08:08:03.251958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:00.239835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245854+0000","last_change":"2023-11-24T08:08:03.237839+0000","last_active":"2023-11-24T08:08:03.245854+0000","last_peered":"2023-11-24T08:08:03.245854+0000","last_clean":"2023-11-24T08:08:03.245854+0000","last_became_active":"2023-11-24T08:08:03.237596+0000","last_became_peered":"2023-11-24T08:08:03.237596+0000","last_unstale":"2023-11-24T08:08:03.245854+0000","last_undegraded":"2023-11-24T08:08:03.245854+0000","last_fullsized":"2023-11-24T08:08:03.245854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:42.240633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.242672+0000","last_change":"2023-11-24T08:08:03.238180+0000","last_active":"2023-11-24T08:08:03.242672+0000","last_peered":"2023-11-24T08:08:03.242672+0000","last_clean":"2023-11-24T08:08:03.242672+0000","last_became_active":"2023-11-24T08:08:03.235378+0000","last_became_peered":"2023-11-24T08:08:03.235378+0000","last_unstale":"2023-11-24T08:08:03.242672+0000","last_undegraded":"2023-11-24T08:08:03.242672+0000","last_fullsized":"2023-11-24T08:08:03.242672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:46.688269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233000+0000","last_change":"2023-11-24T08:08:03.247899+0000","last_active":"2023-11-24T08:08:04.233000+0000","last_peered":"2023-11-24T08:08:04.233000+0000","last_clean":"2023-11-24T08:08:04.233000+0000","last_became_active":"2023-11-24T08:08:03.247533+0000","last_became_peered":"2023-11-24T08:08:03.247533+0000","last_unstale":"2023-11-24T08:08:04.233000+0000","last_undegraded":"2023-11-24T08:08:04.233000+0000","last_fullsized":"2023-11-24T08:08:04.233000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:38:48.847689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235697+0000","last_change":"2023-11-24T08:08:03.243405+0000","last_active":"2023-11-24T08:08:04.235697+0000","last_peered":"2023-11-24T08:08:04.235697+0000","last_clean":"2023-11-24T08:08:04.235697+0000","last_became_active":"2023-11-24T08:08:03.242945+0000","last_became_peered":"2023-11-24T08:08:03.242945+0000","last_unstale":"2023-11-24T08:08:04.235697+0000","last_undegraded":"2023-11-24T08:08:04.235697+0000","last_fullsized":"2023-11-24T08:08:04.235697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:49:06.480779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.234782+0000","last_change":"2023-11-24T08:08:03.238242+0000","last_active":"2023-11-24T08:08:04.234782+0000","last_peered":"2023-11-24T08:08:04.234782+0000","last_clean":"2023-11-24T08:08:04.234782+0000","last_became_active":"2023-11-24T08:08:03.236398+0000","last_became_peered":"2023-11-24T08:08:03.236398+0000","last_unstale":"2023-11-24T08:08:04.234782+0000","last_undegraded":"2023-11-24T08:08:04.234782+0000","last_fullsized":"2023-11-24T08:08:04.234782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:39.107030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.239422+0000","last_change":"2023-11-24T08:08:03.237446+0000","last_active":"2023-11-24T08:08:03.239422+0000","last_peered":"2023-11-24T08:08:03.239422+0000","last_clean":"2023-11-24T08:08:03.239422+0000","last_became_active":"2023-11-24T08:08:03.236587+0000","last_became_peered":"2023-11-24T08:08:03.236587+0000","last_unstale":"2023-11-24T08:08:03.239422+0000","last_undegraded":"2023-11-24T08:08:03.239422+0000","last_fullsized":"2023-11-24T08:08:03.239422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:00.239835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.240183+0000","last_change":"2023-11-24T08:08:03.235834+0000","last_active":"2023-11-24T08:08:03.240183+0000","last_peered":"2023-11-24T08:08:03.240183+0000","last_clean":"2023-11-24T08:08:03.240183+0000","last_became_active":"2023-11-24T08:08:03.235440+0000","last_became_peered":"2023-11-24T08:08:03.235440+0000","last_unstale":"2023-11-24T08:08:03.240183+0000","last_undegraded":"2023-11-24T08:08:03.240183+0000","last_fullsized":"2023-11-24T08:08:03.240183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:00.239835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236061+0000","last_change":"2023-11-24T08:08:03.250354+0000","last_active":"2023-11-24T08:08:04.236061+0000","last_peered":"2023-11-24T08:08:04.236061+0000","last_clean":"2023-11-24T08:08:04.236061+0000","last_became_active":"2023-11-24T08:08:03.250035+0000","last_became_peered":"2023-11-24T08:08:03.250035+0000","last_unstale":"2023-11-24T08:08:04.236061+0000","last_undegraded":"2023-11-24T08:08:04.236061+0000","last_fullsized":"2023-11-24T08:08:04.236061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:49.616235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.256600+0000","last_change":"2023-11-24T08:08:03.250720+0000","last_active":"2023-11-24T08:08:03.256600+0000","last_peered":"2023-11-24T08:08:03.256600+0000","last_clean":"2023-11-24T08:08:03.256600+0000","last_became_active":"2023-11-24T08:08:03.250505+0000","last_became_peered":"2023-11-24T08:08:03.250505+0000","last_unstale":"2023-11-24T08:08:03.256600+0000","last_undegraded":"2023-11-24T08:08:03.256600+0000","last_fullsized":"2023-11-24T08:08:03.256600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:27.035648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.235216+0000","last_change":"2023-11-24T08:08:03.227139+0000","last_active":"2023-11-24T08:08:03.235216+0000","last_peered":"2023-11-24T08:08:03.235216+0000","last_clean":"2023-11-24T08:08:03.235216+0000","last_became_active":"2023-11-24T08:08:03.226826+0000","last_became_peered":"2023-11-24T08:08:03.226826+0000","last_unstale":"2023-11-24T08:08:03.235216+0000","last_undegraded":"2023-11-24T08:08:03.235216+0000","last_fullsized":"2023-11-24T08:08:03.235216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:10.776738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233152+0000","last_change":"2023-11-24T08:08:03.225323+0000","last_active":"2023-11-24T08:08:04.233152+0000","last_peered":"2023-11-24T08:08:04.233152+0000","last_clean":"2023-11-24T08:08:04.233152+0000","last_became_active":"2023-11-24T08:08:03.225040+0000","last_became_peered":"2023-11-24T08:08:03.225040+0000","last_unstale":"2023-11-24T08:08:04.233152+0000","last_undegraded":"2023-11-24T08:08:04.233152+0000","last_fullsized":"2023-11-24T08:08:04.233152+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:03:37.572125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252175+0000","last_change":"2023-11-24T08:08:03.246679+0000","last_active":"2023-11-24T08:08:03.252175+0000","last_peered":"2023-11-24T08:08:03.252175+0000","last_clean":"2023-11-24T08:08:03.252175+0000","last_became_active":"2023-11-24T08:08:03.246401+0000","last_became_peered":"2023-11-24T08:08:03.246401+0000","last_unstale":"2023-11-24T08:08:03.252175+0000","last_undegraded":"2023-11-24T08:08:03.252175+0000","last_fullsized":"2023-11-24T08:08:03.252175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:36.795576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235606+0000","last_change":"2023-11-24T08:08:03.247565+0000","last_active":"2023-11-24T08:08:04.235606+0000","last_peered":"2023-11-24T08:08:04.235606+0000","last_clean":"2023-11-24T08:08:04.235606+0000","last_became_active":"2023-11-24T08:08:03.247176+0000","last_became_peered":"2023-11-24T08:08:03.247176+0000","last_unstale":"2023-11-24T08:08:04.235606+0000","last_undegraded":"2023-11-24T08:08:04.235606+0000","last_fullsized":"2023-11-24T08:08:04.235606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:03:39.642408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.237050+0000","last_change":"2023-11-24T08:08:03.238027+0000","last_active":"2023-11-24T08:08:04.237050+0000","last_peered":"2023-11-24T08:08:04.237050+0000","last_clean":"2023-11-24T08:08:04.237050+0000","last_became_active":"2023-11-24T08:08:03.237777+0000","last_became_peered":"2023-11-24T08:08:03.237777+0000","last_unstale":"2023-11-24T08:08:04.237050+0000","last_undegraded":"2023-11-24T08:08:04.237050+0000","last_fullsized":"2023-11-24T08:08:04.237050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:43.968737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233530+0000","last_change":"2023-11-24T08:08:03.230220+0000","last_active":"2023-11-24T08:08:04.233530+0000","last_peered":"2023-11-24T08:08:04.233530+0000","last_clean":"2023-11-24T08:08:04.233530+0000","last_became_active":"2023-11-24T08:08:03.229628+0000","last_became_peered":"2023-11-24T08:08:03.229628+0000","last_unstale":"2023-11-24T08:08:04.233530+0000","last_undegraded":"2023-11-24T08:08:04.233530+0000","last_fullsized":"2023-11-24T08:08:04.233530+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:08.880666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233205+0000","last_change":"2023-11-24T08:08:03.228853+0000","last_active":"2023-11-24T08:08:04.233205+0000","last_peered":"2023-11-24T08:08:04.233205+0000","last_clean":"2023-11-24T08:08:04.233205+0000","last_became_active":"2023-11-24T08:08:03.228548+0000","last_became_peered":"2023-11-24T08:08:03.228548+0000","last_unstale":"2023-11-24T08:08:04.233205+0000","last_undegraded":"2023-11-24T08:08:04.233205+0000","last_fullsized":"2023-11-24T08:08:04.233205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:37.172485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.242716+0000","last_change":"2023-11-24T08:08:03.239332+0000","last_active":"2023-11-24T08:08:03.242716+0000","last_peered":"2023-11-24T08:08:03.242716+0000","last_clean":"2023-11-24T08:08:03.242716+0000","last_became_active":"2023-11-24T08:08:03.238967+0000","last_became_peered":"2023-11-24T08:08:03.238967+0000","last_unstale":"2023-11-24T08:08:03.242716+0000","last_undegraded":"2023-11-24T08:08:03.242716+0000","last_fullsized":"2023-11-24T08:08:03.242716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:12.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.236957+0000","last_change":"2023-11-24T08:08:03.227221+0000","last_active":"2023-11-24T08:08:03.236957+0000","last_peered":"2023-11-24T08:08:03.236957+0000","last_clean":"2023-11-24T08:08:03.236957+0000","last_became_active":"2023-11-24T08:08:03.226308+0000","last_became_peered":"2023-11-24T08:08:03.226308+0000","last_unstale":"2023-11-24T08:08:03.236957+0000","last_undegraded":"2023-11-24T08:08:03.236957+0000","last_fullsized":"2023-11-24T08:08:03.236957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:11.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237262+0000","last_change":"2023-11-24T08:08:03.229909+0000","last_active":"2023-11-24T08:08:03.237262+0000","last_peered":"2023-11-24T08:08:03.237262+0000","last_clean":"2023-11-24T08:08:03.237262+0000","last_became_active":"2023-11-24T08:08:03.229542+0000","last_became_peered":"2023-11-24T08:08:03.229542+0000","last_unstale":"2023-11-24T08:08:03.237262+0000","last_undegraded":"2023-11-24T08:08:03.237262+0000","last_fullsized":"2023-11-24T08:08:03.237262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:07:04.087760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.407876+0000","last_change":"2023-11-24T08:08:03.246121+0000","last_active":"2023-11-24T08:08:04.407876+0000","last_peered":"2023-11-24T08:08:04.407876+0000","last_clean":"2023-11-24T08:08:04.407876+0000","last_became_active":"2023-11-24T08:08:03.239501+0000","last_became_peered":"2023-11-24T08:08:03.239501+0000","last_unstale":"2023-11-24T08:08:04.407876+0000","last_undegraded":"2023-11-24T08:08:04.407876+0000","last_fullsized":"2023-11-24T08:08:04.407876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:36.507635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245633+0000","last_change":"2023-11-24T08:08:03.237207+0000","last_active":"2023-11-24T08:08:03.245633+0000","last_peered":"2023-11-24T08:08:03.245633+0000","last_clean":"2023-11-24T08:08:03.245633+0000","last_became_active":"2023-11-24T08:08:03.235004+0000","last_became_peered":"2023-11-24T08:08:03.235004+0000","last_unstale":"2023-11-24T08:08:03.245633+0000","last_undegraded":"2023-11-24T08:08:03.245633+0000","last_fullsized":"2023-11-24T08:08:03.245633+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:22.417665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.242467+0000","last_change":"2023-11-24T08:08:03.237471+0000","last_active":"2023-11-24T08:08:03.242467+0000","last_peered":"2023-11-24T08:08:03.242467+0000","last_clean":"2023-11-24T08:08:03.242467+0000","last_became_active":"2023-11-24T08:08:03.237224+0000","last_became_peered":"2023-11-24T08:08:03.237224+0000","last_unstale":"2023-11-24T08:08:03.242467+0000","last_undegraded":"2023-11-24T08:08:03.242467+0000","last_fullsized":"2023-11-24T08:08:03.242467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:16.065589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233680+0000","last_change":"2023-11-24T08:08:03.247432+0000","last_active":"2023-11-24T08:08:04.233680+0000","last_peered":"2023-11-24T08:08:04.233680+0000","last_clean":"2023-11-24T08:08:04.233680+0000","last_became_active":"2023-11-24T08:08:03.243447+0000","last_became_peered":"2023-11-24T08:08:03.243447+0000","last_unstale":"2023-11-24T08:08:04.233680+0000","last_undegraded":"2023-11-24T08:08:04.233680+0000","last_fullsized":"2023-11-24T08:08:04.233680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:47.806698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252360+0000","last_change":"2023-11-24T08:08:03.246749+0000","last_active":"2023-11-24T08:08:03.252360+0000","last_peered":"2023-11-24T08:08:03.252360+0000","last_clean":"2023-11-24T08:08:03.252360+0000","last_became_active":"2023-11-24T08:08:03.243612+0000","last_became_peered":"2023-11-24T08:08:03.243612+0000","last_unstale":"2023-11-24T08:08:03.252360+0000","last_undegraded":"2023-11-24T08:08:03.252360+0000","last_fullsized":"2023-11-24T08:08:03.252360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:30.726997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.250202+0000","last_change":"2023-11-24T08:08:03.243232+0000","last_active":"2023-11-24T08:08:03.250202+0000","last_peered":"2023-11-24T08:08:03.250202+0000","last_clean":"2023-11-24T08:08:03.250202+0000","last_became_active":"2023-11-24T08:08:03.242882+0000","last_became_peered":"2023-11-24T08:08:03.242882+0000","last_unstale":"2023-11-24T08:08:03.250202+0000","last_undegraded":"2023-11-24T08:08:03.250202+0000","last_fullsized":"2023-11-24T08:08:03.250202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:22.013930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237230+0000","last_change":"2023-11-24T08:08:03.229321+0000","last_active":"2023-11-24T08:08:03.237230+0000","last_peered":"2023-11-24T08:08:03.237230+0000","last_clean":"2023-11-24T08:08:03.237230+0000","last_became_active":"2023-11-24T08:08:03.229016+0000","last_became_peered":"2023-11-24T08:08:03.229016+0000","last_unstale":"2023-11-24T08:08:03.237230+0000","last_undegraded":"2023-11-24T08:08:03.237230+0000","last_fullsized":"2023-11-24T08:08:03.237230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:57.298705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236570+0000","last_change":"2023-11-24T08:08:03.246515+0000","last_active":"2023-11-24T08:08:04.236570+0000","last_peered":"2023-11-24T08:08:04.236570+0000","last_clean":"2023-11-24T08:08:04.236570+0000","last_became_active":"2023-11-24T08:08:03.246183+0000","last_became_peered":"2023-11-24T08:08:03.246183+0000","last_unstale":"2023-11-24T08:08:04.236570+0000","last_undegraded":"2023-11-24T08:08:04.236570+0000","last_fullsized":"2023-11-24T08:08:04.236570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:37.172485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245254+0000","last_change":"2023-11-24T08:08:03.240414+0000","last_active":"2023-11-24T08:08:03.245254+0000","last_peered":"2023-11-24T08:08:03.245254+0000","last_clean":"2023-11-24T08:08:03.245254+0000","last_became_active":"2023-11-24T08:08:03.240121+0000","last_became_peered":"2023-11-24T08:08:03.240121+0000","last_unstale":"2023-11-24T08:08:03.245254+0000","last_undegraded":"2023-11-24T08:08:03.245254+0000","last_fullsized":"2023-11-24T08:08:03.245254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:42.240633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235035+0000","last_change":"2023-11-24T08:08:03.234219+0000","last_active":"2023-11-24T08:08:04.235035+0000","last_peered":"2023-11-24T08:08:04.235035+0000","last_clean":"2023-11-24T08:08:04.235035+0000","last_became_active":"2023-11-24T08:08:03.233451+0000","last_became_peered":"2023-11-24T08:08:03.233451+0000","last_unstale":"2023-11-24T08:08:04.235035+0000","last_undegraded":"2023-11-24T08:08:04.235035+0000","last_fullsized":"2023-11-24T08:08:04.235035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:56.408270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408881+0000","last_change":"2023-11-24T08:08:03.234271+0000","last_active":"2023-11-24T08:08:04.408881+0000","last_peered":"2023-11-24T08:08:04.408881+0000","last_clean":"2023-11-24T08:08:04.408881+0000","last_became_active":"2023-11-24T08:08:03.233965+0000","last_became_peered":"2023-11-24T08:08:03.233965+0000","last_unstale":"2023-11-24T08:08:04.408881+0000","last_undegraded":"2023-11-24T08:08:04.408881+0000","last_fullsized":"2023-11-24T08:08:04.408881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:10.245062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252838+0000","last_change":"2023-11-24T08:08:02.226066+0000","last_active":"2023-11-24T08:08:03.252838+0000","last_peered":"2023-11-24T08:08:03.252838+0000","last_clean":"2023-11-24T08:08:03.252838+0000","last_became_active":"2023-11-24T08:08:02.225549+0000","last_became_peered":"2023-11-24T08:08:02.225549+0000","last_unstale":"2023-11-24T08:08:03.252838+0000","last_undegraded":"2023-11-24T08:08:03.252838+0000","last_fullsized":"2023-11-24T08:08:03.252838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:25:01.334376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245709+0000","last_change":"2023-11-24T08:08:03.241990+0000","last_active":"2023-11-24T08:08:03.245709+0000","last_peered":"2023-11-24T08:08:03.245709+0000","last_clean":"2023-11-24T08:08:03.245709+0000","last_became_active":"2023-11-24T08:08:03.241688+0000","last_became_peered":"2023-11-24T08:08:03.241688+0000","last_unstale":"2023-11-24T08:08:03.245709+0000","last_undegraded":"2023-11-24T08:08:03.245709+0000","last_fullsized":"2023-11-24T08:08:03.245709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:27.322348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408964+0000","last_change":"2023-11-24T08:08:02.219724+0000","last_active":"2023-11-24T08:08:04.408964+0000","last_peered":"2023-11-24T08:08:04.408964+0000","last_clean":"2023-11-24T08:08:04.408964+0000","last_became_active":"2023-11-24T08:08:02.219458+0000","last_became_peered":"2023-11-24T08:08:02.219458+0000","last_unstale":"2023-11-24T08:08:04.408964+0000","last_undegraded":"2023-11-24T08:08:04.408964+0000","last_fullsized":"2023-11-24T08:08:04.408964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:05.904638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237235+0000","last_change":"2023-11-24T08:08:03.230522+0000","last_active":"2023-11-24T08:08:03.237235+0000","last_peered":"2023-11-24T08:08:03.237235+0000","last_clean":"2023-11-24T08:08:03.237235+0000","last_became_active":"2023-11-24T08:08:03.229003+0000","last_became_peered":"2023-11-24T08:08:03.229003+0000","last_unstale":"2023-11-24T08:08:03.237235+0000","last_undegraded":"2023-11-24T08:08:03.237235+0000","last_fullsized":"2023-11-24T08:08:03.237235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:49.733887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233305+0000","last_change":"2023-11-24T08:08:02.206891+0000","last_active":"2023-11-24T08:08:04.233305+0000","last_peered":"2023-11-24T08:08:04.233305+0000","last_clean":"2023-11-24T08:08:04.233305+0000","last_became_active":"2023-11-24T08:08:02.206592+0000","last_became_peered":"2023-11-24T08:08:02.206592+0000","last_unstale":"2023-11-24T08:08:04.233305+0000","last_undegraded":"2023-11-24T08:08:04.233305+0000","last_fullsized":"2023-11-24T08:08:04.233305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:55.392995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252410+0000","last_change":"2023-11-24T08:08:03.247815+0000","last_active":"2023-11-24T08:08:03.252410+0000","last_peered":"2023-11-24T08:08:03.252410+0000","last_clean":"2023-11-24T08:08:03.252410+0000","last_became_active":"2023-11-24T08:08:03.242100+0000","last_became_peered":"2023-11-24T08:08:03.242100+0000","last_unstale":"2023-11-24T08:08:03.252410+0000","last_undegraded":"2023-11-24T08:08:03.252410+0000","last_fullsized":"2023-11-24T08:08:03.252410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:22.013930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.248511+0000","last_change":"2023-11-24T08:08:02.209494+0000","last_active":"2023-11-24T08:08:03.248511+0000","last_peered":"2023-11-24T08:08:03.248511+0000","last_clean":"2023-11-24T08:08:03.248511+0000","last_became_active":"2023-11-24T08:08:02.208684+0000","last_became_peered":"2023-11-24T08:08:02.208684+0000","last_unstale":"2023-11-24T08:08:03.248511+0000","last_undegraded":"2023-11-24T08:08:03.248511+0000","last_fullsized":"2023-11-24T08:08:03.248511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:07:03.072485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236385+0000","last_change":"2023-11-24T08:08:03.241171+0000","last_active":"2023-11-24T08:08:04.236385+0000","last_peered":"2023-11-24T08:08:04.236385+0000","last_clean":"2023-11-24T08:08:04.236385+0000","last_became_active":"2023-11-24T08:08:03.240849+0000","last_became_peered":"2023-11-24T08:08:03.240849+0000","last_unstale":"2023-11-24T08:08:04.236385+0000","last_undegraded":"2023-11-24T08:08:04.236385+0000","last_fullsized":"2023-11-24T08:08:04.236385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:38:48.847689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.240495+0000","last_change":"2023-11-24T08:08:02.220404+0000","last_active":"2023-11-24T08:08:03.240495+0000","last_peered":"2023-11-24T08:08:03.240495+0000","last_clean":"2023-11-24T08:08:03.240495+0000","last_became_active":"2023-11-24T08:08:02.220090+0000","last_became_peered":"2023-11-24T08:08:02.220090+0000","last_unstale":"2023-11-24T08:08:03.240495+0000","last_undegraded":"2023-11-24T08:08:03.240495+0000","last_fullsized":"2023-11-24T08:08:03.240495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:39.697414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.246028+0000","last_change":"2023-11-24T08:08:03.240673+0000","last_active":"2023-11-24T08:08:03.246028+0000","last_peered":"2023-11-24T08:08:03.246028+0000","last_clean":"2023-11-24T08:08:03.246028+0000","last_became_active":"2023-11-24T08:08:03.240068+0000","last_became_peered":"2023-11-24T08:08:03.240068+0000","last_unstale":"2023-11-24T08:08:03.246028+0000","last_undegraded":"2023-11-24T08:08:03.246028+0000","last_fullsized":"2023-11-24T08:08:03.246028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:41.901192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.241808+0000","last_change":"2023-11-24T08:08:02.219642+0000","last_active":"2023-11-24T08:08:03.241808+0000","last_peered":"2023-11-24T08:08:03.241808+0000","last_clean":"2023-11-24T08:08:03.241808+0000","last_became_active":"2023-11-24T08:08:02.219361+0000","last_became_peered":"2023-11-24T08:08:02.219361+0000","last_unstale":"2023-11-24T08:08:03.241808+0000","last_undegraded":"2023-11-24T08:08:03.241808+0000","last_fullsized":"2023-11-24T08:08:03.241808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:41.225358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.243852+0000","last_change":"2023-11-24T08:08:03.237895+0000","last_active":"2023-11-24T08:08:03.243852+0000","last_peered":"2023-11-24T08:08:03.243852+0000","last_clean":"2023-11-24T08:08:03.243852+0000","last_became_active":"2023-11-24T08:08:03.237612+0000","last_became_peered":"2023-11-24T08:08:03.237612+0000","last_unstale":"2023-11-24T08:08:03.243852+0000","last_undegraded":"2023-11-24T08:08:03.243852+0000","last_fullsized":"2023-11-24T08:08:03.243852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:12.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232565+0000","last_change":"2023-11-24T08:08:02.199608+0000","last_active":"2023-11-24T08:08:04.232565+0000","last_peered":"2023-11-24T08:08:04.232565+0000","last_clean":"2023-11-24T08:08:04.232565+0000","last_became_active":"2023-11-24T08:08:02.199346+0000","last_became_peered":"2023-11-24T08:08:02.199346+0000","last_unstale":"2023-11-24T08:08:04.232565+0000","last_undegraded":"2023-11-24T08:08:04.232565+0000","last_fullsized":"2023-11-24T08:08:04.232565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:20.998654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.253930+0000","last_change":"2023-11-24T08:08:03.253109+0000","last_active":"2023-11-24T08:08:03.253930+0000","last_peered":"2023-11-24T08:08:03.253930+0000","last_clean":"2023-11-24T08:08:03.253930+0000","last_became_active":"2023-11-24T08:08:03.252720+0000","last_became_peered":"2023-11-24T08:08:03.252720+0000","last_unstale":"2023-11-24T08:08:03.253930+0000","last_undegraded":"2023-11-24T08:08:03.253930+0000","last_fullsized":"2023-11-24T08:08:03.253930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:40.712689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216139+0000","last_change":"2023-11-24T08:08:02.216570+0000","last_active":"2023-11-24T08:08:03.216139+0000","last_peered":"2023-11-24T08:08:03.216139+0000","last_clean":"2023-11-24T08:08:03.216139+0000","last_became_active":"2023-11-24T08:08:02.216245+0000","last_became_peered":"2023-11-24T08:08:02.216245+0000","last_unstale":"2023-11-24T08:08:03.216139+0000","last_undegraded":"2023-11-24T08:08:03.216139+0000","last_fullsized":"2023-11-24T08:08:03.216139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:32.470903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.257135+0000","last_change":"2023-11-24T08:08:03.251797+0000","last_active":"2023-11-24T08:08:03.257135+0000","last_peered":"2023-11-24T08:08:03.257135+0000","last_clean":"2023-11-24T08:08:03.257135+0000","last_became_active":"2023-11-24T08:08:03.249289+0000","last_became_peered":"2023-11-24T08:08:03.249289+0000","last_unstale":"2023-11-24T08:08:03.257135+0000","last_undegraded":"2023-11-24T08:08:03.257135+0000","last_fullsized":"2023-11-24T08:08:03.257135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:51.459757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233863+0000","last_change":"2023-11-24T08:08:02.222192+0000","last_active":"2023-11-24T08:08:04.233863+0000","last_peered":"2023-11-24T08:08:04.233863+0000","last_clean":"2023-11-24T08:08:04.233863+0000","last_became_active":"2023-11-24T08:08:02.221918+0000","last_became_peered":"2023-11-24T08:08:02.221918+0000","last_unstale":"2023-11-24T08:08:04.233863+0000","last_undegraded":"2023-11-24T08:08:04.233863+0000","last_fullsized":"2023-11-24T08:08:04.233863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:03:38.627133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233958+0000","last_change":"2023-11-24T08:08:03.240060+0000","last_active":"2023-11-24T08:08:04.233958+0000","last_peered":"2023-11-24T08:08:04.233958+0000","last_clean":"2023-11-24T08:08:04.233958+0000","last_became_active":"2023-11-24T08:08:03.239780+0000","last_became_peered":"2023-11-24T08:08:03.239780+0000","last_unstale":"2023-11-24T08:08:04.233958+0000","last_undegraded":"2023-11-24T08:08:04.233958+0000","last_fullsized":"2023-11-24T08:08:04.233958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:31:48.943663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408966+0000","last_change":"2023-11-24T08:08:02.212825+0000","last_active":"2023-11-24T08:08:04.408966+0000","last_peered":"2023-11-24T08:08:04.408966+0000","last_clean":"2023-11-24T08:08:04.408966+0000","last_became_active":"2023-11-24T08:08:02.212539+0000","last_became_peered":"2023-11-24T08:08:02.212539+0000","last_unstale":"2023-11-24T08:08:04.408966+0000","last_undegraded":"2023-11-24T08:08:04.408966+0000","last_fullsized":"2023-11-24T08:08:04.408966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:41.857145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233351+0000","last_change":"2023-11-24T08:08:03.241268+0000","last_active":"2023-11-24T08:08:04.233351+0000","last_peered":"2023-11-24T08:08:04.233351+0000","last_clean":"2023-11-24T08:08:04.233351+0000","last_became_active":"2023-11-24T08:08:03.240427+0000","last_became_peered":"2023-11-24T08:08:03.240427+0000","last_unstale":"2023-11-24T08:08:04.233351+0000","last_undegraded":"2023-11-24T08:08:04.233351+0000","last_fullsized":"2023-11-24T08:08:04.233351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:43.968737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.254516+0000","last_change":"2023-11-24T08:08:02.222373+0000","last_active":"2023-11-24T08:08:03.254516+0000","last_peered":"2023-11-24T08:08:03.254516+0000","last_clean":"2023-11-24T08:08:03.254516+0000","last_became_active":"2023-11-24T08:08:02.222057+0000","last_became_peered":"2023-11-24T08:08:02.222057+0000","last_unstale":"2023-11-24T08:08:03.254516+0000","last_undegraded":"2023-11-24T08:08:03.254516+0000","last_fullsized":"2023-11-24T08:08:03.254516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:31.061155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252066+0000","last_change":"2023-11-24T08:08:03.248324+0000","last_active":"2023-11-24T08:08:03.252066+0000","last_peered":"2023-11-24T08:08:03.252066+0000","last_clean":"2023-11-24T08:08:03.252066+0000","last_became_active":"2023-11-24T08:08:03.247636+0000","last_became_peered":"2023-11-24T08:08:03.247636+0000","last_unstale":"2023-11-24T08:08:03.252066+0000","last_undegraded":"2023-11-24T08:08:03.252066+0000","last_fullsized":"2023-11-24T08:08:03.252066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:16.065589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233260+0000","last_change":"2023-11-24T08:08:02.208834+0000","last_active":"2023-11-24T08:08:04.233260+0000","last_peered":"2023-11-24T08:08:04.233260+0000","last_clean":"2023-11-24T08:08:04.233260+0000","last_became_active":"2023-11-24T08:08:02.208403+0000","last_became_peered":"2023-11-24T08:08:02.208403+0000","last_unstale":"2023-11-24T08:08:04.233260+0000","last_undegraded":"2023-11-24T08:08:04.233260+0000","last_fullsized":"2023-11-24T08:08:04.233260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:29.711722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.256296+0000","last_change":"2023-11-24T08:08:03.253508+0000","last_active":"2023-11-24T08:08:03.256296+0000","last_peered":"2023-11-24T08:08:03.256296+0000","last_clean":"2023-11-24T08:08:03.256296+0000","last_became_active":"2023-11-24T08:08:03.253161+0000","last_became_peered":"2023-11-24T08:08:03.253161+0000","last_unstale":"2023-11-24T08:08:03.256296+0000","last_undegraded":"2023-11-24T08:08:03.256296+0000","last_fullsized":"2023-11-24T08:08:03.256296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:27.322348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.244530+0000","last_change":"2023-11-24T08:08:02.218240+0000","last_active":"2023-11-24T08:08:03.244530+0000","last_peered":"2023-11-24T08:08:03.244530+0000","last_clean":"2023-11-24T08:08:03.244530+0000","last_became_active":"2023-11-24T08:08:02.217973+0000","last_became_peered":"2023-11-24T08:08:02.217973+0000","last_unstale":"2023-11-24T08:08:03.244530+0000","last_undegraded":"2023-11-24T08:08:03.244530+0000","last_fullsized":"2023-11-24T08:08:03.244530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:25:01.334376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232949+0000","last_change":"2023-11-24T08:08:03.225833+0000","last_active":"2023-11-24T08:08:04.232949+0000","last_peered":"2023-11-24T08:08:04.232949+0000","last_clean":"2023-11-24T08:08:04.232949+0000","last_became_active":"2023-11-24T08:08:03.225528+0000","last_became_peered":"2023-11-24T08:08:03.225528+0000","last_unstale":"2023-11-24T08:08:04.232949+0000","last_undegraded":"2023-11-24T08:08:04.232949+0000","last_fullsized":"2023-11-24T08:08:04.232949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:49.616235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216648+0000","last_change":"2023-11-24T08:08:02.217100+0000","last_active":"2023-11-24T08:08:03.216648+0000","last_peered":"2023-11-24T08:08:03.216648+0000","last_clean":"2023-11-24T08:08:03.216648+0000","last_became_active":"2023-11-24T08:08:02.216824+0000","last_became_peered":"2023-11-24T08:08:02.216824+0000","last_unstale":"2023-11-24T08:08:03.216648+0000","last_undegraded":"2023-11-24T08:08:03.216648+0000","last_fullsized":"2023-11-24T08:08:03.216648+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:25:01.334376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235116+0000","last_change":"2023-11-24T08:08:03.241206+0000","last_active":"2023-11-24T08:08:04.235116+0000","last_peered":"2023-11-24T08:08:04.235116+0000","last_clean":"2023-11-24T08:08:04.235116+0000","last_became_active":"2023-11-24T08:08:03.240918+0000","last_became_peered":"2023-11-24T08:08:03.240918+0000","last_unstale":"2023-11-24T08:08:04.235116+0000","last_undegraded":"2023-11-24T08:08:04.235116+0000","last_fullsized":"2023-11-24T08:08:04.235116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:57:47.706132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232549+0000","last_change":"2023-11-24T08:08:02.218999+0000","last_active":"2023-11-24T08:08:04.232549+0000","last_peered":"2023-11-24T08:08:04.232549+0000","last_clean":"2023-11-24T08:08:04.232549+0000","last_became_active":"2023-11-24T08:08:02.218725+0000","last_became_peered":"2023-11-24T08:08:02.218725+0000","last_unstale":"2023-11-24T08:08:04.232549+0000","last_undegraded":"2023-11-24T08:08:04.232549+0000","last_fullsized":"2023-11-24T08:08:04.232549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:26.020373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245583+0000","last_change":"2023-11-24T08:08:03.241291+0000","last_active":"2023-11-24T08:08:03.245583+0000","last_peered":"2023-11-24T08:08:03.245583+0000","last_clean":"2023-11-24T08:08:03.245583+0000","last_became_active":"2023-11-24T08:08:03.240880+0000","last_became_peered":"2023-11-24T08:08:03.240880+0000","last_unstale":"2023-11-24T08:08:03.245583+0000","last_undegraded":"2023-11-24T08:08:03.245583+0000","last_fullsized":"2023-11-24T08:08:03.245583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:06.015618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232641+0000","last_change":"2023-11-24T08:08:02.208200+0000","last_active":"2023-11-24T08:08:04.232641+0000","last_peered":"2023-11-24T08:08:04.232641+0000","last_clean":"2023-11-24T08:08:04.232641+0000","last_became_active":"2023-11-24T08:08:02.207931+0000","last_became_peered":"2023-11-24T08:08:02.207931+0000","last_unstale":"2023-11-24T08:08:04.232641+0000","last_undegraded":"2023-11-24T08:08:04.232641+0000","last_fullsized":"2023-11-24T08:08:04.232641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:31.061155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252129+0000","last_change":"2023-11-24T08:08:03.248295+0000","last_active":"2023-11-24T08:08:03.252129+0000","last_peered":"2023-11-24T08:08:03.252129+0000","last_clean":"2023-11-24T08:08:03.252129+0000","last_became_active":"2023-11-24T08:08:03.247988+0000","last_became_peered":"2023-11-24T08:08:03.247988+0000","last_unstale":"2023-11-24T08:08:03.252129+0000","last_undegraded":"2023-11-24T08:08:03.252129+0000","last_fullsized":"2023-11-24T08:08:03.252129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:33.269003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.235485+0000","last_change":"2023-11-24T08:08:02.214284+0000","last_active":"2023-11-24T08:08:03.235485+0000","last_peered":"2023-11-24T08:08:03.235485+0000","last_clean":"2023-11-24T08:08:03.235485+0000","last_became_active":"2023-11-24T08:08:02.214032+0000","last_became_peered":"2023-11-24T08:08:02.214032+0000","last_unstale":"2023-11-24T08:08:03.235485+0000","last_undegraded":"2023-11-24T08:08:03.235485+0000","last_fullsized":"2023-11-24T08:08:03.235485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:26.020373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252107+0000","last_change":"2023-11-24T08:08:03.248074+0000","last_active":"2023-11-24T08:08:03.252107+0000","last_peered":"2023-11-24T08:08:03.252107+0000","last_clean":"2023-11-24T08:08:03.252107+0000","last_became_active":"2023-11-24T08:08:03.244889+0000","last_became_peered":"2023-11-24T08:08:03.244889+0000","last_unstale":"2023-11-24T08:08:03.252107+0000","last_undegraded":"2023-11-24T08:08:03.252107+0000","last_fullsized":"2023-11-24T08:08:03.252107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:32:13.712187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.238414+0000","last_change":"2023-11-24T08:08:02.218698+0000","last_active":"2023-11-24T08:08:03.238414+0000","last_peered":"2023-11-24T08:08:03.238414+0000","last_clean":"2023-11-24T08:08:03.238414+0000","last_became_active":"2023-11-24T08:08:02.218366+0000","last_became_peered":"2023-11-24T08:08:02.218366+0000","last_unstale":"2023-11-24T08:08:03.238414+0000","last_undegraded":"2023-11-24T08:08:03.238414+0000","last_fullsized":"2023-11-24T08:08:03.238414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:23.938177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245835+0000","last_change":"2023-11-24T08:08:03.229540+0000","last_active":"2023-11-24T08:08:03.245835+0000","last_peered":"2023-11-24T08:08:03.245835+0000","last_clean":"2023-11-24T08:08:03.245835+0000","last_became_active":"2023-11-24T08:08:03.229278+0000","last_became_peered":"2023-11-24T08:08:03.229278+0000","last_unstale":"2023-11-24T08:08:03.245835+0000","last_undegraded":"2023-11-24T08:08:03.245835+0000","last_fullsized":"2023-11-24T08:08:03.245835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:06.015618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.239037+0000","last_change":"2023-11-24T08:08:02.213927+0000","last_active":"2023-11-24T08:08:03.239037+0000","last_peered":"2023-11-24T08:08:03.239037+0000","last_clean":"2023-11-24T08:08:03.239037+0000","last_became_active":"2023-11-24T08:08:02.211653+0000","last_became_peered":"2023-11-24T08:08:02.211653+0000","last_unstale":"2023-11-24T08:08:03.239037+0000","last_undegraded":"2023-11-24T08:08:03.239037+0000","last_fullsized":"2023-11-24T08:08:03.239037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:26.307073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.239764+0000","last_change":"2023-11-24T08:08:03.236070+0000","last_active":"2023-11-24T08:08:03.239764+0000","last_peered":"2023-11-24T08:08:03.239764+0000","last_clean":"2023-11-24T08:08:03.239764+0000","last_became_active":"2023-11-24T08:08:03.235833+0000","last_became_peered":"2023-11-24T08:08:03.235833+0000","last_unstale":"2023-11-24T08:08:03.239764+0000","last_undegraded":"2023-11-24T08:08:03.239764+0000","last_fullsized":"2023-11-24T08:08:03.239764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:26.509496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.219676+0000","last_change":"2023-11-24T08:08:02.216108+0000","last_active":"2023-11-24T08:08:03.219676+0000","last_peered":"2023-11-24T08:08:03.219676+0000","last_clean":"2023-11-24T08:08:03.219676+0000","last_became_active":"2023-11-24T08:08:02.215794+0000","last_became_peered":"2023-11-24T08:08:02.215794+0000","last_unstale":"2023-11-24T08:08:03.219676+0000","last_undegraded":"2023-11-24T08:08:03.219676+0000","last_fullsized":"2023-11-24T08:08:03.219676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:21.402390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.236981+0000","last_change":"2023-11-24T08:08:03.232854+0000","last_active":"2023-11-24T08:08:03.236981+0000","last_peered":"2023-11-24T08:08:03.236981+0000","last_clean":"2023-11-24T08:08:03.236981+0000","last_became_active":"2023-11-24T08:08:03.232456+0000","last_became_peered":"2023-11-24T08:08:03.232456+0000","last_unstale":"2023-11-24T08:08:03.236981+0000","last_undegraded":"2023-11-24T08:08:03.236981+0000","last_fullsized":"2023-11-24T08:08:03.236981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:11.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408378+0000","last_change":"2023-11-24T08:08:02.213721+0000","last_active":"2023-11-24T08:08:04.408378+0000","last_peered":"2023-11-24T08:08:04.408378+0000","last_clean":"2023-11-24T08:08:04.408378+0000","last_became_active":"2023-11-24T08:08:02.212532+0000","last_became_peered":"2023-11-24T08:08:02.212532+0000","last_unstale":"2023-11-24T08:08:04.408378+0000","last_undegraded":"2023-11-24T08:08:04.408378+0000","last_fullsized":"2023-11-24T08:08:04.408378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:51.301966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.235193+0000","last_change":"2023-11-24T08:08:03.225899+0000","last_active":"2023-11-24T08:08:03.235193+0000","last_peered":"2023-11-24T08:08:03.235193+0000","last_clean":"2023-11-24T08:08:03.235193+0000","last_became_active":"2023-11-24T08:08:03.225620+0000","last_became_peered":"2023-11-24T08:08:03.225620+0000","last_unstale":"2023-11-24T08:08:03.235193+0000","last_undegraded":"2023-11-24T08:08:03.235193+0000","last_fullsized":"2023-11-24T08:08:03.235193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:40:04.489091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.228669+0000","last_change":"2023-11-24T08:08:02.223682+0000","last_active":"2023-11-24T08:08:03.228669+0000","last_peered":"2023-11-24T08:08:03.228669+0000","last_clean":"2023-11-24T08:08:03.228669+0000","last_became_active":"2023-11-24T08:08:02.223390+0000","last_became_peered":"2023-11-24T08:08:02.223390+0000","last_unstale":"2023-11-24T08:08:03.228669+0000","last_undegraded":"2023-11-24T08:08:03.228669+0000","last_fullsized":"2023-11-24T08:08:03.228669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:09.925297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.234365+0000","last_change":"2023-11-24T08:08:03.225125+0000","last_active":"2023-11-24T08:08:03.234365+0000","last_peered":"2023-11-24T08:08:03.234365+0000","last_clean":"2023-11-24T08:08:03.234365+0000","last_became_active":"2023-11-24T08:08:03.223554+0000","last_became_peered":"2023-11-24T08:08:03.223554+0000","last_unstale":"2023-11-24T08:08:03.234365+0000","last_undegraded":"2023-11-24T08:08:03.234365+0000","last_fullsized":"2023-11-24T08:08:03.234365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:30:05.849655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216657+0000","last_change":"2023-11-24T08:08:02.210183+0000","last_active":"2023-11-24T08:08:03.216657+0000","last_peered":"2023-11-24T08:08:03.216657+0000","last_clean":"2023-11-24T08:08:03.216657+0000","last_became_active":"2023-11-24T08:08:02.209812+0000","last_became_peered":"2023-11-24T08:08:02.209812+0000","last_unstale":"2023-11-24T08:08:03.216657+0000","last_undegraded":"2023-11-24T08:08:03.216657+0000","last_fullsized":"2023-11-24T08:08:03.216657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:09.925297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.234844+0000","last_change":"2023-11-24T08:08:03.243221+0000","last_active":"2023-11-24T08:08:04.234844+0000","last_peered":"2023-11-24T08:08:04.234844+0000","last_clean":"2023-11-24T08:08:04.234844+0000","last_became_active":"2023-11-24T08:08:03.242535+0000","last_became_peered":"2023-11-24T08:08:03.242535+0000","last_unstale":"2023-11-24T08:08:04.234844+0000","last_undegraded":"2023-11-24T08:08:04.234844+0000","last_fullsized":"2023-11-24T08:08:04.234844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:57:55.131775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.228518+0000","last_change":"2023-11-24T08:08:02.220728+0000","last_active":"2023-11-24T08:08:03.228518+0000","last_peered":"2023-11-24T08:08:03.228518+0000","last_clean":"2023-11-24T08:08:03.228518+0000","last_became_active":"2023-11-24T08:08:02.220412+0000","last_became_peered":"2023-11-24T08:08:02.220412+0000","last_unstale":"2023-11-24T08:08:03.228518+0000","last_undegraded":"2023-11-24T08:08:03.228518+0000","last_fullsized":"2023-11-24T08:08:03.228518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:29.711722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252175+0000","last_change":"2023-11-24T08:08:03.251167+0000","last_active":"2023-11-24T08:08:03.252175+0000","last_peered":"2023-11-24T08:08:03.252175+0000","last_clean":"2023-11-24T08:08:03.252175+0000","last_became_active":"2023-11-24T08:08:03.250844+0000","last_became_peered":"2023-11-24T08:08:03.250844+0000","last_unstale":"2023-11-24T08:08:03.252175+0000","last_undegraded":"2023-11-24T08:08:03.252175+0000","last_fullsized":"2023-11-24T08:08:03.252175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:33.269003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.247102+0000","last_change":"2023-11-24T08:08:02.220854+0000","last_active":"2023-11-24T08:08:03.247102+0000","last_peered":"2023-11-24T08:08:03.247102+0000","last_clean":"2023-11-24T08:08:03.247102+0000","last_became_active":"2023-11-24T08:08:02.220565+0000","last_became_peered":"2023-11-24T08:08:02.220565+0000","last_unstale":"2023-11-24T08:08:03.247102+0000","last_undegraded":"2023-11-24T08:08:03.247102+0000","last_fullsized":"2023-11-24T08:08:03.247102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:40.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.249082+0000","last_change":"2023-11-24T08:08:03.243022+0000","last_active":"2023-11-24T08:08:03.249082+0000","last_peered":"2023-11-24T08:08:03.249082+0000","last_clean":"2023-11-24T08:08:03.249082+0000","last_became_active":"2023-11-24T08:08:03.242720+0000","last_became_peered":"2023-11-24T08:08:03.242720+0000","last_unstale":"2023-11-24T08:08:03.249082+0000","last_undegraded":"2023-11-24T08:08:03.249082+0000","last_fullsized":"2023-11-24T08:08:03.249082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:40.211028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.409052+0000","last_change":"2023-11-24T08:08:02.211128+0000","last_active":"2023-11-24T08:08:04.409052+0000","last_peered":"2023-11-24T08:08:04.409052+0000","last_clean":"2023-11-24T08:08:04.409052+0000","last_became_active":"2023-11-24T08:08:02.210847+0000","last_became_peered":"2023-11-24T08:08:02.210847+0000","last_unstale":"2023-11-24T08:08:04.409052+0000","last_undegraded":"2023-11-24T08:08:04.409052+0000","last_fullsized":"2023-11-24T08:08:04.409052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:17:51.784778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408628+0000","last_change":"2023-11-24T08:08:03.227307+0000","last_active":"2023-11-24T08:08:04.408628+0000","last_peered":"2023-11-24T08:08:04.408628+0000","last_clean":"2023-11-24T08:08:04.408628+0000","last_became_active":"2023-11-24T08:08:03.226976+0000","last_became_peered":"2023-11-24T08:08:03.226976+0000","last_unstale":"2023-11-24T08:08:04.408628+0000","last_undegraded":"2023-11-24T08:08:04.408628+0000","last_fullsized":"2023-11-24T08:08:04.408628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:55:07.058115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.214571+0000","last_change":"2023-11-24T08:08:02.208652+0000","last_active":"2023-11-24T08:08:03.214571+0000","last_peered":"2023-11-24T08:08:03.214571+0000","last_clean":"2023-11-24T08:08:03.214571+0000","last_became_active":"2023-11-24T08:08:02.208420+0000","last_became_peered":"2023-11-24T08:08:02.208420+0000","last_unstale":"2023-11-24T08:08:03.214571+0000","last_undegraded":"2023-11-24T08:08:03.214571+0000","last_fullsized":"2023-11-24T08:08:03.214571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:23.938177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245552+0000","last_change":"2023-11-24T08:08:03.240847+0000","last_active":"2023-11-24T08:08:03.245552+0000","last_peered":"2023-11-24T08:08:03.245552+0000","last_clean":"2023-11-24T08:08:03.245552+0000","last_became_active":"2023-11-24T08:08:03.240544+0000","last_became_peered":"2023-11-24T08:08:03.240544+0000","last_unstale":"2023-11-24T08:08:03.245552+0000","last_undegraded":"2023-11-24T08:08:03.245552+0000","last_fullsized":"2023-11-24T08:08:03.245552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:33.486178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408579+0000","last_change":"2023-11-24T08:08:02.220781+0000","last_active":"2023-11-24T08:08:04.408579+0000","last_peered":"2023-11-24T08:08:04.408579+0000","last_clean":"2023-11-24T08:08:04.408579+0000","last_became_active":"2023-11-24T08:08:02.220515+0000","last_became_peered":"2023-11-24T08:08:02.220515+0000","last_unstale":"2023-11-24T08:08:04.408579+0000","last_undegraded":"2023-11-24T08:08:04.408579+0000","last_fullsized":"2023-11-24T08:08:04.408579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:17.342587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408209+0000","last_change":"2023-11-24T08:08:03.238629+0000","last_active":"2023-11-24T08:08:04.408209+0000","last_peered":"2023-11-24T08:08:04.408209+0000","last_clean":"2023-11-24T08:08:04.408209+0000","last_became_active":"2023-11-24T08:08:03.238167+0000","last_became_peered":"2023-11-24T08:08:03.238167+0000","last_unstale":"2023-11-24T08:08:04.408209+0000","last_undegraded":"2023-11-24T08:08:04.408209+0000","last_fullsized":"2023-11-24T08:08:04.408209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:01.468974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216716+0000","last_change":"2023-11-24T08:08:02.217563+0000","last_active":"2023-11-24T08:08:03.216716+0000","last_peered":"2023-11-24T08:08:03.216716+0000","last_clean":"2023-11-24T08:08:03.216716+0000","last_became_active":"2023-11-24T08:08:02.217317+0000","last_became_peered":"2023-11-24T08:08:02.217317+0000","last_unstale":"2023-11-24T08:08:03.216716+0000","last_undegraded":"2023-11-24T08:08:03.216716+0000","last_fullsized":"2023-11-24T08:08:03.216716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:21.402390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232531+0000","last_change":"2023-11-24T08:08:03.243150+0000","last_active":"2023-11-24T08:08:04.232531+0000","last_peered":"2023-11-24T08:08:04.232531+0000","last_clean":"2023-11-24T08:08:04.232531+0000","last_became_active":"2023-11-24T08:08:03.231067+0000","last_became_peered":"2023-11-24T08:08:03.231067+0000","last_unstale":"2023-11-24T08:08:04.232531+0000","last_undegraded":"2023-11-24T08:08:04.232531+0000","last_fullsized":"2023-11-24T08:08:04.232531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:49:06.480779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216991+0000","last_change":"2023-11-24T08:08:02.220865+0000","last_active":"2023-11-24T08:08:03.216991+0000","last_peered":"2023-11-24T08:08:03.216991+0000","last_clean":"2023-11-24T08:08:03.216991+0000","last_became_active":"2023-11-24T08:08:02.220520+0000","last_became_peered":"2023-11-24T08:08:02.220520+0000","last_unstale":"2023-11-24T08:08:03.216991+0000","last_undegraded":"2023-11-24T08:08:03.216991+0000","last_fullsized":"2023-11-24T08:08:03.216991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:05.000343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237881+0000","last_change":"2023-11-24T08:08:03.233842+0000","last_active":"2023-11-24T08:08:03.237881+0000","last_peered":"2023-11-24T08:08:03.237881+0000","last_clean":"2023-11-24T08:08:03.237881+0000","last_became_active":"2023-11-24T08:08:03.233505+0000","last_became_peered":"2023-11-24T08:08:03.233505+0000","last_unstale":"2023-11-24T08:08:03.237881+0000","last_undegraded":"2023-11-24T08:08:03.237881+0000","last_fullsized":"2023-11-24T08:08:03.237881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:46.688269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232754+0000","last_change":"2023-11-24T08:08:02.219788+0000","last_active":"2023-11-24T08:08:04.232754+0000","last_peered":"2023-11-24T08:08:04.232754+0000","last_clean":"2023-11-24T08:08:04.232754+0000","last_became_active":"2023-11-24T08:08:02.219552+0000","last_became_peered":"2023-11-24T08:08:02.219552+0000","last_unstale":"2023-11-24T08:08:04.232754+0000","last_undegraded":"2023-11-24T08:08:04.232754+0000","last_fullsized":"2023-11-24T08:08:04.232754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:57:54.116500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236472+0000","last_change":"2023-11-24T08:08:03.236394+0000","last_active":"2023-11-24T08:08:04.236472+0000","last_peered":"2023-11-24T08:08:04.236472+0000","last_clean":"2023-11-24T08:08:04.236472+0000","last_became_active":"2023-11-24T08:08:03.236099+0000","last_became_peered":"2023-11-24T08:08:03.236099+0000","last_unstale":"2023-11-24T08:08:04.236472+0000","last_undegraded":"2023-11-24T08:08:04.236472+0000","last_fullsized":"2023-11-24T08:08:04.236472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:03:37.572125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.230169+0000","last_change":"2023-11-24T08:08:02.224821+0000","last_active":"2023-11-24T08:08:03.230169+0000","last_peered":"2023-11-24T08:08:03.230169+0000","last_clean":"2023-11-24T08:08:03.230169+0000","last_became_active":"2023-11-24T08:08:02.224068+0000","last_became_peered":"2023-11-24T08:08:02.224068+0000","last_unstale":"2023-11-24T08:08:03.230169+0000","last_undegraded":"2023-11-24T08:08:03.230169+0000","last_fullsized":"2023-11-24T08:08:03.230169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:39.697414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.228311+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:08:03.228311+0000","last_peered":"2023-11-24T08:08:03.228311+0000","last_clean":"2023-11-24T08:08:03.228311+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:08:03.228311+0000","last_undegraded":"2023-11-24T08:08:03.228311+0000","last_fullsized":"2023-11-24T08:08:03.228311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":738708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.079}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.151}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.359},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.3280000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.26},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.4179999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4490000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.528},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":1.4830000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0620000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1240000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.216},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.1559999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.423}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.3640000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0579999999999998,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.5209999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.7110000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.855},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.369}]},{"osd":2,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":3.2069999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":2.6120000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":4.173},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.601}]},{"osd":4,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":3.5960000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":2.5190000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":3.4820000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":4.5709999999999997},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":4.3209999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.218}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.141}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3700000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5099999999999998,"5min":3.5099999999999998,"15min":3.5099999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.496}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.5840000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.3979999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":149884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0009999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.876},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.0569999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.2589999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.214},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.363}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.419}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.496}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.536},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3149999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.92400000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.877}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":1.04},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":1.226}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":149884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.04},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.78300000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.222}]},{"osd":3,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.97799999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.413}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.3169999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4650000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.51},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.373}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":738618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.93999999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.119}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.5049999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.554}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.369},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.341}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.448},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.407},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1779999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:07.672 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:07.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.919+0000 7f54cf59e640 1 Processor -- start 2023-11-24T08:08:07.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.919+0000 7f54cf59e640 1 -- start start 2023-11-24T08:08:07.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.920+0000 7f54cf59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f54d0159590 0x7f54d0070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.920+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.920+0000 7f54cf59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d0071790 con 0x7f54d00cd220 2023-11-24T08:08:07.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.920+0000 7f54cf59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d0071100 con 0x7f54d0159590 2023-11-24T08:08:07.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.920+0000 7f54cf59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0070860 con 0x7f54d00b3c20 2023-11-24T08:08:07.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54ce59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f54d0159590 0x7f54d0070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54ced9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f54d00cd220 0x7f54d006d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45422/0 (socket says 172.21.15.97:45422) 2023-11-24T08:08:07.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54ced9d640 1 -- 172.21.15.97:0/2999818586 learned_addr learned my addr 172.21.15.97:0/2999818586 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:07.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54c7fff640 1 --2- 172.21.15.97:0/2999818586 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54ce59c640 1 -- 172.21.15.97:0/2999818586 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 msgr2=0x7f54d00ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:07.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54ce59c640 1 --2- 172.21.15.97:0/2999818586 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d00ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54cdd9b640 1 -- 172.21.15.97:0/2999818586 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914067320 0 0) 0x7f54d0071790 con 0x7f54d00cd220 2023-11-24T08:08:07.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54ce59c640 1 -- 172.21.15.97:0/2999818586 >> v1:172.21.15.97:6789/0 conn(0x7f54d00cd220 legacy=0x7f54d006d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54ce59c640 1 -- 172.21.15.97:0/2999818586 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0070b40 con 0x7f54d0159590 2023-11-24T08:08:07.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.921+0000 7f54c7fff640 1 --2- 172.21.15.97:0/2999818586 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:07.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.922+0000 7f54ce59c640 1 --2- 172.21.15.97:0/2999818586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d0159590 0x7f54d0070160 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097a0 tx=0x7f54c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7159b5e1ac35fdf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:07.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cdd9b640 1 -- 172.21.15.97:0/2999818586 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c002e070 con 0x7f54d0159590 2023-11-24T08:08:07.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cdd9b640 1 -- 172.21.15.97:0/2999818586 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c00315a0 con 0x7f54d0159590 2023-11-24T08:08:07.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cdd9b640 1 -- 172.21.15.97:0/2999818586 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0031930 con 0x7f54d0159590 2023-11-24T08:08:07.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cf59e640 1 -- 172.21.15.97:0/2999818586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d0159590 msgr2=0x7f54d0070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cf59e640 1 --2- 172.21.15.97:0/2999818586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d0159590 0x7f54d0070160 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097a0 tx=0x7f54c002b840 comp rx=0 tx=0).stop 2023-11-24T08:08:07.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cf59e640 1 -- 172.21.15.97:0/2999818586 shutdown_connections 2023-11-24T08:08:07.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cf59e640 1 --2- 172.21.15.97:0/2999818586 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cf59e640 1 --2- 172.21.15.97:0/2999818586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d0159590 0x7f54d0070160 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cf59e640 1 -- 172.21.15.97:0/2999818586 >> 172.21.15.97:0/2999818586 conn(0x7f54d006a800 msgr2=0x7f54d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:07.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.923+0000 7f54cf59e640 1 -- 172.21.15.97:0/2999818586 shutdown_connections 2023-11-24T08:08:07.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.924+0000 7f54cf59e640 1 -- 172.21.15.97:0/2999818586 wait complete. 2023-11-24T08:08:07.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.925+0000 7f54cf59e640 1 Processor -- start 2023-11-24T08:08:07.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.925+0000 7f54cf59e640 1 -- start start 2023-11-24T08:08:07.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.926+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d014a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.926+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d00cd220 0x7f54d013d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.926+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d0159590 0x7f54d013de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.926+0000 7f54cf59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01e4940 con 0x7f54d00cd220 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.926+0000 7f54cf59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0155420 con 0x7f54d0159590 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.926+0000 7f54cf59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d014a8e0 con 0x7f54d00b3c20 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.926+0000 7f54c7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d00cd220 0x7f54d013d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d00cd220 0x7f54d013d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42210/0 (socket says 172.21.15.97:42210) 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 -- 172.21.15.97:0/1016248108 learned_addr learned my addr 172.21.15.97:0/1016248108 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54ce59c640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d014a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 -- 172.21.15.97:0/1016248108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 msgr2=0x7f54d014a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d014a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 -- 172.21.15.97:0/1016248108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d0159590 msgr2=0x7f54d013de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:07.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d0159590 0x7f54d013de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:07.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 -- 172.21.15.97:0/1016248108 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009400 con 0x7f54d00cd220 2023-11-24T08:08:07.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c7fff640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d00cd220 0x7f54d013d4f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c7f0 tx=0x7f54b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:07.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.927+0000 7f54c6ffd640 1 -- 172.21.15.97:0/1016248108 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8007a30 con 0x7f54d00cd220 2023-11-24T08:08:07.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.928+0000 7f54c6ffd640 1 -- 172.21.15.97:0/1016248108 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8007b90 con 0x7f54d00cd220 2023-11-24T08:08:07.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.928+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d014adf0 con 0x7f54d00cd220 2023-11-24T08:08:07.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.928+0000 7f54c6ffd640 1 -- 172.21.15.97:0/1016248108 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800ce40 con 0x7f54d00cd220 2023-11-24T08:08:07.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.928+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d014b3b0 con 0x7f54d00cd220 2023-11-24T08:08:07.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.929+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d0067450 con 0x7f54d00cd220 2023-11-24T08:08:07.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.930+0000 7f54c6ffd640 1 -- 172.21.15.97:0/1016248108 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54b80113f0 con 0x7f54d00cd220 2023-11-24T08:08:07.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.931+0000 7f54c6ffd640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f54b006ae40 0x7f54b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:07.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.931+0000 7f54c6ffd640 1 -- 172.21.15.97:0/1016248108 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54b8089750 con 0x7f54d00cd220 2023-11-24T08:08:07.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.931+0000 7f54ce59c640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f54b006ae40 0x7f54b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:07.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.932+0000 7f54ce59c640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f54b006ae40 0x7f54b006d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54c0036000 tx=0x7f54c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:07.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:07.935+0000 7f54c6ffd640 1 -- 172.21.15.97:0/1016248108 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54b8054800 con 0x7f54d00cd220 2023-11-24T08:08:08.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.122+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54d00cc020 con 0x7f54b006ae40 2023-11-24T08:08:08.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.134+0000 7f54c6ffd640 1 -- 172.21.15.97:0/1016248108 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287725 (secure 0 0 0) 0x7f54d00cc020 con 0x7f54b006ae40 2023-11-24T08:08:08.139 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:08.141 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:08:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f54b006ae40 msgr2=0x7f54b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f54b006ae40 0x7f54b006d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54c0036000 tx=0x7f54c0008030 comp rx=0 tx=0).stop 2023-11-24T08:08:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d00cd220 msgr2=0x7f54d013d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d00cd220 0x7f54d013d4f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c7f0 tx=0x7f54b800cbf0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 shutdown_connections 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f54b006ae40 0x7f54b006d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d0159590 0x7f54d013de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d00cd220 0x7f54d013d4f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 --2- 172.21.15.97:0/1016248108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d00b3c20 0x7f54d014a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 >> 172.21.15.97:0/1016248108 conn(0x7f54d006a800 msgr2=0x7f54d0149920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 shutdown_connections 2023-11-24T08:08:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.140+0000 7f54cf59e640 1 -- 172.21.15.97:0/1016248108 wait complete. 2023-11-24T08:08:08.160 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-11-24T08:08:07.293679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224528,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750192,"statfs":{"total":773094113280,"available":772864196608,"internally_reserved":0,"allocated":4300800,"data_stored":2371556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001745"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.254004+0000","last_change":"2023-11-24T08:08:03.250450+0000","last_active":"2023-11-24T08:08:03.254004+0000","last_peered":"2023-11-24T08:08:03.254004+0000","last_clean":"2023-11-24T08:08:03.254004+0000","last_became_active":"2023-11-24T08:08:03.250097+0000","last_became_peered":"2023-11-24T08:08:03.250097+0000","last_unstale":"2023-11-24T08:08:03.254004+0000","last_undegraded":"2023-11-24T08:08:03.254004+0000","last_fullsized":"2023-11-24T08:08:03.254004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:24.953452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233554+0000","last_change":"2023-11-24T08:08:03.230438+0000","last_active":"2023-11-24T08:08:04.233554+0000","last_peered":"2023-11-24T08:08:04.233554+0000","last_clean":"2023-11-24T08:08:04.233554+0000","last_became_active":"2023-11-24T08:08:03.229929+0000","last_became_peered":"2023-11-24T08:08:03.229929+0000","last_unstale":"2023-11-24T08:08:04.233554+0000","last_undegraded":"2023-11-24T08:08:04.233554+0000","last_fullsized":"2023-11-24T08:08:04.233554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:22:45.935441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.251958+0000","last_change":"2023-11-24T08:08:03.247594+0000","last_active":"2023-11-24T08:08:03.251958+0000","last_peered":"2023-11-24T08:08:03.251958+0000","last_clean":"2023-11-24T08:08:03.251958+0000","last_became_active":"2023-11-24T08:08:03.247289+0000","last_became_peered":"2023-11-24T08:08:03.247289+0000","last_unstale":"2023-11-24T08:08:03.251958+0000","last_undegraded":"2023-11-24T08:08:03.251958+0000","last_fullsized":"2023-11-24T08:08:03.251958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:00.239835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245854+0000","last_change":"2023-11-24T08:08:03.237839+0000","last_active":"2023-11-24T08:08:03.245854+0000","last_peered":"2023-11-24T08:08:03.245854+0000","last_clean":"2023-11-24T08:08:03.245854+0000","last_became_active":"2023-11-24T08:08:03.237596+0000","last_became_peered":"2023-11-24T08:08:03.237596+0000","last_unstale":"2023-11-24T08:08:03.245854+0000","last_undegraded":"2023-11-24T08:08:03.245854+0000","last_fullsized":"2023-11-24T08:08:03.245854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:42.240633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.242672+0000","last_change":"2023-11-24T08:08:03.238180+0000","last_active":"2023-11-24T08:08:03.242672+0000","last_peered":"2023-11-24T08:08:03.242672+0000","last_clean":"2023-11-24T08:08:03.242672+0000","last_became_active":"2023-11-24T08:08:03.235378+0000","last_became_peered":"2023-11-24T08:08:03.235378+0000","last_unstale":"2023-11-24T08:08:03.242672+0000","last_undegraded":"2023-11-24T08:08:03.242672+0000","last_fullsized":"2023-11-24T08:08:03.242672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:46.688269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233000+0000","last_change":"2023-11-24T08:08:03.247899+0000","last_active":"2023-11-24T08:08:04.233000+0000","last_peered":"2023-11-24T08:08:04.233000+0000","last_clean":"2023-11-24T08:08:04.233000+0000","last_became_active":"2023-11-24T08:08:03.247533+0000","last_became_peered":"2023-11-24T08:08:03.247533+0000","last_unstale":"2023-11-24T08:08:04.233000+0000","last_undegraded":"2023-11-24T08:08:04.233000+0000","last_fullsized":"2023-11-24T08:08:04.233000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:38:48.847689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235697+0000","last_change":"2023-11-24T08:08:03.243405+0000","last_active":"2023-11-24T08:08:04.235697+0000","last_peered":"2023-11-24T08:08:04.235697+0000","last_clean":"2023-11-24T08:08:04.235697+0000","last_became_active":"2023-11-24T08:08:03.242945+0000","last_became_peered":"2023-11-24T08:08:03.242945+0000","last_unstale":"2023-11-24T08:08:04.235697+0000","last_undegraded":"2023-11-24T08:08:04.235697+0000","last_fullsized":"2023-11-24T08:08:04.235697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:49:06.480779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.234782+0000","last_change":"2023-11-24T08:08:03.238242+0000","last_active":"2023-11-24T08:08:04.234782+0000","last_peered":"2023-11-24T08:08:04.234782+0000","last_clean":"2023-11-24T08:08:04.234782+0000","last_became_active":"2023-11-24T08:08:03.236398+0000","last_became_peered":"2023-11-24T08:08:03.236398+0000","last_unstale":"2023-11-24T08:08:04.234782+0000","last_undegraded":"2023-11-24T08:08:04.234782+0000","last_fullsized":"2023-11-24T08:08:04.234782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:39.107030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.239422+0000","last_change":"2023-11-24T08:08:03.237446+0000","last_active":"2023-11-24T08:08:03.239422+0000","last_peered":"2023-11-24T08:08:03.239422+0000","last_clean":"2023-11-24T08:08:03.239422+0000","last_became_active":"2023-11-24T08:08:03.236587+0000","last_became_peered":"2023-11-24T08:08:03.236587+0000","last_unstale":"2023-11-24T08:08:03.239422+0000","last_undegraded":"2023-11-24T08:08:03.239422+0000","last_fullsized":"2023-11-24T08:08:03.239422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:00.239835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.240183+0000","last_change":"2023-11-24T08:08:03.235834+0000","last_active":"2023-11-24T08:08:03.240183+0000","last_peered":"2023-11-24T08:08:03.240183+0000","last_clean":"2023-11-24T08:08:03.240183+0000","last_became_active":"2023-11-24T08:08:03.235440+0000","last_became_peered":"2023-11-24T08:08:03.235440+0000","last_unstale":"2023-11-24T08:08:03.240183+0000","last_undegraded":"2023-11-24T08:08:03.240183+0000","last_fullsized":"2023-11-24T08:08:03.240183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:59:00.239835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236061+0000","last_change":"2023-11-24T08:08:03.250354+0000","last_active":"2023-11-24T08:08:04.236061+0000","last_peered":"2023-11-24T08:08:04.236061+0000","last_clean":"2023-11-24T08:08:04.236061+0000","last_became_active":"2023-11-24T08:08:03.250035+0000","last_became_peered":"2023-11-24T08:08:03.250035+0000","last_unstale":"2023-11-24T08:08:04.236061+0000","last_undegraded":"2023-11-24T08:08:04.236061+0000","last_fullsized":"2023-11-24T08:08:04.236061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:49.616235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.256600+0000","last_change":"2023-11-24T08:08:03.250720+0000","last_active":"2023-11-24T08:08:03.256600+0000","last_peered":"2023-11-24T08:08:03.256600+0000","last_clean":"2023-11-24T08:08:03.256600+0000","last_became_active":"2023-11-24T08:08:03.250505+0000","last_became_peered":"2023-11-24T08:08:03.250505+0000","last_unstale":"2023-11-24T08:08:03.256600+0000","last_undegraded":"2023-11-24T08:08:03.256600+0000","last_fullsized":"2023-11-24T08:08:03.256600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:27.035648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.235216+0000","last_change":"2023-11-24T08:08:03.227139+0000","last_active":"2023-11-24T08:08:03.235216+0000","last_peered":"2023-11-24T08:08:03.235216+0000","last_clean":"2023-11-24T08:08:03.235216+0000","last_became_active":"2023-11-24T08:08:03.226826+0000","last_became_peered":"2023-11-24T08:08:03.226826+0000","last_unstale":"2023-11-24T08:08:03.235216+0000","last_undegraded":"2023-11-24T08:08:03.235216+0000","last_fullsized":"2023-11-24T08:08:03.235216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:10.776738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233152+0000","last_change":"2023-11-24T08:08:03.225323+0000","last_active":"2023-11-24T08:08:04.233152+0000","last_peered":"2023-11-24T08:08:04.233152+0000","last_clean":"2023-11-24T08:08:04.233152+0000","last_became_active":"2023-11-24T08:08:03.225040+0000","last_became_peered":"2023-11-24T08:08:03.225040+0000","last_unstale":"2023-11-24T08:08:04.233152+0000","last_undegraded":"2023-11-24T08:08:04.233152+0000","last_fullsized":"2023-11-24T08:08:04.233152+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:03:37.572125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252175+0000","last_change":"2023-11-24T08:08:03.246679+0000","last_active":"2023-11-24T08:08:03.252175+0000","last_peered":"2023-11-24T08:08:03.252175+0000","last_clean":"2023-11-24T08:08:03.252175+0000","last_became_active":"2023-11-24T08:08:03.246401+0000","last_became_peered":"2023-11-24T08:08:03.246401+0000","last_unstale":"2023-11-24T08:08:03.252175+0000","last_undegraded":"2023-11-24T08:08:03.252175+0000","last_fullsized":"2023-11-24T08:08:03.252175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:36.795576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235606+0000","last_change":"2023-11-24T08:08:03.247565+0000","last_active":"2023-11-24T08:08:04.235606+0000","last_peered":"2023-11-24T08:08:04.235606+0000","last_clean":"2023-11-24T08:08:04.235606+0000","last_became_active":"2023-11-24T08:08:03.247176+0000","last_became_peered":"2023-11-24T08:08:03.247176+0000","last_unstale":"2023-11-24T08:08:04.235606+0000","last_undegraded":"2023-11-24T08:08:04.235606+0000","last_fullsized":"2023-11-24T08:08:04.235606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:03:39.642408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.237050+0000","last_change":"2023-11-24T08:08:03.238027+0000","last_active":"2023-11-24T08:08:04.237050+0000","last_peered":"2023-11-24T08:08:04.237050+0000","last_clean":"2023-11-24T08:08:04.237050+0000","last_became_active":"2023-11-24T08:08:03.237777+0000","last_became_peered":"2023-11-24T08:08:03.237777+0000","last_unstale":"2023-11-24T08:08:04.237050+0000","last_undegraded":"2023-11-24T08:08:04.237050+0000","last_fullsized":"2023-11-24T08:08:04.237050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:43.968737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233530+0000","last_change":"2023-11-24T08:08:03.230220+0000","last_active":"2023-11-24T08:08:04.233530+0000","last_peered":"2023-11-24T08:08:04.233530+0000","last_clean":"2023-11-24T08:08:04.233530+0000","last_became_active":"2023-11-24T08:08:03.229628+0000","last_became_peered":"2023-11-24T08:08:03.229628+0000","last_unstale":"2023-11-24T08:08:04.233530+0000","last_undegraded":"2023-11-24T08:08:04.233530+0000","last_fullsized":"2023-11-24T08:08:04.233530+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:08.880666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233205+0000","last_change":"2023-11-24T08:08:03.228853+0000","last_active":"2023-11-24T08:08:04.233205+0000","last_peered":"2023-11-24T08:08:04.233205+0000","last_clean":"2023-11-24T08:08:04.233205+0000","last_became_active":"2023-11-24T08:08:03.228548+0000","last_became_peered":"2023-11-24T08:08:03.228548+0000","last_unstale":"2023-11-24T08:08:04.233205+0000","last_undegraded":"2023-11-24T08:08:04.233205+0000","last_fullsized":"2023-11-24T08:08:04.233205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:37.172485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.242716+0000","last_change":"2023-11-24T08:08:03.239332+0000","last_active":"2023-11-24T08:08:03.242716+0000","last_peered":"2023-11-24T08:08:03.242716+0000","last_clean":"2023-11-24T08:08:03.242716+0000","last_became_active":"2023-11-24T08:08:03.238967+0000","last_became_peered":"2023-11-24T08:08:03.238967+0000","last_unstale":"2023-11-24T08:08:03.242716+0000","last_undegraded":"2023-11-24T08:08:03.242716+0000","last_fullsized":"2023-11-24T08:08:03.242716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:12.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.236957+0000","last_change":"2023-11-24T08:08:03.227221+0000","last_active":"2023-11-24T08:08:03.236957+0000","last_peered":"2023-11-24T08:08:03.236957+0000","last_clean":"2023-11-24T08:08:03.236957+0000","last_became_active":"2023-11-24T08:08:03.226308+0000","last_became_peered":"2023-11-24T08:08:03.226308+0000","last_unstale":"2023-11-24T08:08:03.236957+0000","last_undegraded":"2023-11-24T08:08:03.236957+0000","last_fullsized":"2023-11-24T08:08:03.236957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:11.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237262+0000","last_change":"2023-11-24T08:08:03.229909+0000","last_active":"2023-11-24T08:08:03.237262+0000","last_peered":"2023-11-24T08:08:03.237262+0000","last_clean":"2023-11-24T08:08:03.237262+0000","last_became_active":"2023-11-24T08:08:03.229542+0000","last_became_peered":"2023-11-24T08:08:03.229542+0000","last_unstale":"2023-11-24T08:08:03.237262+0000","last_undegraded":"2023-11-24T08:08:03.237262+0000","last_fullsized":"2023-11-24T08:08:03.237262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:07:04.087760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.407876+0000","last_change":"2023-11-24T08:08:03.246121+0000","last_active":"2023-11-24T08:08:04.407876+0000","last_peered":"2023-11-24T08:08:04.407876+0000","last_clean":"2023-11-24T08:08:04.407876+0000","last_became_active":"2023-11-24T08:08:03.239501+0000","last_became_peered":"2023-11-24T08:08:03.239501+0000","last_unstale":"2023-11-24T08:08:04.407876+0000","last_undegraded":"2023-11-24T08:08:04.407876+0000","last_fullsized":"2023-11-24T08:08:04.407876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:36.507635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245633+0000","last_change":"2023-11-24T08:08:03.237207+0000","last_active":"2023-11-24T08:08:03.245633+0000","last_peered":"2023-11-24T08:08:03.245633+0000","last_clean":"2023-11-24T08:08:03.245633+0000","last_became_active":"2023-11-24T08:08:03.235004+0000","last_became_peered":"2023-11-24T08:08:03.235004+0000","last_unstale":"2023-11-24T08:08:03.245633+0000","last_undegraded":"2023-11-24T08:08:03.245633+0000","last_fullsized":"2023-11-24T08:08:03.245633+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:22.417665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.242467+0000","last_change":"2023-11-24T08:08:03.237471+0000","last_active":"2023-11-24T08:08:03.242467+0000","last_peered":"2023-11-24T08:08:03.242467+0000","last_clean":"2023-11-24T08:08:03.242467+0000","last_became_active":"2023-11-24T08:08:03.237224+0000","last_became_peered":"2023-11-24T08:08:03.237224+0000","last_unstale":"2023-11-24T08:08:03.242467+0000","last_undegraded":"2023-11-24T08:08:03.242467+0000","last_fullsized":"2023-11-24T08:08:03.242467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:16.065589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233680+0000","last_change":"2023-11-24T08:08:03.247432+0000","last_active":"2023-11-24T08:08:04.233680+0000","last_peered":"2023-11-24T08:08:04.233680+0000","last_clean":"2023-11-24T08:08:04.233680+0000","last_became_active":"2023-11-24T08:08:03.243447+0000","last_became_peered":"2023-11-24T08:08:03.243447+0000","last_unstale":"2023-11-24T08:08:04.233680+0000","last_undegraded":"2023-11-24T08:08:04.233680+0000","last_fullsized":"2023-11-24T08:08:04.233680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:47.806698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252360+0000","last_change":"2023-11-24T08:08:03.246749+0000","last_active":"2023-11-24T08:08:03.252360+0000","last_peered":"2023-11-24T08:08:03.252360+0000","last_clean":"2023-11-24T08:08:03.252360+0000","last_became_active":"2023-11-24T08:08:03.243612+0000","last_became_peered":"2023-11-24T08:08:03.243612+0000","last_unstale":"2023-11-24T08:08:03.252360+0000","last_undegraded":"2023-11-24T08:08:03.252360+0000","last_fullsized":"2023-11-24T08:08:03.252360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:30.726997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.250202+0000","last_change":"2023-11-24T08:08:03.243232+0000","last_active":"2023-11-24T08:08:03.250202+0000","last_peered":"2023-11-24T08:08:03.250202+0000","last_clean":"2023-11-24T08:08:03.250202+0000","last_became_active":"2023-11-24T08:08:03.242882+0000","last_became_peered":"2023-11-24T08:08:03.242882+0000","last_unstale":"2023-11-24T08:08:03.250202+0000","last_undegraded":"2023-11-24T08:08:03.250202+0000","last_fullsized":"2023-11-24T08:08:03.250202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:22.013930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237230+0000","last_change":"2023-11-24T08:08:03.229321+0000","last_active":"2023-11-24T08:08:03.237230+0000","last_peered":"2023-11-24T08:08:03.237230+0000","last_clean":"2023-11-24T08:08:03.237230+0000","last_became_active":"2023-11-24T08:08:03.229016+0000","last_became_peered":"2023-11-24T08:08:03.229016+0000","last_unstale":"2023-11-24T08:08:03.237230+0000","last_undegraded":"2023-11-24T08:08:03.237230+0000","last_fullsized":"2023-11-24T08:08:03.237230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:57.298705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236570+0000","last_change":"2023-11-24T08:08:03.246515+0000","last_active":"2023-11-24T08:08:04.236570+0000","last_peered":"2023-11-24T08:08:04.236570+0000","last_clean":"2023-11-24T08:08:04.236570+0000","last_became_active":"2023-11-24T08:08:03.246183+0000","last_became_peered":"2023-11-24T08:08:03.246183+0000","last_unstale":"2023-11-24T08:08:04.236570+0000","last_undegraded":"2023-11-24T08:08:04.236570+0000","last_fullsized":"2023-11-24T08:08:04.236570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:37.172485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245254+0000","last_change":"2023-11-24T08:08:03.240414+0000","last_active":"2023-11-24T08:08:03.245254+0000","last_peered":"2023-11-24T08:08:03.245254+0000","last_clean":"2023-11-24T08:08:03.245254+0000","last_became_active":"2023-11-24T08:08:03.240121+0000","last_became_peered":"2023-11-24T08:08:03.240121+0000","last_unstale":"2023-11-24T08:08:03.245254+0000","last_undegraded":"2023-11-24T08:08:03.245254+0000","last_fullsized":"2023-11-24T08:08:03.245254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:42.240633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235035+0000","last_change":"2023-11-24T08:08:03.234219+0000","last_active":"2023-11-24T08:08:04.235035+0000","last_peered":"2023-11-24T08:08:04.235035+0000","last_clean":"2023-11-24T08:08:04.235035+0000","last_became_active":"2023-11-24T08:08:03.233451+0000","last_became_peered":"2023-11-24T08:08:03.233451+0000","last_unstale":"2023-11-24T08:08:04.235035+0000","last_undegraded":"2023-11-24T08:08:04.235035+0000","last_fullsized":"2023-11-24T08:08:04.235035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:56.408270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408881+0000","last_change":"2023-11-24T08:08:03.234271+0000","last_active":"2023-11-24T08:08:04.408881+0000","last_peered":"2023-11-24T08:08:04.408881+0000","last_clean":"2023-11-24T08:08:04.408881+0000","last_became_active":"2023-11-24T08:08:03.233965+0000","last_became_peered":"2023-11-24T08:08:03.233965+0000","last_unstale":"2023-11-24T08:08:04.408881+0000","last_undegraded":"2023-11-24T08:08:04.408881+0000","last_fullsized":"2023-11-24T08:08:04.408881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:10.245062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252838+0000","last_change":"2023-11-24T08:08:02.226066+0000","last_active":"2023-11-24T08:08:03.252838+0000","last_peered":"2023-11-24T08:08:03.252838+0000","last_clean":"2023-11-24T08:08:03.252838+0000","last_became_active":"2023-11-24T08:08:02.225549+0000","last_became_peered":"2023-11-24T08:08:02.225549+0000","last_unstale":"2023-11-24T08:08:03.252838+0000","last_undegraded":"2023-11-24T08:08:03.252838+0000","last_fullsized":"2023-11-24T08:08:03.252838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:25:01.334376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245709+0000","last_change":"2023-11-24T08:08:03.241990+0000","last_active":"2023-11-24T08:08:03.245709+0000","last_peered":"2023-11-24T08:08:03.245709+0000","last_clean":"2023-11-24T08:08:03.245709+0000","last_became_active":"2023-11-24T08:08:03.241688+0000","last_became_peered":"2023-11-24T08:08:03.241688+0000","last_unstale":"2023-11-24T08:08:03.245709+0000","last_undegraded":"2023-11-24T08:08:03.245709+0000","last_fullsized":"2023-11-24T08:08:03.245709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:27.322348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408964+0000","last_change":"2023-11-24T08:08:02.219724+0000","last_active":"2023-11-24T08:08:04.408964+0000","last_peered":"2023-11-24T08:08:04.408964+0000","last_clean":"2023-11-24T08:08:04.408964+0000","last_became_active":"2023-11-24T08:08:02.219458+0000","last_became_peered":"2023-11-24T08:08:02.219458+0000","last_unstale":"2023-11-24T08:08:04.408964+0000","last_undegraded":"2023-11-24T08:08:04.408964+0000","last_fullsized":"2023-11-24T08:08:04.408964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:05.904638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237235+0000","last_change":"2023-11-24T08:08:03.230522+0000","last_active":"2023-11-24T08:08:03.237235+0000","last_peered":"2023-11-24T08:08:03.237235+0000","last_clean":"2023-11-24T08:08:03.237235+0000","last_became_active":"2023-11-24T08:08:03.229003+0000","last_became_peered":"2023-11-24T08:08:03.229003+0000","last_unstale":"2023-11-24T08:08:03.237235+0000","last_undegraded":"2023-11-24T08:08:03.237235+0000","last_fullsized":"2023-11-24T08:08:03.237235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:49.733887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233305+0000","last_change":"2023-11-24T08:08:02.206891+0000","last_active":"2023-11-24T08:08:04.233305+0000","last_peered":"2023-11-24T08:08:04.233305+0000","last_clean":"2023-11-24T08:08:04.233305+0000","last_became_active":"2023-11-24T08:08:02.206592+0000","last_became_peered":"2023-11-24T08:08:02.206592+0000","last_unstale":"2023-11-24T08:08:04.233305+0000","last_undegraded":"2023-11-24T08:08:04.233305+0000","last_fullsized":"2023-11-24T08:08:04.233305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:07:55.392995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252410+0000","last_change":"2023-11-24T08:08:03.247815+0000","last_active":"2023-11-24T08:08:03.252410+0000","last_peered":"2023-11-24T08:08:03.252410+0000","last_clean":"2023-11-24T08:08:03.252410+0000","last_became_active":"2023-11-24T08:08:03.242100+0000","last_became_peered":"2023-11-24T08:08:03.242100+0000","last_unstale":"2023-11-24T08:08:03.252410+0000","last_undegraded":"2023-11-24T08:08:03.252410+0000","last_fullsized":"2023-11-24T08:08:03.252410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:22.013930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.248511+0000","last_change":"2023-11-24T08:08:02.209494+0000","last_active":"2023-11-24T08:08:03.248511+0000","last_peered":"2023-11-24T08:08:03.248511+0000","last_clean":"2023-11-24T08:08:03.248511+0000","last_became_active":"2023-11-24T08:08:02.208684+0000","last_became_peered":"2023-11-24T08:08:02.208684+0000","last_unstale":"2023-11-24T08:08:03.248511+0000","last_undegraded":"2023-11-24T08:08:03.248511+0000","last_fullsized":"2023-11-24T08:08:03.248511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:07:03.072485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236385+0000","last_change":"2023-11-24T08:08:03.241171+0000","last_active":"2023-11-24T08:08:04.236385+0000","last_peered":"2023-11-24T08:08:04.236385+0000","last_clean":"2023-11-24T08:08:04.236385+0000","last_became_active":"2023-11-24T08:08:03.240849+0000","last_became_peered":"2023-11-24T08:08:03.240849+0000","last_unstale":"2023-11-24T08:08:04.236385+0000","last_undegraded":"2023-11-24T08:08:04.236385+0000","last_fullsized":"2023-11-24T08:08:04.236385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:38:48.847689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.240495+0000","last_change":"2023-11-24T08:08:02.220404+0000","last_active":"2023-11-24T08:08:03.240495+0000","last_peered":"2023-11-24T08:08:03.240495+0000","last_clean":"2023-11-24T08:08:03.240495+0000","last_became_active":"2023-11-24T08:08:02.220090+0000","last_became_peered":"2023-11-24T08:08:02.220090+0000","last_unstale":"2023-11-24T08:08:03.240495+0000","last_undegraded":"2023-11-24T08:08:03.240495+0000","last_fullsized":"2023-11-24T08:08:03.240495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:39.697414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.246028+0000","last_change":"2023-11-24T08:08:03.240673+0000","last_active":"2023-11-24T08:08:03.246028+0000","last_peered":"2023-11-24T08:08:03.246028+0000","last_clean":"2023-11-24T08:08:03.246028+0000","last_became_active":"2023-11-24T08:08:03.240068+0000","last_became_peered":"2023-11-24T08:08:03.240068+0000","last_unstale":"2023-11-24T08:08:03.246028+0000","last_undegraded":"2023-11-24T08:08:03.246028+0000","last_fullsized":"2023-11-24T08:08:03.246028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:41.901192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.241808+0000","last_change":"2023-11-24T08:08:02.219642+0000","last_active":"2023-11-24T08:08:03.241808+0000","last_peered":"2023-11-24T08:08:03.241808+0000","last_clean":"2023-11-24T08:08:03.241808+0000","last_became_active":"2023-11-24T08:08:02.219361+0000","last_became_peered":"2023-11-24T08:08:02.219361+0000","last_unstale":"2023-11-24T08:08:03.241808+0000","last_undegraded":"2023-11-24T08:08:03.241808+0000","last_fullsized":"2023-11-24T08:08:03.241808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:41.225358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.243852+0000","last_change":"2023-11-24T08:08:03.237895+0000","last_active":"2023-11-24T08:08:03.243852+0000","last_peered":"2023-11-24T08:08:03.243852+0000","last_clean":"2023-11-24T08:08:03.243852+0000","last_became_active":"2023-11-24T08:08:03.237612+0000","last_became_peered":"2023-11-24T08:08:03.237612+0000","last_unstale":"2023-11-24T08:08:03.243852+0000","last_undegraded":"2023-11-24T08:08:03.243852+0000","last_fullsized":"2023-11-24T08:08:03.243852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:12.250125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232565+0000","last_change":"2023-11-24T08:08:02.199608+0000","last_active":"2023-11-24T08:08:04.232565+0000","last_peered":"2023-11-24T08:08:04.232565+0000","last_clean":"2023-11-24T08:08:04.232565+0000","last_became_active":"2023-11-24T08:08:02.199346+0000","last_became_peered":"2023-11-24T08:08:02.199346+0000","last_unstale":"2023-11-24T08:08:04.232565+0000","last_undegraded":"2023-11-24T08:08:04.232565+0000","last_fullsized":"2023-11-24T08:08:04.232565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:20.998654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.253930+0000","last_change":"2023-11-24T08:08:03.253109+0000","last_active":"2023-11-24T08:08:03.253930+0000","last_peered":"2023-11-24T08:08:03.253930+0000","last_clean":"2023-11-24T08:08:03.253930+0000","last_became_active":"2023-11-24T08:08:03.252720+0000","last_became_peered":"2023-11-24T08:08:03.252720+0000","last_unstale":"2023-11-24T08:08:03.253930+0000","last_undegraded":"2023-11-24T08:08:03.253930+0000","last_fullsized":"2023-11-24T08:08:03.253930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:40.712689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216139+0000","last_change":"2023-11-24T08:08:02.216570+0000","last_active":"2023-11-24T08:08:03.216139+0000","last_peered":"2023-11-24T08:08:03.216139+0000","last_clean":"2023-11-24T08:08:03.216139+0000","last_became_active":"2023-11-24T08:08:02.216245+0000","last_became_peered":"2023-11-24T08:08:02.216245+0000","last_unstale":"2023-11-24T08:08:03.216139+0000","last_undegraded":"2023-11-24T08:08:03.216139+0000","last_fullsized":"2023-11-24T08:08:03.216139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:32.470903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.257135+0000","last_change":"2023-11-24T08:08:03.251797+0000","last_active":"2023-11-24T08:08:03.257135+0000","last_peered":"2023-11-24T08:08:03.257135+0000","last_clean":"2023-11-24T08:08:03.257135+0000","last_became_active":"2023-11-24T08:08:03.249289+0000","last_became_peered":"2023-11-24T08:08:03.249289+0000","last_unstale":"2023-11-24T08:08:03.257135+0000","last_undegraded":"2023-11-24T08:08:03.257135+0000","last_fullsized":"2023-11-24T08:08:03.257135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:51.459757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233863+0000","last_change":"2023-11-24T08:08:02.222192+0000","last_active":"2023-11-24T08:08:04.233863+0000","last_peered":"2023-11-24T08:08:04.233863+0000","last_clean":"2023-11-24T08:08:04.233863+0000","last_became_active":"2023-11-24T08:08:02.221918+0000","last_became_peered":"2023-11-24T08:08:02.221918+0000","last_unstale":"2023-11-24T08:08:04.233863+0000","last_undegraded":"2023-11-24T08:08:04.233863+0000","last_fullsized":"2023-11-24T08:08:04.233863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:03:38.627133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233958+0000","last_change":"2023-11-24T08:08:03.240060+0000","last_active":"2023-11-24T08:08:04.233958+0000","last_peered":"2023-11-24T08:08:04.233958+0000","last_clean":"2023-11-24T08:08:04.233958+0000","last_became_active":"2023-11-24T08:08:03.239780+0000","last_became_peered":"2023-11-24T08:08:03.239780+0000","last_unstale":"2023-11-24T08:08:04.233958+0000","last_undegraded":"2023-11-24T08:08:04.233958+0000","last_fullsized":"2023-11-24T08:08:04.233958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:31:48.943663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408966+0000","last_change":"2023-11-24T08:08:02.212825+0000","last_active":"2023-11-24T08:08:04.408966+0000","last_peered":"2023-11-24T08:08:04.408966+0000","last_clean":"2023-11-24T08:08:04.408966+0000","last_became_active":"2023-11-24T08:08:02.212539+0000","last_became_peered":"2023-11-24T08:08:02.212539+0000","last_unstale":"2023-11-24T08:08:04.408966+0000","last_undegraded":"2023-11-24T08:08:04.408966+0000","last_fullsized":"2023-11-24T08:08:04.408966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:41.857145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233351+0000","last_change":"2023-11-24T08:08:03.241268+0000","last_active":"2023-11-24T08:08:04.233351+0000","last_peered":"2023-11-24T08:08:04.233351+0000","last_clean":"2023-11-24T08:08:04.233351+0000","last_became_active":"2023-11-24T08:08:03.240427+0000","last_became_peered":"2023-11-24T08:08:03.240427+0000","last_unstale":"2023-11-24T08:08:04.233351+0000","last_undegraded":"2023-11-24T08:08:04.233351+0000","last_fullsized":"2023-11-24T08:08:04.233351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:43.968737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.254516+0000","last_change":"2023-11-24T08:08:02.222373+0000","last_active":"2023-11-24T08:08:03.254516+0000","last_peered":"2023-11-24T08:08:03.254516+0000","last_clean":"2023-11-24T08:08:03.254516+0000","last_became_active":"2023-11-24T08:08:02.222057+0000","last_became_peered":"2023-11-24T08:08:02.222057+0000","last_unstale":"2023-11-24T08:08:03.254516+0000","last_undegraded":"2023-11-24T08:08:03.254516+0000","last_fullsized":"2023-11-24T08:08:03.254516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:31.061155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252066+0000","last_change":"2023-11-24T08:08:03.248324+0000","last_active":"2023-11-24T08:08:03.252066+0000","last_peered":"2023-11-24T08:08:03.252066+0000","last_clean":"2023-11-24T08:08:03.252066+0000","last_became_active":"2023-11-24T08:08:03.247636+0000","last_became_peered":"2023-11-24T08:08:03.247636+0000","last_unstale":"2023-11-24T08:08:03.252066+0000","last_undegraded":"2023-11-24T08:08:03.252066+0000","last_fullsized":"2023-11-24T08:08:03.252066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:16.065589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.233260+0000","last_change":"2023-11-24T08:08:02.208834+0000","last_active":"2023-11-24T08:08:04.233260+0000","last_peered":"2023-11-24T08:08:04.233260+0000","last_clean":"2023-11-24T08:08:04.233260+0000","last_became_active":"2023-11-24T08:08:02.208403+0000","last_became_peered":"2023-11-24T08:08:02.208403+0000","last_unstale":"2023-11-24T08:08:04.233260+0000","last_undegraded":"2023-11-24T08:08:04.233260+0000","last_fullsized":"2023-11-24T08:08:04.233260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:29.711722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.256296+0000","last_change":"2023-11-24T08:08:03.253508+0000","last_active":"2023-11-24T08:08:03.256296+0000","last_peered":"2023-11-24T08:08:03.256296+0000","last_clean":"2023-11-24T08:08:03.256296+0000","last_became_active":"2023-11-24T08:08:03.253161+0000","last_became_peered":"2023-11-24T08:08:03.253161+0000","last_unstale":"2023-11-24T08:08:03.256296+0000","last_undegraded":"2023-11-24T08:08:03.256296+0000","last_fullsized":"2023-11-24T08:08:03.256296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:27.322348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.244530+0000","last_change":"2023-11-24T08:08:02.218240+0000","last_active":"2023-11-24T08:08:03.244530+0000","last_peered":"2023-11-24T08:08:03.244530+0000","last_clean":"2023-11-24T08:08:03.244530+0000","last_became_active":"2023-11-24T08:08:02.217973+0000","last_became_peered":"2023-11-24T08:08:02.217973+0000","last_unstale":"2023-11-24T08:08:03.244530+0000","last_undegraded":"2023-11-24T08:08:03.244530+0000","last_fullsized":"2023-11-24T08:08:03.244530+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:25:01.334376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232949+0000","last_change":"2023-11-24T08:08:03.225833+0000","last_active":"2023-11-24T08:08:04.232949+0000","last_peered":"2023-11-24T08:08:04.232949+0000","last_clean":"2023-11-24T08:08:04.232949+0000","last_became_active":"2023-11-24T08:08:03.225528+0000","last_became_peered":"2023-11-24T08:08:03.225528+0000","last_unstale":"2023-11-24T08:08:04.232949+0000","last_undegraded":"2023-11-24T08:08:04.232949+0000","last_fullsized":"2023-11-24T08:08:04.232949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:49.616235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216648+0000","last_change":"2023-11-24T08:08:02.217100+0000","last_active":"2023-11-24T08:08:03.216648+0000","last_peered":"2023-11-24T08:08:03.216648+0000","last_clean":"2023-11-24T08:08:03.216648+0000","last_became_active":"2023-11-24T08:08:02.216824+0000","last_became_peered":"2023-11-24T08:08:02.216824+0000","last_unstale":"2023-11-24T08:08:03.216648+0000","last_undegraded":"2023-11-24T08:08:03.216648+0000","last_fullsized":"2023-11-24T08:08:03.216648+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:25:01.334376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.235116+0000","last_change":"2023-11-24T08:08:03.241206+0000","last_active":"2023-11-24T08:08:04.235116+0000","last_peered":"2023-11-24T08:08:04.235116+0000","last_clean":"2023-11-24T08:08:04.235116+0000","last_became_active":"2023-11-24T08:08:03.240918+0000","last_became_peered":"2023-11-24T08:08:03.240918+0000","last_unstale":"2023-11-24T08:08:04.235116+0000","last_undegraded":"2023-11-24T08:08:04.235116+0000","last_fullsized":"2023-11-24T08:08:04.235116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:57:47.706132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232549+0000","last_change":"2023-11-24T08:08:02.218999+0000","last_active":"2023-11-24T08:08:04.232549+0000","last_peered":"2023-11-24T08:08:04.232549+0000","last_clean":"2023-11-24T08:08:04.232549+0000","last_became_active":"2023-11-24T08:08:02.218725+0000","last_became_peered":"2023-11-24T08:08:02.218725+0000","last_unstale":"2023-11-24T08:08:04.232549+0000","last_undegraded":"2023-11-24T08:08:04.232549+0000","last_fullsized":"2023-11-24T08:08:04.232549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:26.020373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245583+0000","last_change":"2023-11-24T08:08:03.241291+0000","last_active":"2023-11-24T08:08:03.245583+0000","last_peered":"2023-11-24T08:08:03.245583+0000","last_clean":"2023-11-24T08:08:03.245583+0000","last_became_active":"2023-11-24T08:08:03.240880+0000","last_became_peered":"2023-11-24T08:08:03.240880+0000","last_unstale":"2023-11-24T08:08:03.245583+0000","last_undegraded":"2023-11-24T08:08:03.245583+0000","last_fullsized":"2023-11-24T08:08:03.245583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:06.015618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232641+0000","last_change":"2023-11-24T08:08:02.208200+0000","last_active":"2023-11-24T08:08:04.232641+0000","last_peered":"2023-11-24T08:08:04.232641+0000","last_clean":"2023-11-24T08:08:04.232641+0000","last_became_active":"2023-11-24T08:08:02.207931+0000","last_became_peered":"2023-11-24T08:08:02.207931+0000","last_unstale":"2023-11-24T08:08:04.232641+0000","last_undegraded":"2023-11-24T08:08:04.232641+0000","last_fullsized":"2023-11-24T08:08:04.232641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:31.061155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252129+0000","last_change":"2023-11-24T08:08:03.248295+0000","last_active":"2023-11-24T08:08:03.252129+0000","last_peered":"2023-11-24T08:08:03.252129+0000","last_clean":"2023-11-24T08:08:03.252129+0000","last_became_active":"2023-11-24T08:08:03.247988+0000","last_became_peered":"2023-11-24T08:08:03.247988+0000","last_unstale":"2023-11-24T08:08:03.252129+0000","last_undegraded":"2023-11-24T08:08:03.252129+0000","last_fullsized":"2023-11-24T08:08:03.252129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:33.269003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.235485+0000","last_change":"2023-11-24T08:08:02.214284+0000","last_active":"2023-11-24T08:08:03.235485+0000","last_peered":"2023-11-24T08:08:03.235485+0000","last_clean":"2023-11-24T08:08:03.235485+0000","last_became_active":"2023-11-24T08:08:02.214032+0000","last_became_peered":"2023-11-24T08:08:02.214032+0000","last_unstale":"2023-11-24T08:08:03.235485+0000","last_undegraded":"2023-11-24T08:08:03.235485+0000","last_fullsized":"2023-11-24T08:08:03.235485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:26.020373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252107+0000","last_change":"2023-11-24T08:08:03.248074+0000","last_active":"2023-11-24T08:08:03.252107+0000","last_peered":"2023-11-24T08:08:03.252107+0000","last_clean":"2023-11-24T08:08:03.252107+0000","last_became_active":"2023-11-24T08:08:03.244889+0000","last_became_peered":"2023-11-24T08:08:03.244889+0000","last_unstale":"2023-11-24T08:08:03.252107+0000","last_undegraded":"2023-11-24T08:08:03.252107+0000","last_fullsized":"2023-11-24T08:08:03.252107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:32:13.712187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.238414+0000","last_change":"2023-11-24T08:08:02.218698+0000","last_active":"2023-11-24T08:08:03.238414+0000","last_peered":"2023-11-24T08:08:03.238414+0000","last_clean":"2023-11-24T08:08:03.238414+0000","last_became_active":"2023-11-24T08:08:02.218366+0000","last_became_peered":"2023-11-24T08:08:02.218366+0000","last_unstale":"2023-11-24T08:08:03.238414+0000","last_undegraded":"2023-11-24T08:08:03.238414+0000","last_fullsized":"2023-11-24T08:08:03.238414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:23.938177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245835+0000","last_change":"2023-11-24T08:08:03.229540+0000","last_active":"2023-11-24T08:08:03.245835+0000","last_peered":"2023-11-24T08:08:03.245835+0000","last_clean":"2023-11-24T08:08:03.245835+0000","last_became_active":"2023-11-24T08:08:03.229278+0000","last_became_peered":"2023-11-24T08:08:03.229278+0000","last_unstale":"2023-11-24T08:08:03.245835+0000","last_undegraded":"2023-11-24T08:08:03.245835+0000","last_fullsized":"2023-11-24T08:08:03.245835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:06.015618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.239037+0000","last_change":"2023-11-24T08:08:02.213927+0000","last_active":"2023-11-24T08:08:03.239037+0000","last_peered":"2023-11-24T08:08:03.239037+0000","last_clean":"2023-11-24T08:08:03.239037+0000","last_became_active":"2023-11-24T08:08:02.211653+0000","last_became_peered":"2023-11-24T08:08:02.211653+0000","last_unstale":"2023-11-24T08:08:03.239037+0000","last_undegraded":"2023-11-24T08:08:03.239037+0000","last_fullsized":"2023-11-24T08:08:03.239037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:26.307073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.239764+0000","last_change":"2023-11-24T08:08:03.236070+0000","last_active":"2023-11-24T08:08:03.239764+0000","last_peered":"2023-11-24T08:08:03.239764+0000","last_clean":"2023-11-24T08:08:03.239764+0000","last_became_active":"2023-11-24T08:08:03.235833+0000","last_became_peered":"2023-11-24T08:08:03.235833+0000","last_unstale":"2023-11-24T08:08:03.239764+0000","last_undegraded":"2023-11-24T08:08:03.239764+0000","last_fullsized":"2023-11-24T08:08:03.239764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:36:26.509496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.219676+0000","last_change":"2023-11-24T08:08:02.216108+0000","last_active":"2023-11-24T08:08:03.219676+0000","last_peered":"2023-11-24T08:08:03.219676+0000","last_clean":"2023-11-24T08:08:03.219676+0000","last_became_active":"2023-11-24T08:08:02.215794+0000","last_became_peered":"2023-11-24T08:08:02.215794+0000","last_unstale":"2023-11-24T08:08:03.219676+0000","last_undegraded":"2023-11-24T08:08:03.219676+0000","last_fullsized":"2023-11-24T08:08:03.219676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:21.402390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.236981+0000","last_change":"2023-11-24T08:08:03.232854+0000","last_active":"2023-11-24T08:08:03.236981+0000","last_peered":"2023-11-24T08:08:03.236981+0000","last_clean":"2023-11-24T08:08:03.236981+0000","last_became_active":"2023-11-24T08:08:03.232456+0000","last_became_peered":"2023-11-24T08:08:03.232456+0000","last_unstale":"2023-11-24T08:08:03.236981+0000","last_undegraded":"2023-11-24T08:08:03.236981+0000","last_fullsized":"2023-11-24T08:08:03.236981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:11.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408378+0000","last_change":"2023-11-24T08:08:02.213721+0000","last_active":"2023-11-24T08:08:04.408378+0000","last_peered":"2023-11-24T08:08:04.408378+0000","last_clean":"2023-11-24T08:08:04.408378+0000","last_became_active":"2023-11-24T08:08:02.212532+0000","last_became_peered":"2023-11-24T08:08:02.212532+0000","last_unstale":"2023-11-24T08:08:04.408378+0000","last_undegraded":"2023-11-24T08:08:04.408378+0000","last_fullsized":"2023-11-24T08:08:04.408378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:51.301966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.235193+0000","last_change":"2023-11-24T08:08:03.225899+0000","last_active":"2023-11-24T08:08:03.235193+0000","last_peered":"2023-11-24T08:08:03.235193+0000","last_clean":"2023-11-24T08:08:03.235193+0000","last_became_active":"2023-11-24T08:08:03.225620+0000","last_became_peered":"2023-11-24T08:08:03.225620+0000","last_unstale":"2023-11-24T08:08:03.235193+0000","last_undegraded":"2023-11-24T08:08:03.235193+0000","last_fullsized":"2023-11-24T08:08:03.235193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:40:04.489091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.228669+0000","last_change":"2023-11-24T08:08:02.223682+0000","last_active":"2023-11-24T08:08:03.228669+0000","last_peered":"2023-11-24T08:08:03.228669+0000","last_clean":"2023-11-24T08:08:03.228669+0000","last_became_active":"2023-11-24T08:08:02.223390+0000","last_became_peered":"2023-11-24T08:08:02.223390+0000","last_unstale":"2023-11-24T08:08:03.228669+0000","last_undegraded":"2023-11-24T08:08:03.228669+0000","last_fullsized":"2023-11-24T08:08:03.228669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:09.925297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.234365+0000","last_change":"2023-11-24T08:08:03.225125+0000","last_active":"2023-11-24T08:08:03.234365+0000","last_peered":"2023-11-24T08:08:03.234365+0000","last_clean":"2023-11-24T08:08:03.234365+0000","last_became_active":"2023-11-24T08:08:03.223554+0000","last_became_peered":"2023-11-24T08:08:03.223554+0000","last_unstale":"2023-11-24T08:08:03.234365+0000","last_undegraded":"2023-11-24T08:08:03.234365+0000","last_fullsized":"2023-11-24T08:08:03.234365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:30:05.849655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216657+0000","last_change":"2023-11-24T08:08:02.210183+0000","last_active":"2023-11-24T08:08:03.216657+0000","last_peered":"2023-11-24T08:08:03.216657+0000","last_clean":"2023-11-24T08:08:03.216657+0000","last_became_active":"2023-11-24T08:08:02.209812+0000","last_became_peered":"2023-11-24T08:08:02.209812+0000","last_unstale":"2023-11-24T08:08:03.216657+0000","last_undegraded":"2023-11-24T08:08:03.216657+0000","last_fullsized":"2023-11-24T08:08:03.216657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:09.925297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.234844+0000","last_change":"2023-11-24T08:08:03.243221+0000","last_active":"2023-11-24T08:08:04.234844+0000","last_peered":"2023-11-24T08:08:04.234844+0000","last_clean":"2023-11-24T08:08:04.234844+0000","last_became_active":"2023-11-24T08:08:03.242535+0000","last_became_peered":"2023-11-24T08:08:03.242535+0000","last_unstale":"2023-11-24T08:08:04.234844+0000","last_undegraded":"2023-11-24T08:08:04.234844+0000","last_fullsized":"2023-11-24T08:08:04.234844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:57:55.131775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.228518+0000","last_change":"2023-11-24T08:08:02.220728+0000","last_active":"2023-11-24T08:08:03.228518+0000","last_peered":"2023-11-24T08:08:03.228518+0000","last_clean":"2023-11-24T08:08:03.228518+0000","last_became_active":"2023-11-24T08:08:02.220412+0000","last_became_peered":"2023-11-24T08:08:02.220412+0000","last_unstale":"2023-11-24T08:08:03.228518+0000","last_undegraded":"2023-11-24T08:08:03.228518+0000","last_fullsized":"2023-11-24T08:08:03.228518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:29.711722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.252175+0000","last_change":"2023-11-24T08:08:03.251167+0000","last_active":"2023-11-24T08:08:03.252175+0000","last_peered":"2023-11-24T08:08:03.252175+0000","last_clean":"2023-11-24T08:08:03.252175+0000","last_became_active":"2023-11-24T08:08:03.250844+0000","last_became_peered":"2023-11-24T08:08:03.250844+0000","last_unstale":"2023-11-24T08:08:03.252175+0000","last_undegraded":"2023-11-24T08:08:03.252175+0000","last_fullsized":"2023-11-24T08:08:03.252175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:33.269003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.247102+0000","last_change":"2023-11-24T08:08:02.220854+0000","last_active":"2023-11-24T08:08:03.247102+0000","last_peered":"2023-11-24T08:08:03.247102+0000","last_clean":"2023-11-24T08:08:03.247102+0000","last_became_active":"2023-11-24T08:08:02.220565+0000","last_became_peered":"2023-11-24T08:08:02.220565+0000","last_unstale":"2023-11-24T08:08:03.247102+0000","last_undegraded":"2023-11-24T08:08:03.247102+0000","last_fullsized":"2023-11-24T08:08:03.247102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:40.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.249082+0000","last_change":"2023-11-24T08:08:03.243022+0000","last_active":"2023-11-24T08:08:03.249082+0000","last_peered":"2023-11-24T08:08:03.249082+0000","last_clean":"2023-11-24T08:08:03.249082+0000","last_became_active":"2023-11-24T08:08:03.242720+0000","last_became_peered":"2023-11-24T08:08:03.242720+0000","last_unstale":"2023-11-24T08:08:03.249082+0000","last_undegraded":"2023-11-24T08:08:03.249082+0000","last_fullsized":"2023-11-24T08:08:03.249082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:55:40.211028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.409052+0000","last_change":"2023-11-24T08:08:02.211128+0000","last_active":"2023-11-24T08:08:04.409052+0000","last_peered":"2023-11-24T08:08:04.409052+0000","last_clean":"2023-11-24T08:08:04.409052+0000","last_became_active":"2023-11-24T08:08:02.210847+0000","last_became_peered":"2023-11-24T08:08:02.210847+0000","last_unstale":"2023-11-24T08:08:04.409052+0000","last_undegraded":"2023-11-24T08:08:04.409052+0000","last_fullsized":"2023-11-24T08:08:04.409052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:17:51.784778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408628+0000","last_change":"2023-11-24T08:08:03.227307+0000","last_active":"2023-11-24T08:08:04.408628+0000","last_peered":"2023-11-24T08:08:04.408628+0000","last_clean":"2023-11-24T08:08:04.408628+0000","last_became_active":"2023-11-24T08:08:03.226976+0000","last_became_peered":"2023-11-24T08:08:03.226976+0000","last_unstale":"2023-11-24T08:08:04.408628+0000","last_undegraded":"2023-11-24T08:08:04.408628+0000","last_fullsized":"2023-11-24T08:08:04.408628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:55:07.058115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.214571+0000","last_change":"2023-11-24T08:08:02.208652+0000","last_active":"2023-11-24T08:08:03.214571+0000","last_peered":"2023-11-24T08:08:03.214571+0000","last_clean":"2023-11-24T08:08:03.214571+0000","last_became_active":"2023-11-24T08:08:02.208420+0000","last_became_peered":"2023-11-24T08:08:02.208420+0000","last_unstale":"2023-11-24T08:08:03.214571+0000","last_undegraded":"2023-11-24T08:08:03.214571+0000","last_fullsized":"2023-11-24T08:08:03.214571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:23.938177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.245552+0000","last_change":"2023-11-24T08:08:03.240847+0000","last_active":"2023-11-24T08:08:03.245552+0000","last_peered":"2023-11-24T08:08:03.245552+0000","last_clean":"2023-11-24T08:08:03.245552+0000","last_became_active":"2023-11-24T08:08:03.240544+0000","last_became_peered":"2023-11-24T08:08:03.240544+0000","last_unstale":"2023-11-24T08:08:03.245552+0000","last_undegraded":"2023-11-24T08:08:03.245552+0000","last_fullsized":"2023-11-24T08:08:03.245552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:33.486178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408579+0000","last_change":"2023-11-24T08:08:02.220781+0000","last_active":"2023-11-24T08:08:04.408579+0000","last_peered":"2023-11-24T08:08:04.408579+0000","last_clean":"2023-11-24T08:08:04.408579+0000","last_became_active":"2023-11-24T08:08:02.220515+0000","last_became_peered":"2023-11-24T08:08:02.220515+0000","last_unstale":"2023-11-24T08:08:04.408579+0000","last_undegraded":"2023-11-24T08:08:04.408579+0000","last_fullsized":"2023-11-24T08:08:04.408579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:55:17.342587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.408209+0000","last_change":"2023-11-24T08:08:03.238629+0000","last_active":"2023-11-24T08:08:04.408209+0000","last_peered":"2023-11-24T08:08:04.408209+0000","last_clean":"2023-11-24T08:08:04.408209+0000","last_became_active":"2023-11-24T08:08:03.238167+0000","last_became_peered":"2023-11-24T08:08:03.238167+0000","last_unstale":"2023-11-24T08:08:04.408209+0000","last_undegraded":"2023-11-24T08:08:04.408209+0000","last_fullsized":"2023-11-24T08:08:04.408209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:01.468974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216716+0000","last_change":"2023-11-24T08:08:02.217563+0000","last_active":"2023-11-24T08:08:03.216716+0000","last_peered":"2023-11-24T08:08:03.216716+0000","last_clean":"2023-11-24T08:08:03.216716+0000","last_became_active":"2023-11-24T08:08:02.217317+0000","last_became_peered":"2023-11-24T08:08:02.217317+0000","last_unstale":"2023-11-24T08:08:03.216716+0000","last_undegraded":"2023-11-24T08:08:03.216716+0000","last_fullsized":"2023-11-24T08:08:03.216716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:21.402390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232531+0000","last_change":"2023-11-24T08:08:03.243150+0000","last_active":"2023-11-24T08:08:04.232531+0000","last_peered":"2023-11-24T08:08:04.232531+0000","last_clean":"2023-11-24T08:08:04.232531+0000","last_became_active":"2023-11-24T08:08:03.231067+0000","last_became_peered":"2023-11-24T08:08:03.231067+0000","last_unstale":"2023-11-24T08:08:04.232531+0000","last_undegraded":"2023-11-24T08:08:04.232531+0000","last_fullsized":"2023-11-24T08:08:04.232531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:49:06.480779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.216991+0000","last_change":"2023-11-24T08:08:02.220865+0000","last_active":"2023-11-24T08:08:03.216991+0000","last_peered":"2023-11-24T08:08:03.216991+0000","last_clean":"2023-11-24T08:08:03.216991+0000","last_became_active":"2023-11-24T08:08:02.220520+0000","last_became_peered":"2023-11-24T08:08:02.220520+0000","last_unstale":"2023-11-24T08:08:03.216991+0000","last_undegraded":"2023-11-24T08:08:03.216991+0000","last_fullsized":"2023-11-24T08:08:03.216991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:05.000343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.237881+0000","last_change":"2023-11-24T08:08:03.233842+0000","last_active":"2023-11-24T08:08:03.237881+0000","last_peered":"2023-11-24T08:08:03.237881+0000","last_clean":"2023-11-24T08:08:03.237881+0000","last_became_active":"2023-11-24T08:08:03.233505+0000","last_became_peered":"2023-11-24T08:08:03.233505+0000","last_unstale":"2023-11-24T08:08:03.237881+0000","last_undegraded":"2023-11-24T08:08:03.237881+0000","last_fullsized":"2023-11-24T08:08:03.237881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:46.688269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.232754+0000","last_change":"2023-11-24T08:08:02.219788+0000","last_active":"2023-11-24T08:08:04.232754+0000","last_peered":"2023-11-24T08:08:04.232754+0000","last_clean":"2023-11-24T08:08:04.232754+0000","last_became_active":"2023-11-24T08:08:02.219552+0000","last_became_peered":"2023-11-24T08:08:02.219552+0000","last_unstale":"2023-11-24T08:08:04.232754+0000","last_undegraded":"2023-11-24T08:08:04.232754+0000","last_fullsized":"2023-11-24T08:08:04.232754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:57:54.116500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:08:04.236472+0000","last_change":"2023-11-24T08:08:03.236394+0000","last_active":"2023-11-24T08:08:04.236472+0000","last_peered":"2023-11-24T08:08:04.236472+0000","last_clean":"2023-11-24T08:08:04.236472+0000","last_became_active":"2023-11-24T08:08:03.236099+0000","last_became_peered":"2023-11-24T08:08:03.236099+0000","last_unstale":"2023-11-24T08:08:04.236472+0000","last_undegraded":"2023-11-24T08:08:04.236472+0000","last_fullsized":"2023-11-24T08:08:04.236472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:02.177637+0000","last_clean_scrub_stamp":"2023-11-24T08:08:02.177637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:03:37.572125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.230169+0000","last_change":"2023-11-24T08:08:02.224821+0000","last_active":"2023-11-24T08:08:03.230169+0000","last_peered":"2023-11-24T08:08:03.230169+0000","last_clean":"2023-11-24T08:08:03.230169+0000","last_became_active":"2023-11-24T08:08:02.224068+0000","last_became_peered":"2023-11-24T08:08:02.224068+0000","last_unstale":"2023-11-24T08:08:03.230169+0000","last_undegraded":"2023-11-24T08:08:03.230169+0000","last_fullsized":"2023-11-24T08:08:03.230169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:08:01.162361+0000","last_clean_scrub_stamp":"2023-11-24T08:08:01.162361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:39.697414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:08:03.228311+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:08:03.228311+0000","last_peered":"2023-11-24T08:08:03.228311+0000","last_clean":"2023-11-24T08:08:03.228311+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:08:03.228311+0000","last_undegraded":"2023-11-24T08:08:03.228311+0000","last_fullsized":"2023-11-24T08:08:03.228311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":738708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.079}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.151}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.359},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.3280000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.26},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.4179999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4490000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.528},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":1.4830000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0620000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1240000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.216},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.1559999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.423}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.3640000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0579999999999998,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.5209999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.998},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.7110000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.855},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.369}]},{"osd":2,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":3.2069999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":2.6120000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":4.173},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.601}]},{"osd":4,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":3.5960000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":2.5190000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":3.4820000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":4.5709999999999997},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":4.3209999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.218}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.141}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.3700000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5099999999999998,"5min":3.5099999999999998,"15min":3.5099999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.496}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.5840000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.3979999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":149884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0009999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.876},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.0569999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.2589999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.214},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.363}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.419}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.496}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.536},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3149999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.92400000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.877}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":1.04},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":1.226}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":149884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.04},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.78300000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.222}]},{"osd":3,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.97799999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.413}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.3169999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4650000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.51},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.373}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":738618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.93999999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.119}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.5049999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.554}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.369},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.341}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.448},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.407},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1779999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:08.165 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:08:08.165 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:08:08.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.424+0000 7f3d88648640 1 Processor -- start 2023-11-24T08:08:08.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.425+0000 7f3d88648640 1 -- start start 2023-11-24T08:08:08.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.426+0000 7f3d88648640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d800d1f00 0x7f3d800cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.426+0000 7f3d88648640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800d0880 con 0x7f3d8015d320 2023-11-24T08:08:08.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.426+0000 7f3d88648640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800b61b0 con 0x7f3d8015d700 2023-11-24T08:08:08.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.426+0000 7f3d88648640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800b6490 con 0x7f3d800d1f00 2023-11-24T08:08:08.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.427+0000 7f3d863e4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3d8015d320 0x7f3d800d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45424/0 (socket says 172.21.15.97:45424) 2023-11-24T08:08:08.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.427+0000 7f3d863e4640 1 -- 172.21.15.97:0/2350183306 learned_addr learned my addr 172.21.15.97:0/2350183306 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:08.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.427+0000 7f3d85be3640 1 --2- 172.21.15.97:0/2350183306 >> v2:172.21.15.97:3300/0 conn(0x7f3d800d1f00 0x7f3d800cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.427+0000 7f3d85be3640 1 -- 172.21.15.97:0/2350183306 >> v1:172.21.15.183:6789/0 conn(0x7f3d8015d700 legacy=0x7f3d800d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:08.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.427+0000 7f3d85be3640 1 -- 172.21.15.97:0/2350183306 >> v1:172.21.15.97:6789/0 conn(0x7f3d8015d320 legacy=0x7f3d800d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.427+0000 7f3d85be3640 1 -- 172.21.15.97:0/2350183306 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800b6770 con 0x7f3d800d1f00 2023-11-24T08:08:08.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.428+0000 7f3d85be3640 1 --2- 172.21.15.97:0/2350183306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d800d1f00 0x7f3d800cfb90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097a0 tx=0x7f3d7402b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39812a19b80bc2e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:08.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d853e2640 1 -- 172.21.15.97:0/2350183306 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74030710 con 0x7f3d800d1f00 2023-11-24T08:08:08.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d853e2640 1 -- 172.21.15.97:0/2350183306 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7402e050 con 0x7f3d800d1f00 2023-11-24T08:08:08.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d853e2640 1 -- 172.21.15.97:0/2350183306 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74030a90 con 0x7f3d800d1f00 2023-11-24T08:08:08.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d88648640 1 -- 172.21.15.97:0/2350183306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d800d1f00 msgr2=0x7f3d800cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d88648640 1 --2- 172.21.15.97:0/2350183306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d800d1f00 0x7f3d800cfb90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097a0 tx=0x7f3d7402b680 comp rx=0 tx=0).stop 2023-11-24T08:08:08.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d88648640 1 -- 172.21.15.97:0/2350183306 shutdown_connections 2023-11-24T08:08:08.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d88648640 1 --2- 172.21.15.97:0/2350183306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d800d1f00 0x7f3d800cfb90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d88648640 1 -- 172.21.15.97:0/2350183306 >> 172.21.15.97:0/2350183306 conn(0x7f3d8009c580 msgr2=0x7f3d800d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:08.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.429+0000 7f3d88648640 1 -- 172.21.15.97:0/2350183306 shutdown_connections 2023-11-24T08:08:08.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.430+0000 7f3d88648640 1 -- 172.21.15.97:0/2350183306 wait complete. 2023-11-24T08:08:08.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.431+0000 7f3d88648640 1 Processor -- start 2023-11-24T08:08:08.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.431+0000 7f3d88648640 1 -- start start 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.432+0000 7f3d88648640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d800d1f00 0x7f3d801595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.432+0000 7f3d88648640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d8015d320 0x7f3d800ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.432+0000 7f3d88648640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d8015d700 0x7f3d800cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.432+0000 7f3d88648640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801f3300 con 0x7f3d8015d320 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.432+0000 7f3d88648640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800cac80 con 0x7f3d8015d700 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.432+0000 7f3d88648640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800caf60 con 0x7f3d800d1f00 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d8015d320 0x7f3d800ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d8015d320 0x7f3d800ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42228/0 (socket says 172.21.15.97:42228) 2023-11-24T08:08:08.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 -- 172.21.15.97:0/1366460431 learned_addr learned my addr 172.21.15.97:0/1366460431 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d86be5640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d8015d700 0x7f3d800cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 -- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d800d1f00 msgr2=0x7f3d801595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d863e4640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d800d1f00 0x7f3d801595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d800d1f00 0x7f3d801595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 -- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d8015d700 msgr2=0x7f3d800cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d8015d700 0x7f3d800cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 -- 172.21.15.97:0/1366460431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d74009400 con 0x7f3d8015d320 2023-11-24T08:08:08.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.433+0000 7f3d85be3640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d8015d320 0x7f3d800ca300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097a0 tx=0x7f3d740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:08.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.434+0000 7f3d72ffd640 1 -- 172.21.15.97:0/1366460431 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74032910 con 0x7f3d8015d320 2023-11-24T08:08:08.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.434+0000 7f3d72ffd640 1 -- 172.21.15.97:0/1366460431 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74032a70 con 0x7f3d8015d320 2023-11-24T08:08:08.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.434+0000 7f3d72ffd640 1 -- 172.21.15.97:0/1366460431 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74032e20 con 0x7f3d8015d320 2023-11-24T08:08:08.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.434+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d800cb240 con 0x7f3d8015d320 2023-11-24T08:08:08.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.434+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d800c8070 con 0x7f3d8015d320 2023-11-24T08:08:08.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.435+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d80067670 con 0x7f3d8015d320 2023-11-24T08:08:08.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.436+0000 7f3d72ffd640 1 -- 172.21.15.97:0/1366460431 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d74039040 con 0x7f3d8015d320 2023-11-24T08:08:08.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.437+0000 7f3d72ffd640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d6406ae70 0x7f3d6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.438+0000 7f3d72ffd640 1 -- 172.21.15.97:0/1366460431 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d740ab480 con 0x7f3d8015d320 2023-11-24T08:08:08.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.438+0000 7f3d863e4640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d6406ae70 0x7f3d6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.438+0000 7f3d863e4640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d6406ae70 0x7f3d6406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000f60 tx=0x7f3d7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:08.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.442+0000 7f3d72ffd640 1 -- 172.21.15.97:0/1366460431 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d74076490 con 0x7f3d8015d320 2023-11-24T08:08:08.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.701+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3d8006cd20 con 0x7f3d8015d320 2023-11-24T08:08:08.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.705+0000 7f3d72ffd640 1 -- 172.21.15.97:0/1366460431 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3d74079ab0 con 0x7f3d8015d320 2023-11-24T08:08:08.708 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-11-24T08:08:08.708 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBLWWBlRHFuKhAAF85SZrFh9cWe6ZO4yGMg/A== 2023-11-24T08:08:08.708 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow" 2023-11-24T08:08:08.708 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-11-24T08:08:08.708 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:08:08.709 INFO:teuthology.orchestra.run.smithi097.stderr:updated caps for client.0 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.708+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d6406ae70 msgr2=0x7f3d6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.708+0000 7f3d88648640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d6406ae70 0x7f3d6406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000f60 tx=0x7f3d7c009040 comp rx=0 tx=0).stop 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.708+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d8015d320 msgr2=0x7f3d800ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.708+0000 7f3d88648640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d8015d320 0x7f3d800ca300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097a0 tx=0x7f3d740046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 shutdown_connections 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3d6406ae70 0x7f3d6406d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d8015d700 0x7f3d800cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d8015d320 0x7f3d800ca300 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 --2- 172.21.15.97:0/1366460431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d800d1f00 0x7f3d801595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 >> 172.21.15.97:0/1366460431 conn(0x7f3d8009c580 msgr2=0x7f3d8006b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:08.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 shutdown_connections 2023-11-24T08:08:08.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.709+0000 7f3d88648640 1 -- 172.21.15.97:0/1366460431 wait complete. 2023-11-24T08:08:08.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:08.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.937+0000 7f87dcada640 1 Processor -- start 2023-11-24T08:08:08.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.937+0000 7f87dcada640 1 -- start start 2023-11-24T08:08:08.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.938+0000 7f87dcada640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f87d813e360 0x7f87d80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.938+0000 7f87dcada640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87d815f9c0 0x7f87d80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.938+0000 7f87dcada640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d815c5f0 con 0x7f87d813df80 2023-11-24T08:08:08.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.938+0000 7f87dcada640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d806c470 con 0x7f87d815f9c0 2023-11-24T08:08:08.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.938+0000 7f87dcada640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d806c750 con 0x7f87d813e360 2023-11-24T08:08:08.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.939+0000 7f87d6d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87d815f9c0 0x7f87d80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.939+0000 7f87d6d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87d815f9c0 0x7f87d80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42242/0 (socket says 172.21.15.97:42242) 2023-11-24T08:08:08.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.939+0000 7f87d6d9d640 1 -- 172.21.15.97:0/2138885883 learned_addr learned my addr 172.21.15.97:0/2138885883 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:08.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.939+0000 7f87d6d9d640 1 -- 172.21.15.97:0/2138885883 >> v2:172.21.15.183:3300/0 conn(0x7f87d813e360 msgr2=0x7f87d80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:08.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.939+0000 7f87d6d9d640 1 --2- 172.21.15.97:0/2138885883 >> v2:172.21.15.183:3300/0 conn(0x7f87d813e360 0x7f87d80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.939+0000 7f87d6d9d640 1 -- 172.21.15.97:0/2138885883 >> v1:172.21.15.183:6789/0 conn(0x7f87d813df80 legacy=0x7f87d815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:08.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.939+0000 7f87d6d9d640 1 -- 172.21.15.97:0/2138885883 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d806ca30 con 0x7f87d815f9c0 2023-11-24T08:08:08.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.940+0000 7f87d6d9d640 1 --2- 172.21.15.97:0/2138885883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d815f9c0 0x7f87d80cf7d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ccae0 tx=0x7f87d002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f937079932f607f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.940+0000 7f87d5d9b640 1 -- 172.21.15.97:0/2138885883 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d002ca60 con 0x7f87d815f9c0 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87d5d9b640 1 -- 172.21.15.97:0/2138885883 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d002cbc0 con 0x7f87d815f9c0 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87d5d9b640 1 -- 172.21.15.97:0/2138885883 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00343f0 con 0x7f87d815f9c0 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 -- 172.21.15.97:0/2138885883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d815f9c0 msgr2=0x7f87d80cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 --2- 172.21.15.97:0/2138885883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d815f9c0 0x7f87d80cf7d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ccae0 tx=0x7f87d002bec0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 -- 172.21.15.97:0/2138885883 shutdown_connections 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 --2- 172.21.15.97:0/2138885883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d815f9c0 0x7f87d80cf7d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 --2- 172.21.15.97:0/2138885883 >> v2:172.21.15.183:3300/0 conn(0x7f87d813e360 0x7f87d80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 -- 172.21.15.97:0/2138885883 >> 172.21.15.97:0/2138885883 conn(0x7f87d806a800 msgr2=0x7f87d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:08.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 -- 172.21.15.97:0/2138885883 shutdown_connections 2023-11-24T08:08:08.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.941+0000 7f87dcada640 1 -- 172.21.15.97:0/2138885883 wait complete. 2023-11-24T08:08:08.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.943+0000 7f87dcada640 1 Processor -- start 2023-11-24T08:08:08.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.943+0000 7f87dcada640 1 -- start start 2023-11-24T08:08:08.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87dcada640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d813df80 0x7f87d813ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87dcada640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87d813e360 0x7f87d814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87dcada640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87d815f9c0 0x7f87d80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87dcada640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8070770 con 0x7f87d813df80 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87dcada640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d814bee0 con 0x7f87d815f9c0 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87dcada640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d813d350 con 0x7f87d813e360 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87d659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d813df80 0x7f87d813ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87d659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d813df80 0x7f87d813ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42252/0 (socket says 172.21.15.97:42252) 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.944+0000 7f87d659c640 1 -- 172.21.15.97:0/3115922761 learned_addr learned my addr 172.21.15.97:0/3115922761 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d6d9d640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87d815f9c0 0x7f87d80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87cffff640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87d813e360 0x7f87d814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d659c640 1 -- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87d813e360 msgr2=0x7f87d814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d659c640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87d813e360 0x7f87d814a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d659c640 1 -- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87d815f9c0 msgr2=0x7f87d80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:08.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d659c640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87d815f9c0 0x7f87d80b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:08.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d659c640 1 -- 172.21.15.97:0/3115922761 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009b30 con 0x7f87d813df80 2023-11-24T08:08:08.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d6d9d640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87d815f9c0 0x7f87d80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:08.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87d659c640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d813df80 0x7f87d813ce10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b3f0 tx=0x7f87c800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:08.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87ceffd640 1 -- 172.21.15.97:0/3115922761 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8011830 con 0x7f87d813df80 2023-11-24T08:08:08.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87ceffd640 1 -- 172.21.15.97:0/3115922761 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8011990 con 0x7f87d813df80 2023-11-24T08:08:08.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.945+0000 7f87ceffd640 1 -- 172.21.15.97:0/3115922761 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8011d40 con 0x7f87d813df80 2023-11-24T08:08:08.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.946+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d814b640 con 0x7f87d813df80 2023-11-24T08:08:08.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.946+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d814bc00 con 0x7f87d813df80 2023-11-24T08:08:08.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.947+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d8070540 con 0x7f87d813df80 2023-11-24T08:08:08.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.948+0000 7f87ceffd640 1 -- 172.21.15.97:0/3115922761 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87c801a400 con 0x7f87d813df80 2023-11-24T08:08:08.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.948+0000 7f87ceffd640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f87b806ae40 0x7f87b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:08.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.949+0000 7f87ceffd640 1 -- 172.21.15.97:0/3115922761 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87c8089510 con 0x7f87d813df80 2023-11-24T08:08:08.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.949+0000 7f87cffff640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f87b806ae40 0x7f87b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:08.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.949+0000 7f87cffff640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f87b806ae40 0x7f87b806d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f87d815b2c0 tx=0x7f87c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:08.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:08.953+0000 7f87ceffd640 1 -- 172.21.15.97:0/3115922761 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87c8054520 con 0x7f87d813df80 2023-11-24T08:08:09.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.179+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87d806dad0 con 0x7f87d813df80 2023-11-24T08:08:09.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.180+0000 7f87ceffd640 1 -- 172.21.15.97:0/3115922761 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f87c8057b40 con 0x7f87d813df80 2023-11-24T08:08:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:09.183 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3619089631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3619089631},{"type":"v1","addr":"172.21.15.183:6834","nonce":3619089631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1237344944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1237344944},{"type":"v1","addr":"172.21.15.97:6837","nonce":1237344944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1425639784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1425639784},{"type":"v1","addr":"172.21.15.183:6835","nonce":1425639784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:08:02.652077+0000","modified":"2023-11-24T08:08:05.725467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5244":{"gid":5244,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.97:6835/4116734497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4116734497},{"type":"v1","addr":"172.21.15.97:6835","nonce":4116734497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:08:09.183 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 17 2023-11-24T08:08:09.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f87b806ae40 msgr2=0x7f87b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f87b806ae40 0x7f87b806d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f87d815b2c0 tx=0x7f87c0008040 comp rx=0 tx=0).stop 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d813df80 msgr2=0x7f87d813ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d813df80 0x7f87d813ce10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b3f0 tx=0x7f87c800b8b0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 shutdown_connections 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f87b806ae40 0x7f87b806d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87d815f9c0 0x7f87d80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87d813e360 0x7f87d814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 --2- 172.21.15.97:0/3115922761 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87d813df80 0x7f87d813ce10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 >> 172.21.15.97:0/3115922761 conn(0x7f87d806a800 msgr2=0x7f87d815dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:09.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 shutdown_connections 2023-11-24T08:08:09.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.183+0000 7f87dcada640 1 -- 172.21.15.97:0/3115922761 wait complete. 2023-11-24T08:08:09.607 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:08:02.652077+0000', 'modified': '2023-11-24T08:08:05.725467+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5244': {'gid': 5244, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.97:6835/4116734497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6834', 'nonce': 4116734497}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 4116734497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:08:09.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:08:09.608 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T08:08:09.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.833+0000 7f7c98341640 1 Processor -- start 2023-11-24T08:08:09.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.833+0000 7f7c98341640 1 -- start start 2023-11-24T08:08:09.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.834+0000 7f7c98341640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c9013df80 0x7f7c9015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c98341640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9006c470 con 0x7f7c9013e360 2023-11-24T08:08:09.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c98341640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9006c750 con 0x7f7c900cf9a0 2023-11-24T08:08:09.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c98341640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9006ca30 con 0x7f7c9013df80 2023-11-24T08:08:09.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c958dc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7c9013e360 0x7f7c900cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45426/0 (socket says 172.21.15.97:45426) 2023-11-24T08:08:09.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c958dc640 1 -- 172.21.15.97:0/4240206267 learned_addr learned my addr 172.21.15.97:0/4240206267 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549913182 0 0) 0x7f7c9006c470 con 0x7f7c9013e360 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7c003520 con 0x7f7c9013e360 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.835+0000 7f7c960dd640 1 --2- 172.21.15.97:0/4240206267 >> v2:172.21.15.183:3300/0 conn(0x7f7c9013df80 0x7f7c9015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 916669581 0 0) 0x7f7c7c003520 con 0x7f7c9013e360 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 >> v2:172.21.15.183:3300/0 conn(0x7f7c9013df80 msgr2=0x7f7c9015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 --2- 172.21.15.97:0/4240206267 >> v2:172.21.15.183:3300/0 conn(0x7f7c9013df80 0x7f7c9015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 >> v1:172.21.15.183:6789/0 conn(0x7f7c900cf9a0 legacy=0x7f7c900cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9006cd10 con 0x7f7c9013e360 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f7c80001670 con 0x7f7c9013e360 2023-11-24T08:08:09.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 >> v1:172.21.15.97:6789/0 conn(0x7f7c9013e360 legacy=0x7f7c900cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7c003970 0x7f7c7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9006ca30 con 0x7f7c7c005180 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c00c0d0 con 0x7f7c7c0047c0 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c00c290 con 0x7f7c7c003970 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.836+0000 7f7c968de640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c960dd640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7c003970 0x7f7c7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c958dc640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c968de640 1 -- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7c003970 msgr2=0x7f7c7c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c968de640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7c003970 0x7f7c7c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c968de640 1 -- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c0047c0 msgr2=0x7f7c7c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c968de640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c968de640 1 -- 172.21.15.97:0/4240206267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c003520 con 0x7f7c7c005180 2023-11-24T08:08:09.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.837+0000 7f7c960dd640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7c003970 0x7f7c7c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.838+0000 7f7c968de640 1 -- 172.21.15.97:0/4240206267 reap_dead start 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.838+0000 7f7c968de640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001e20 tx=0x7f7c7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9d4625365d3e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88003b70 con 0x7f7c7c005180 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88003cd0 con 0x7f7c7c005180 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c950db640 1 -- 172.21.15.97:0/4240206267 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88005310 con 0x7f7c7c005180 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c98341640 1 -- 172.21.15.97:0/4240206267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c7c005180 msgr2=0x7f7c7c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c98341640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001e20 tx=0x7f7c7c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c98341640 1 -- 172.21.15.97:0/4240206267 shutdown_connections 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c98341640 1 --2- 172.21.15.97:0/4240206267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c98341640 1 -- 172.21.15.97:0/4240206267 >> 172.21.15.97:0/4240206267 conn(0x7f7c9006a800 msgr2=0x7f7c9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:09.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c98341640 1 -- 172.21.15.97:0/4240206267 shutdown_connections 2023-11-24T08:08:09.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.839+0000 7f7c98341640 1 -- 172.21.15.97:0/4240206267 wait complete. 2023-11-24T08:08:09.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.841+0000 7f7c98341640 1 Processor -- start 2023-11-24T08:08:09.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.841+0000 7f7c98341640 1 -- start start 2023-11-24T08:08:09.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.842+0000 7f7c98341640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c005180 0x7f7c9013d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.842+0000 7f7c98341640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c900b2cf0 0x7f7c900b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.842+0000 7f7c98341640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c90151e30 0x7f7c901522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.842+0000 7f7c98341640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c90072130 con 0x7f7c900b2cf0 2023-11-24T08:08:09.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.842+0000 7f7c98341640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900b3690 con 0x7f7c7c005180 2023-11-24T08:08:09.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.842+0000 7f7c98341640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900714b0 con 0x7f7c90151e30 2023-11-24T08:08:09.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c900b2cf0 0x7f7c900b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c900b2cf0 0x7f7c900b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42260/0 (socket says 172.21.15.97:42260) 2023-11-24T08:08:09.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 -- 172.21.15.97:0/2291187203 learned_addr learned my addr 172.21.15.97:0/2291187203 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 -- 172.21.15.97:0/2291187203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c90151e30 msgr2=0x7f7c901522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c90151e30 0x7f7c901522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 -- 172.21.15.97:0/2291187203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c005180 msgr2=0x7f7c9013d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c005180 0x7f7c9013d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 -- 172.21.15.97:0/2291187203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90071790 con 0x7f7c900b2cf0 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.843+0000 7f7c958dc640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c900b2cf0 0x7f7c900b3150 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e780 tx=0x7f7c8000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.844+0000 7f7c86ffd640 1 -- 172.21.15.97:0/2291187203 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000ee90 con 0x7f7c900b2cf0 2023-11-24T08:08:09.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.844+0000 7f7c86ffd640 1 -- 172.21.15.97:0/2291187203 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8000c870 con 0x7f7c900b2cf0 2023-11-24T08:08:09.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.844+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c90071a70 con 0x7f7c900b2cf0 2023-11-24T08:08:09.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.844+0000 7f7c86ffd640 1 -- 172.21.15.97:0/2291187203 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000cc20 con 0x7f7c900b2cf0 2023-11-24T08:08:09.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.844+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c901527f0 con 0x7f7c900b2cf0 2023-11-24T08:08:09.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.847+0000 7f7c86ffd640 1 -- 172.21.15.97:0/2291187203 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c8001d460 con 0x7f7c900b2cf0 2023-11-24T08:08:09.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.848+0000 7f7c86ffd640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7c7406ae40 0x7f7c7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.848+0000 7f7c86ffd640 1 -- 172.21.15.97:0/2291187203 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c800895e0 con 0x7f7c900b2cf0 2023-11-24T08:08:09.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.848+0000 7f7c960dd640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7c7406ae40 0x7f7c7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.848+0000 7f7c9afb2740 1 Processor -- start 2023-11-24T08:08:09.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.848+0000 7f7c9afb2740 1 -- start start 2023-11-24T08:08:09.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.849+0000 7f7c960dd640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7c7406ae40 0x7f7c7406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c006f00 tx=0x7f7c8c006e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.849+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79cea0 0x55c49d79d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.849+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d79c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.849+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79c5e0 0x55c49d7e0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.849+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d6fb880 con 0x55c49d79c5e0 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.849+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d70aae0 con 0x55c49d797ba0 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.849+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d7081d0 con 0x55c49d79cea0 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79c5e0 0x55c49d7e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79c5e0 0x55c49d7e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42272/0 (socket says 172.21.15.97:42272) 2023-11-24T08:08:09.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 -- 172.21.15.97:0/2241798377 learned_addr learned my addr 172.21.15.97:0/2241798377 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c960dd640 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79cea0 0x55c49d79d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c958dc640 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d79c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 -- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79cea0 msgr2=0x55c49d79d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79cea0 0x55c49d79d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 -- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 msgr2=0x55c49d79c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d79c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 -- 172.21.15.97:0/2241798377 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c49d6cb860 con 0x55c49d79c5e0 2023-11-24T08:08:09.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.850+0000 7f7c968de640 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79c5e0 0x55c49d7e0560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7c8802c040 tx=0x7f7c8802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a09de51739f4a9a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:09.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c73fff640 1 -- 172.21.15.97:0/2241798377 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88003b70 con 0x55c49d79c5e0 2023-11-24T08:08:09.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c73fff640 1 -- 172.21.15.97:0/2241798377 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88006b50 con 0x55c49d79c5e0 2023-11-24T08:08:09.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c73fff640 1 -- 172.21.15.97:0/2241798377 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880050d0 con 0x55c49d79c5e0 2023-11-24T08:08:09.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2241798377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79c5e0 msgr2=0x55c49d7e0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79c5e0 0x55c49d7e0560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7c8802c040 tx=0x7f7c8802e000 comp rx=0 tx=0).stop 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2241798377 shutdown_connections 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79c5e0 0x55c49d7e0560 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d79c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2241798377 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79cea0 0x55c49d79d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2241798377 >> 172.21.15.97:0/2241798377 conn(0x55c49d75ec70 msgr2=0x55c49d7e2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.851+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2241798377 shutdown_connections 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.852+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2241798377 wait complete. 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.852+0000 7f7c9afb2740 1 -- start start 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.852+0000 7f7c9afb2740 1 Processor -- start 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.853+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d797ba0 0x55c49d7e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.853+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79cea0 0x55c49d7c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d703ac0 con 0x55c49d797ba0 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d6a02f0 con 0x55c49d79cea0 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d6bdc70 con 0x55c49d79c5e0 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c9afb2740 10 client.0 _ll_register_callbacks cb 0x55c49d6c23b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d797ba0 0x55c49d7e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d797ba0 0x55c49d7e70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42288/0 (socket says 172.21.15.97:42288) 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 -- 172.21.15.97:0/844679075 learned_addr learned my addr 172.21.15.97:0/844679075 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c958dc640 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 -- 172.21.15.97:0/844679075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 msgr2=0x55c49d7bbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 -- 172.21.15.97:0/844679075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79cea0 msgr2=0x55c49d7c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79cea0 0x55c49d7c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.854+0000 7f7c960dd640 1 -- 172.21.15.97:0/844679075 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c003520 con 0x55c49d797ba0 2023-11-24T08:08:09.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c960dd640 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d797ba0 0x55c49d7e70d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c006af0 tx=0x7f7c8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaa48f7ea93c7a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c717fa640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-11-24T08:08:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c717fa640 1 -- 172.21.15.97:0/844679075 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c015820 con 0x55c49d797ba0 2023-11-24T08:08:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c717fa640 1 -- 172.21.15.97:0/844679075 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c8c015980 con 0x55c49d797ba0 2023-11-24T08:08:09.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c49d6fcaa0 con 0x55c49d797ba0 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c717fa640 1 -- 172.21.15.97:0/844679075 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c8c015b40 con 0x55c49d797ba0 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c9afb2740 10 client.5424 fetch_fsmap learned FSMap version 17 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c49d702140 con 0x55c49d797ba0 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c717fa640 1 -- 172.21.15.97:0/844679075 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c49d6fcaa0 con 0x55c49d797ba0 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c717fa640 1 -- 172.21.15.97:0/844679075 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7c8c015ca0 con 0x55c49d797ba0 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.855+0000 7f7c9afb2740 10 client.5424 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c9afb2740 10 client.5424 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c9afb2740 20 client.5424 populate_metadata read hostname 'smithi097' 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d7ea310 0x55c49d7ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c9afb2740 4 client.5424 mds_command: new command op to 5244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 --> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c49d6fc7c0 con 0x55c49d7ea310 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c958dc640 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d7ea310 0x55c49d7ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c958dc640 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d7ea310 0x55c49d7ffd40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b956f77693c7f70e server_cookie=6a3bac013e45f080 in_seq=0 out_seq=0 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.856+0000 7f7c717fa640 10 client.5424 ms_handle_connect on v2:172.21.15.97:6834/4116734497 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c717fa640 1 -- 172.21.15.97:0/844679075 <== mds.0 v2:172.21.15.97:6834/4116734497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c49d6fc7c0 con 0x55c49d7ea310 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c717fa640 10 client.5424 handle_command_reply: tid=0 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 client.5424 shutdown 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d797ba0 msgr2=0x55c49d7e70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d797ba0 0x55c49d7e70d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c006af0 tx=0x7f7c8c008040 comp rx=0 tx=0).stop 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 shutdown_connections 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79cea0 0x55c49d7c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d7ea310 0x55c49d7ffd40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7bbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/844679075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d797ba0 0x55c49d7e70d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c717fa640 0 client.5424 ms_handle_reset on v2:172.21.15.97:6834/4116734497 2023-11-24T08:08:09.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.857+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 >> 172.21.15.97:0/844679075 conn(0x55c49d75ec70 msgr2=0x55c49d79d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:09.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.858+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 shutdown_connections 2023-11-24T08:08:09.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.858+0000 7f7c9afb2740 1 -- 172.21.15.97:0/844679075 wait complete. 2023-11-24T08:08:09.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.858+0000 7f7c9afb2740 20 client.5424 trim_cache size 0 max 16384 2023-11-24T08:08:09.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.875+0000 7f7c9afb2740 1 Processor -- start 2023-11-24T08:08:09.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.875+0000 7f7c9afb2740 1 -- start start 2023-11-24T08:08:09.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d797ba0 0x55c49d797130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79c5e0 0x55c49d7c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d7c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d466f20 con 0x55c49d79cea0 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d70c2f0 con 0x55c49d79c5e0 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d7f2400 con 0x55c49d797ba0 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d7c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d7c05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42304/0 (socket says 172.21.15.97:42304) 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 -- 172.21.15.97:0/2899020616 learned_addr learned my addr 172.21.15.97:0/2899020616 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 -- 172.21.15.97:0/2899020616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d797ba0 msgr2=0x55c49d797130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c958dc640 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79c5e0 0x55c49d7c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d797ba0 0x55c49d797130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 -- 172.21.15.97:0/2899020616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79c5e0 msgr2=0x55c49d7c00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79c5e0 0x55c49d7c00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.876+0000 7f7c968de640 1 -- 172.21.15.97:0/2899020616 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c49d7e87c0 con 0x55c49d79cea0 2023-11-24T08:08:09.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.877+0000 7f7c968de640 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d7c05f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001e20 tx=0x7f7c88031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2733ebdfe6b67a43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:09.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.877+0000 7f7c84dff640 1 -- 172.21.15.97:0/2899020616 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88003b70 con 0x55c49d79cea0 2023-11-24T08:08:09.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.877+0000 7f7c84dff640 1 -- 172.21.15.97:0/2899020616 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88049070 con 0x55c49d79cea0 2023-11-24T08:08:09.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.877+0000 7f7c84dff640 1 -- 172.21.15.97:0/2899020616 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88005310 con 0x55c49d79cea0 2023-11-24T08:08:09.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2899020616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 msgr2=0x55c49d7c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d7c05f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001e20 tx=0x7f7c88031000 comp rx=0 tx=0).stop 2023-11-24T08:08:09.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2899020616 shutdown_connections 2023-11-24T08:08:09.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d7c05f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d79c5e0 0x55c49d7c00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/2899020616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d797ba0 0x55c49d797130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2899020616 >> 172.21.15.97:0/2899020616 conn(0x55c49d75ec70 msgr2=0x55c49d7932a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2899020616 shutdown_connections 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 -- 172.21.15.97:0/2899020616 wait complete. 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.878+0000 7f7c9afb2740 1 -- start start 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.879+0000 7f7c9afb2740 1 Processor -- start 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d7c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c9afb2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d84bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d7bb760 con 0x55c49d79cea0 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d7c0e10 con 0x55c49d797ba0 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c9afb2740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c49d7e68b0 con 0x55c49d79c5e0 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c9afb2740 10 client.0 _ll_register_callbacks cb 0x7f7c8c00de40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d84bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d84bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42320/0 (socket says 172.21.15.97:42320) 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 -- 172.21.15.97:0/673207016 learned_addr learned my addr 172.21.15.97:0/673207016 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c960dd640 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d7c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c958dc640 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 -- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 msgr2=0x55c49d7f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 -- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 msgr2=0x55c49d7c08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:09.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d7c08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.880+0000 7f7c968de640 1 -- 172.21.15.97:0/673207016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c49d6cb860 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c968de640 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d84bc50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001f40 tx=0x7f7c88001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34956d17aa09215 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c717fa640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c717fa640 1 -- 172.21.15.97:0/673207016 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88054070 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c717fa640 1 -- 172.21.15.97:0/673207016 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c88005420 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c88006b50 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c717fa640 1 -- 172.21.15.97:0/673207016 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c880055e0 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c9afb2740 10 client.5430 fetch_fsmap learned FSMap version 17 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c49d69fb80 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.881+0000 7f7c717fa640 1 -- 172.21.15.97:0/673207016 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88062020 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c717fa640 1 -- 172.21.15.97:0/673207016 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7c88035070 con 0x55c49d79cea0 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c9afb2740 10 client.5430 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T08:08:09.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c9afb2740 10 client.5430 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c9afb2740 20 client.5430 populate_metadata read hostname 'smithi097' 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d850140 0x55c49d850520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c9afb2740 4 client.5430 mds_command: new command op to 5244 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 --> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c49d4046c0 con 0x55c49d850140 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c960dd640 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d850140 0x55c49d850520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c960dd640 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d850140 0x55c49d850520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2b050b20045c1a5 server_cookie=7aecdabb3c66f309 in_seq=0 out_seq=0 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.882+0000 7f7c717fa640 10 client.5430 ms_handle_connect on v2:172.21.15.97:6834/4116734497 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c717fa640 1 -- 172.21.15.97:0/673207016 <== mds.0 v2:172.21.15.97:6834/4116734497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c49d4046c0 con 0x55c49d850140 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c717fa640 10 client.5430 handle_command_reply: tid=0 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 client.5430 shutdown 2023-11-24T08:08:09.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 msgr2=0x55c49d84bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d84bc50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001f40 tx=0x7f7c88001510 comp rx=0 tx=0).stop 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 shutdown_connections 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c49d79cea0 0x55c49d84bc50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.97:6834/4116734497,v1:172.21.15.97:6835/4116734497] conn(0x55c49d850140 0x55c49d850520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c49d79c5e0 0x55c49d7f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 --2- 172.21.15.97:0/673207016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c49d797ba0 0x55c49d7c08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c717fa640 0 client.5430 ms_handle_reset on v2:172.21.15.97:6834/4116734497 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 >> 172.21.15.97:0/673207016 conn(0x55c49d75ec70 msgr2=0x55c49d7932a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 shutdown_connections 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 1 -- 172.21.15.97:0/673207016 wait complete. 2023-11-24T08:08:09.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.883+0000 7f7c9afb2740 20 client.5430 trim_cache size 0 max 16384 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "bcc30232-58ca-4ca3-86d0-71be2a8a6471", 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 5244, 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2023-11-24T08:08:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 6.6798103209999997, 2023-11-24T08:08:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 17, 2023-11-24T08:08:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 35, 2023-11-24T08:08:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 35, 2023-11-24T08:08:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 15.483712798999999 2023-11-24T08:08:09.892 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7c7406ae40 msgr2=0x7f7c7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7c7406ae40 0x7f7c7406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c006f00 tx=0x7f7c8c006e90 comp rx=0 tx=0).stop 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c900b2cf0 msgr2=0x7f7c900b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c900b2cf0 0x7f7c900b3150 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e780 tx=0x7f7c8000ec40 comp rx=0 tx=0).stop 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 shutdown_connections 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7c7406ae40 0x7f7c7406d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c90151e30 0x7f7c901522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c900b2cf0 0x7f7c900b3150 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 --2- 172.21.15.97:0/2291187203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7c005180 0x7f7c9013d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 >> 172.21.15.97:0/2291187203 conn(0x7f7c9006a800 msgr2=0x7f7c9015d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:09.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 shutdown_connections 2023-11-24T08:08:09.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:09.884+0000 7f7c98341640 1 -- 172.21.15.97:0/2291187203 wait complete. 2023-11-24T08:08:09.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:08:10.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.099+0000 7f6904848640 1 Processor -- start 2023-11-24T08:08:10.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.099+0000 7f6904848640 1 -- start start 2023-11-24T08:08:10.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f6904848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690014b2c0 0x7f69000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:10.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f6904848640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6900071070 0x7f69000cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:10.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f6904848640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000cfbf0 con 0x7f69000cf7d0 2023-11-24T08:08:10.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f6904848640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690014b6a0 con 0x7f6900071070 2023-11-24T08:08:10.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f6904848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6900071690 con 0x7f690014b2c0 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f68fed9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6900071070 0x7f69000cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f68fed9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6900071070 0x7f69000cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42334/0 (socket says 172.21.15.97:42334) 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f68fdd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f69000cf7d0 0x7f6900070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45434/0 (socket says 172.21.15.97:45434) 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f68fed9d640 1 -- 172.21.15.97:0/2345003712 learned_addr learned my addr 172.21.15.97:0/2345003712 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f68fe59c640 1 --2- 172.21.15.97:0/2345003712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690014b2c0 0x7f69000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.101+0000 7f68fed9d640 1 -- 172.21.15.97:0/2345003712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690014b2c0 msgr2=0x7f69000cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.102+0000 7f68fed9d640 1 --2- 172.21.15.97:0/2345003712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690014b2c0 0x7f69000cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.102+0000 7f68fed9d640 1 -- 172.21.15.97:0/2345003712 >> v1:172.21.15.97:6789/0 conn(0x7f69000cf7d0 legacy=0x7f6900070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.102+0000 7f68fed9d640 1 -- 172.21.15.97:0/2345003712 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6900071970 con 0x7f6900071070 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.102+0000 7f68fd59a640 1 -- 172.21.15.97:0/2345003712 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225874133 0 0) 0x7f69000cfbf0 con 0x7f69000cf7d0 2023-11-24T08:08:10.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.102+0000 7f68fe59c640 1 --2- 172.21.15.97:0/2345003712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690014b2c0 0x7f69000cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:10.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.103+0000 7f68fed9d640 1 --2- 172.21.15.97:0/2345003712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6900071070 0x7f69000cc160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009e50 tx=0x7f68f802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e773c19b2630c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:10.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.103+0000 7f68fd59a640 1 -- 172.21.15.97:0/2345003712 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f802caf0 con 0x7f6900071070 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.103+0000 7f68fd59a640 1 -- 172.21.15.97:0/2345003712 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f802cc50 con 0x7f6900071070 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.103+0000 7f68fd59a640 1 -- 172.21.15.97:0/2345003712 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f80343f0 con 0x7f6900071070 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 -- 172.21.15.97:0/2345003712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6900071070 msgr2=0x7f69000cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 --2- 172.21.15.97:0/2345003712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6900071070 0x7f69000cc160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009e50 tx=0x7f68f802bf50 comp rx=0 tx=0).stop 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 -- 172.21.15.97:0/2345003712 shutdown_connections 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 --2- 172.21.15.97:0/2345003712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6900071070 0x7f69000cc160 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 --2- 172.21.15.97:0/2345003712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690014b2c0 0x7f69000cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 -- 172.21.15.97:0/2345003712 >> 172.21.15.97:0/2345003712 conn(0x7f690006a800 msgr2=0x7f690006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 -- 172.21.15.97:0/2345003712 shutdown_connections 2023-11-24T08:08:10.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.104+0000 7f6904848640 1 -- 172.21.15.97:0/2345003712 wait complete. 2023-11-24T08:08:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.106+0000 7f6904848640 1 Processor -- start 2023-11-24T08:08:10.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.106+0000 7f6904848640 1 -- start start 2023-11-24T08:08:10.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f6904848640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6900071070 0x7f6900148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:10.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f6904848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69000cf7d0 0x7f6900147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:10.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f6904848640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f690014b2c0 0x7f69001fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:10.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f6904848640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900149420 con 0x7f690014b2c0 2023-11-24T08:08:10.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f6904848640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69001f7fb0 con 0x7f6900071070 2023-11-24T08:08:10.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f6904848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6900148150 con 0x7f69000cf7d0 2023-11-24T08:08:10.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f690014b2c0 0x7f69001fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f690014b2c0 0x7f69001fb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42348/0 (socket says 172.21.15.97:42348) 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fed9d640 1 -- 172.21.15.97:0/187889662 learned_addr learned my addr 172.21.15.97:0/187889662 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fed9d640 1 -- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69000cf7d0 msgr2=0x7f6900147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fdd9b640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69000cf7d0 0x7f6900147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fe59c640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6900071070 0x7f6900148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fed9d640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69000cf7d0 0x7f6900147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fed9d640 1 -- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6900071070 msgr2=0x7f6900148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.107+0000 7f68fed9d640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6900071070 0x7f6900148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.108+0000 7f68fed9d640 1 -- 172.21.15.97:0/187889662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8009b30 con 0x7f690014b2c0 2023-11-24T08:08:10.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.108+0000 7f68fed9d640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f690014b2c0 0x7f69001fb300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009e50 tx=0x7f68f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:10.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.108+0000 7f68eeffd640 1 -- 172.21.15.97:0/187889662 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8009510 con 0x7f690014b2c0 2023-11-24T08:08:10.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.108+0000 7f68eeffd640 1 -- 172.21.15.97:0/187889662 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f803e450 con 0x7f690014b2c0 2023-11-24T08:08:10.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.108+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69001f7680 con 0x7f690014b2c0 2023-11-24T08:08:10.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.108+0000 7f68eeffd640 1 -- 172.21.15.97:0/187889662 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f803e800 con 0x7f690014b2c0 2023-11-24T08:08:10.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.108+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69001f7c40 con 0x7f690014b2c0 2023-11-24T08:08:10.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.109+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69001f8140 con 0x7f690014b2c0 2023-11-24T08:08:10.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.111+0000 7f68eeffd640 1 -- 172.21.15.97:0/187889662 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68f803e960 con 0x7f690014b2c0 2023-11-24T08:08:10.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.111+0000 7f68eeffd640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f68e006ae40 0x7f68e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:10.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.112+0000 7f68eeffd640 1 -- 172.21.15.97:0/187889662 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68f80ac460 con 0x7f690014b2c0 2023-11-24T08:08:10.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.112+0000 7f68fe59c640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f68e006ae40 0x7f68e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:10.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.112+0000 7f68fe59c640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f68e006ae40 0x7f68e006d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f690014a9d0 tx=0x7f68f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:10.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.116+0000 7f68eeffd640 1 -- 172.21.15.97:0/187889662 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68f80775c0 con 0x7f690014b2c0 2023-11-24T08:08:10.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.351+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69000675d0 con 0x7f690014b2c0 2023-11-24T08:08:10.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.351+0000 7f68eeffd640 1 -- 172.21.15.97:0/187889662 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68f807abe0 con 0x7f690014b2c0 2023-11-24T08:08:10.353 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:08:10.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f68e006ae40 msgr2=0x7f68e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:10.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f68e006ae40 0x7f68e006d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f690014a9d0 tx=0x7f68f0008040 comp rx=0 tx=0).stop 2023-11-24T08:08:10.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f690014b2c0 msgr2=0x7f69001fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:10.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f690014b2c0 0x7f69001fb300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009e50 tx=0x7f68f8004a40 comp rx=0 tx=0).stop 2023-11-24T08:08:10.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 shutdown_connections 2023-11-24T08:08:10.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f68e006ae40 0x7f68e006d300 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f690014b2c0 0x7f69001fb300 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69000cf7d0 0x7f6900147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 --2- 172.21.15.97:0/187889662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6900071070 0x7f6900148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:10.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 >> 172.21.15.97:0/187889662 conn(0x7f690006a800 msgr2=0x7f690006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:10.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 shutdown_connections 2023-11-24T08:08:10.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:10.354+0000 7f6904848640 1 -- 172.21.15.97:0/187889662 wait complete. 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:08:10.373 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:08:10.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:10.374 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-11-24T08:08:10.425 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:08:10.425 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:08:10.425 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:08:10.425 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:08:10.426 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42287sec preferred_lft 42287sec 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 46:c4:d1:8a:f2:3a brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:08:10.427 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::10b7:35ff:fe1c:2d7f/64 scope link 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 46:c4:d1:8a:f2:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::44c4:d1ff:fe8a:f23a/64 scope link 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 6e:b3:b3:8c:c0:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::6cb3:b3ff:fe8c:c010/64 scope link 2023-11-24T08:08:10.428 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:10.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:10.429 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:08:10.512 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-11-24T08:08:10.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:10.516 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-11-24T08:08:10.569 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-11-24T08:08:10.569 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:08:10.569 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:08:10.570 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:08:10.570 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:08:10.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:10.570 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-11-24T08:08:10.570 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-11-24T08:08:10.570 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:08:10.570 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:08:10.570 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:08:10.570 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-11-24T08:08:10.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:10.758 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-11-24T08:08:10.809 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:08:10.810 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:08:10.810 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:08:10.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:10.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-11-24T08:08:10.905 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T08:08:10.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:08:10.906 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:08:10.961 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:08:10.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:08:10.961 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:08:11.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-11-24T08:08:11.113 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:08:11.170 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2023-11-24T08:08:11.171 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/selinux 2023-11-24T08:08:11.172 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:08:11.172 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2023-11-24T08:08:11.172 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2023-11-24T08:08:11.172 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2023-11-24T08:08:11.172 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2023-11-24T08:08:11.172 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2023-11-24T08:08:11.172 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:08:11.173 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:08:11.173 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2023-11-24T08:08:11.173 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:08:11.174 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:08:11.174 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2023-11-24T08:08:11.174 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2023-11-24T08:08:11.174 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:08:11.174 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:08:11.175 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:08:11.175 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:08:11.175 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2023-11-24T08:08:11.175 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:08:11.175 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:08:11.175 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:08:11.175 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:08:11.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:11.176 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-11-24T08:08:11.228 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:08:11.228 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T08:08:11.234 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-11-24T08:08:11.313 DEBUG:teuthology.orchestra.run.smithi097:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:08:11.354 INFO:teuthology.orchestra.run.smithi097.stdout:/proc 2023-11-24T08:08:11.355 INFO:teuthology.orchestra.run.smithi097.stdout:/sys 2023-11-24T08:08:11.355 INFO:teuthology.orchestra.run.smithi097.stdout:/dev 2023-11-24T08:08:11.355 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/security 2023-11-24T08:08:11.355 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/shm 2023-11-24T08:08:11.355 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/pts 2023-11-24T08:08:11.356 INFO:teuthology.orchestra.run.smithi097.stdout:/run 2023-11-24T08:08:11.356 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/cgroup 2023-11-24T08:08:11.356 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/pstore 2023-11-24T08:08:11.356 INFO:teuthology.orchestra.run.smithi097.stdout:/ 2023-11-24T08:08:11.356 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/selinux 2023-11-24T08:08:11.356 INFO:teuthology.orchestra.run.smithi097.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:08:11.356 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/hugepages 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/dev/mqueue 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/debug 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/tracing 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/fs/fuse/connections 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/sys/kernel/config 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/run/user/1000 2023-11-24T08:08:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:08:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:08:11.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:11.359 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-11-24T08:08:11.421 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:2023-11-24T08:08:11.419+0000 7fb9a0844480 -1 init, newargv = 0x564a44e79a70 newargc=15 2023-11-24T08:08:11.421 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[102312]: starting ceph client 2023-11-24T08:08:11.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[102312]: starting fuse 2023-11-24T08:08:11.447 INFO:teuthology.orchestra.run.smithi097.stdout:40 2023-11-24T08:08:11.447 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2023-11-24T08:08:11.447 DEBUG:teuthology.orchestra.run.smithi097:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> import glob 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> import re 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> import os 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> import subprocess 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> def _find_admin_socket(client_name): 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> files = glob.glob(asok_path) 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> # Given a non-glob path, it better be there 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> if "*" not in asok_path: 2023-11-24T08:08:11.448 DEBUG:teuthology.orchestra.run.smithi097:> assert(len(files) == 1) 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> return files[0] 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> for f in files: 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> contents = proc_f.read() 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> if mountpoint in contents: 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> return f 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> print(_find_admin_socket("client.0")) 2023-11-24T08:08:11.449 DEBUG:teuthology.orchestra.run.smithi097:> ' 2023-11-24T08:08:11.644 INFO:teuthology.orchestra.run.smithi097.stdout:/var/run/ceph/ceph-client.0.102312.asok 2023-11-24T08:08:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:08:11.661 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.102312.asok 2023-11-24T08:08:11.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:11.661 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.102312.asok status 2023-11-24T08:08:11.905 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:11.905 INFO:teuthology.orchestra.run.smithi097.stdout: "metadata": { 2023-11-24T08:08:11.905 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:08:11.905 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "entity_id": "0", 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": "smithi097", 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "pid": "102312", 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "root": "/" 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_count": 0, 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_pinned_count": 0, 2023-11-24T08:08:11.906 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 5445, 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "inst": { 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "name": { 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "client", 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "num": 5445 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3292543912 2023-11-24T08:08:11.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3292543912 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "inst_str": "client.5445 192.168.0.1:0/3292543912", 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "addr_str": "192.168.0.1:0/3292543912", 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "inode_count": 1, 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_epoch": 17, 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch": 35, 2023-11-24T08:08:11.908 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:08:11.909 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklisted": false, 2023-11-24T08:08:11.909 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs" 2023-11-24T08:08:11.909 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:11.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:11.920 DEBUG:teuthology.orchestra.run.smithi097:> stat --file-system '--printf=%T 2023-11-24T08:08:11.920 DEBUG:teuthology.orchestra.run.smithi097:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T08:08:11.977 INFO:teuthology.orchestra.run.smithi097.stdout:fuseblk 2023-11-24T08:08:11.977 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T08:08:11.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:11.978 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:08:12.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:08:12.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.290+0000 7fe862c59640 1 Processor -- start 2023-11-24T08:08:12.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.290+0000 7fe862c59640 1 -- start start 2023-11-24T08:08:12.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.291+0000 7fe862c59640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe85c146650 0x7fe85c0b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.291+0000 7fe862c59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.291+0000 7fe862c59640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe85c15e030 0x7fe85c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.291+0000 7fe862c59640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c15dba0 con 0x7fe85c15e030 2023-11-24T08:08:12.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.291+0000 7fe862c59640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c06f800 con 0x7fe85c146650 2023-11-24T08:08:12.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.291+0000 7fe862c59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c06f240 con 0x7fe85c0726f0 2023-11-24T08:08:12.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe85c15e030 0x7fe85c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe85c15e030 0x7fe85c15e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42364/0 (socket says 172.21.15.97:42364) 2023-11-24T08:08:12.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 -- 172.21.15.97:0/920494892 learned_addr learned my addr 172.21.15.97:0/920494892 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:12.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe861456640 1 --2- 172.21.15.97:0/920494892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 -- 172.21.15.97:0/920494892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 msgr2=0x7fe85c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 --2- 172.21.15.97:0/920494892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 -- 172.21.15.97:0/920494892 >> v2:172.21.15.183:3300/0 conn(0x7fe85c146650 msgr2=0x7fe85c0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe861c57640 1 --2- 172.21.15.97:0/920494892 >> v2:172.21.15.183:3300/0 conn(0x7fe85c146650 0x7fe85c0b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 --2- 172.21.15.97:0/920494892 >> v2:172.21.15.183:3300/0 conn(0x7fe85c146650 0x7fe85c0b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe862458640 1 -- 172.21.15.97:0/920494892 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c06f520 con 0x7fe85c15e030 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe861456640 1 --2- 172.21.15.97:0/920494892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.292+0000 7fe861c57640 1 --2- 172.21.15.97:0/920494892 >> v2:172.21.15.183:3300/0 conn(0x7fe85c146650 0x7fe85c0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.293+0000 7fe862458640 1 --2- 172.21.15.97:0/920494892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c15e030 0x7fe85c15e4e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe854009e50 tx=0x7fe85402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8534f2ac99a5ba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.294+0000 7fe860c55640 1 -- 172.21.15.97:0/920494892 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85402ca80 con 0x7fe85c15e030 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.294+0000 7fe860c55640 1 -- 172.21.15.97:0/920494892 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85402cbe0 con 0x7fe85c15e030 2023-11-24T08:08:12.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.294+0000 7fe860c55640 1 -- 172.21.15.97:0/920494892 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540343f0 con 0x7fe85c15e030 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.294+0000 7fe862c59640 1 -- 172.21.15.97:0/920494892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c15e030 msgr2=0x7fe85c15e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.294+0000 7fe862c59640 1 --2- 172.21.15.97:0/920494892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c15e030 0x7fe85c15e4e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe854009e50 tx=0x7fe85402bee0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.295+0000 7fe862c59640 1 -- 172.21.15.97:0/920494892 shutdown_connections 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.295+0000 7fe862c59640 1 --2- 172.21.15.97:0/920494892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c15e030 0x7fe85c15e4e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.295+0000 7fe862c59640 1 --2- 172.21.15.97:0/920494892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.295+0000 7fe862c59640 1 --2- 172.21.15.97:0/920494892 >> v2:172.21.15.183:3300/0 conn(0x7fe85c146650 0x7fe85c0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.295+0000 7fe862c59640 1 -- 172.21.15.97:0/920494892 >> 172.21.15.97:0/920494892 conn(0x7fe85c0b1d40 msgr2=0x7fe85c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.295+0000 7fe862c59640 1 -- 172.21.15.97:0/920494892 shutdown_connections 2023-11-24T08:08:12.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.295+0000 7fe862c59640 1 -- 172.21.15.97:0/920494892 wait complete. 2023-11-24T08:08:12.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.296+0000 7fe862c59640 1 Processor -- start 2023-11-24T08:08:12.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.297+0000 7fe862c59640 1 -- start start 2023-11-24T08:08:12.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.297+0000 7fe862c59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.297+0000 7fe862c59640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c146650 0x7fe85c140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.297+0000 7fe862c59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe85c15e030 0x7fe85c140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.297+0000 7fe862c59640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c14ff90 con 0x7fe85c146650 2023-11-24T08:08:12.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.297+0000 7fe862c59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0ae640 con 0x7fe85c15e030 2023-11-24T08:08:12.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.297+0000 7fe862c59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c14f980 con 0x7fe85c0726f0 2023-11-24T08:08:12.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c146650 0x7fe85c140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c146650 0x7fe85c140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42376/0 (socket says 172.21.15.97:42376) 2023-11-24T08:08:12.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 -- 172.21.15.97:0/390254363 learned_addr learned my addr 172.21.15.97:0/390254363 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 -- 172.21.15.97:0/390254363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 msgr2=0x7fe85c13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 -- 172.21.15.97:0/390254363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe85c15e030 msgr2=0x7fe85c140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe85c15e030 0x7fe85c140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 -- 172.21.15.97:0/390254363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe854009b30 con 0x7fe85c146650 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.298+0000 7fe861456640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c146650 0x7fe85c140220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00c7c0 tx=0x7fe84c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.299+0000 7fe8527fc640 1 -- 172.21.15.97:0/390254363 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c007820 con 0x7fe85c146650 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.299+0000 7fe8527fc640 1 -- 172.21.15.97:0/390254363 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c007980 con 0x7fe85c146650 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.299+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c0ae080 con 0x7fe85c146650 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.299+0000 7fe8527fc640 1 -- 172.21.15.97:0/390254363 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c007d10 con 0x7fe85c146650 2023-11-24T08:08:12.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.299+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c14fbb0 con 0x7fe85c146650 2023-11-24T08:08:12.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.300+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c067b60 con 0x7fe85c146650 2023-11-24T08:08:12.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.301+0000 7fe8527fc640 1 -- 172.21.15.97:0/390254363 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe84c0113f0 con 0x7fe85c146650 2023-11-24T08:08:12.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.302+0000 7fe8527fc640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe84006ae40 0x7fe84006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:12.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.302+0000 7fe8527fc640 1 -- 172.21.15.97:0/390254363 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe84c089670 con 0x7fe85c146650 2023-11-24T08:08:12.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.303+0000 7fe861c57640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe84006ae40 0x7fe84006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:12.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.303+0000 7fe861c57640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe84006ae40 0x7fe84006d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe858006fd0 tx=0x7fe858008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:12.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.307+0000 7fe8527fc640 1 -- 172.21.15.97:0/390254363 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe84c0547b0 con 0x7fe85c146650 2023-11-24T08:08:12.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.536+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe85c06b0f0 con 0x7fe85c146650 2023-11-24T08:08:12.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.537+0000 7fe8527fc640 1 -- 172.21.15.97:0/390254363 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe84c057dd0 con 0x7fe85c146650 2023-11-24T08:08:12.539 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:08:12.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe84006ae40 msgr2=0x7fe84006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe84006ae40 0x7fe84006d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe858006fd0 tx=0x7fe858008040 comp rx=0 tx=0).stop 2023-11-24T08:08:12.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c146650 msgr2=0x7fe85c140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:12.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c146650 0x7fe85c140220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00c7c0 tx=0x7fe84c00cc80 comp rx=0 tx=0).stop 2023-11-24T08:08:12.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 shutdown_connections 2023-11-24T08:08:12.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe84006ae40 0x7fe84006d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe85c15e030 0x7fe85c140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe85c146650 0x7fe85c140220 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 --2- 172.21.15.97:0/390254363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe85c0726f0 0x7fe85c13ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:12.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 >> 172.21.15.97:0/390254363 conn(0x7fe85c0b1d40 msgr2=0x7fe85c06ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:12.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 shutdown_connections 2023-11-24T08:08:12.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:12.539+0000 7fe862c59640 1 -- 172.21.15.97:0/390254363 wait complete. 2023-11-24T08:08:12.559 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:08:12.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:08:12.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-11-24T08:08:12.560 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:08:12.560 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:08:12.560 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:08:12.560 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:08:12.560 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:08:12.560 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:08:12.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:12.560 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-11-24T08:08:12.620 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-11-24T08:08:12.621 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42268sec preferred_lft 42268sec 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:3c:1c:3e:13:f8 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::3808:39ff:fe81:add4/64 scope link 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:12.622 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:08:12.623 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:3c:1c:3e:13:f8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:08:12.623 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::3c:1cff:fe3e:13f8/64 scope link 2023-11-24T08:08:12.623 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:12.623 INFO:teuthology.orchestra.run.smithi183.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:08:12.623 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 9a:bc:f3:16:8b:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:08:12.623 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::98bc:f3ff:fe16:8b2f/64 scope link 2023-11-24T08:08:12.623 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:08:12.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:12.624 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:08:12.717 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-11-24T08:08:12.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:12.721 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-11-24T08:08:12.778 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-11-24T08:08:12.778 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:08:12.778 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:08:12.778 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:08:12.778 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:08:12.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:12.779 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-11-24T08:08:12.779 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-11-24T08:08:12.779 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:08:12.779 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:08:12.779 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:08:12.779 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-11-24T08:08:12.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:12.958 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-24T08:08:13.012 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:08:13.012 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:08:13.013 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:08:13.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:13.013 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-11-24T08:08:13.105 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T08:08:13.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:08:13.106 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:08:13.159 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:08:13.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:08:13.159 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:08:13.206 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2023-11-24T08:08:13.351 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:08:13.407 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2023-11-24T08:08:13.407 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2023-11-24T08:08:13.407 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2023-11-24T08:08:13.407 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2023-11-24T08:08:13.407 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2023-11-24T08:08:13.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:08:13.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:08:13.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:13.410 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2023-11-24T08:08:13.463 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:08:13.463 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T08:08:13.469 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2023-11-24T08:08:13.549 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:08:13.593 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2023-11-24T08:08:13.593 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2023-11-24T08:08:13.593 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2023-11-24T08:08:13.594 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2023-11-24T08:08:13.595 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:08:13.596 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:08:13.596 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:08:13.596 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:08:13.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:13.597 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2023-11-24T08:08:13.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2023-11-24T08:08:13.657+0000 7f9156f41480 -1 init, newargv = 0x555f72960b10 newargc=15 2023-11-24T08:08:13.659 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[95249]: starting ceph client 2023-11-24T08:08:13.671 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[95249]: starting fuse 2023-11-24T08:08:13.686 INFO:teuthology.orchestra.run.smithi183.stdout:41 2023-11-24T08:08:13.686 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-24T08:08:13.686 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:08:13.686 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2023-11-24T08:08:13.686 DEBUG:teuthology.orchestra.run.smithi183:> import re 2023-11-24T08:08:13.686 DEBUG:teuthology.orchestra.run.smithi183:> import os 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:08:13.687 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> return f 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2023-11-24T08:08:13.688 DEBUG:teuthology.orchestra.run.smithi183:> ' 2023-11-24T08:08:13.888 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.95249.asok 2023-11-24T08:08:13.892 INFO:teuthology.orchestra.run.smithi183.stderr:2023-11-24T08:08:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:08:13.905 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95249.asok 2023-11-24T08:08:13.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:13.905 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95249.asok status 2023-11-24T08:08:14.146 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2023-11-24T08:08:14.146 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "1", 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "95249", 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4915, 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2023-11-24T08:08:14.147 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4915 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 2745980005 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: } 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2023-11-24T08:08:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 2745980005 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4915 192.168.0.1:0/2745980005", 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.1:0/2745980005", 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 17, 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 35, 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2023-11-24T08:08:14.149 INFO:teuthology.orchestra.run.smithi183.stdout:} 2023-11-24T08:08:14.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:14.161 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2023-11-24T08:08:14.161 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T08:08:14.215 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2023-11-24T08:08:14.215 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T08:08:14.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:14.215 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:08:14.313 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:08:14.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.534+0000 7f95a2ebb640 1 Processor -- start 2023-11-24T08:08:14.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.535+0000 7f95a2ebb640 1 -- start start 2023-11-24T08:08:14.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a2ebb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f959c071290 0x7f959c0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:14.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a2ebb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f959c15b470 0x7f959c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:14.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a2ebb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c071b90 con 0x7f959c155540 2023-11-24T08:08:14.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a2ebb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c155920 con 0x7f959c071290 2023-11-24T08:08:14.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a2ebb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c15b9e0 con 0x7f959c15b470 2023-11-24T08:08:14.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a1eb9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f959c155540 0x7f959c070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45450/0 (socket says 172.21.15.97:45450) 2023-11-24T08:08:14.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a1eb9640 1 -- 172.21.15.97:0/901470001 learned_addr learned my addr 172.21.15.97:0/901470001 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:14.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a16b8640 1 --2- 172.21.15.97:0/901470001 >> v2:172.21.15.97:3300/0 conn(0x7f959c071290 0x7f959c0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:14.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.536+0000 7f95a26ba640 1 --2- 172.21.15.97:0/901470001 >> v2:172.21.15.183:3300/0 conn(0x7f959c15b470 0x7f959c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:14.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.537+0000 7f95a0eb7640 1 -- 172.21.15.97:0/901470001 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558732360 0 0) 0x7f959c071b90 con 0x7f959c155540 2023-11-24T08:08:14.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.537+0000 7f95a0eb7640 1 -- 172.21.15.97:0/901470001 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9584003520 con 0x7f959c155540 2023-11-24T08:08:14.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.537+0000 7f95a16b8640 1 -- 172.21.15.97:0/901470001 >> v2:172.21.15.183:3300/0 conn(0x7f959c15b470 msgr2=0x7f959c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:14.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.537+0000 7f95a16b8640 1 --2- 172.21.15.97:0/901470001 >> v2:172.21.15.183:3300/0 conn(0x7f959c15b470 0x7f959c0b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:14.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.537+0000 7f95a16b8640 1 -- 172.21.15.97:0/901470001 >> v1:172.21.15.97:6789/0 conn(0x7f959c155540 legacy=0x7f959c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:14.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.537+0000 7f95a16b8640 1 -- 172.21.15.97:0/901470001 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0af1e0 con 0x7f959c071290 2023-11-24T08:08:14.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.538+0000 7f95a16b8640 1 --2- 172.21.15.97:0/901470001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c071290 0x7f959c0aeca0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f959c0cc1a0 tx=0x7f959002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980261d228c165d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:14.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.538+0000 7f95a0eb7640 1 -- 172.21.15.97:0/901470001 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959002e070 con 0x7f959c071290 2023-11-24T08:08:14.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.538+0000 7f95a0eb7640 1 -- 172.21.15.97:0/901470001 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95900315a0 con 0x7f959c071290 2023-11-24T08:08:14.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.538+0000 7f95a0eb7640 1 -- 172.21.15.97:0/901470001 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590031930 con 0x7f959c071290 2023-11-24T08:08:14.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 -- 172.21.15.97:0/901470001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c071290 msgr2=0x7f959c0aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:14.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/901470001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c071290 0x7f959c0aeca0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f959c0cc1a0 tx=0x7f959002b840 comp rx=0 tx=0).stop 2023-11-24T08:08:14.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 -- 172.21.15.97:0/901470001 shutdown_connections 2023-11-24T08:08:14.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/901470001 >> v2:172.21.15.183:3300/0 conn(0x7f959c15b470 0x7f959c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:14.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/901470001 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c071290 0x7f959c0aeca0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:14.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 -- 172.21.15.97:0/901470001 >> 172.21.15.97:0/901470001 conn(0x7f959c0cc1d0 msgr2=0x7f959c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:14.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 -- 172.21.15.97:0/901470001 shutdown_connections 2023-11-24T08:08:14.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.539+0000 7f95a2ebb640 1 -- 172.21.15.97:0/901470001 wait complete. 2023-11-24T08:08:14.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.541+0000 7f95a2ebb640 1 Processor -- start 2023-11-24T08:08:14.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.541+0000 7f95a2ebb640 1 -- start start 2023-11-24T08:08:14.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a2ebb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f959c071290 0x7f959c150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:14.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a2ebb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f959c155540 0x7f959c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:14.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a2ebb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c15b470 0x7f959c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:14.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a2ebb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c15dcd0 con 0x7f959c15b470 2023-11-24T08:08:14.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a2ebb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c15d050 con 0x7f959c071290 2023-11-24T08:08:14.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a2ebb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c15d330 con 0x7f959c155540 2023-11-24T08:08:14.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a26ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c15b470 0x7f959c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a26ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c15b470 0x7f959c153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42404/0 (socket says 172.21.15.97:42404) 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a26ba640 1 -- 172.21.15.97:0/1254074834 learned_addr learned my addr 172.21.15.97:0/1254074834 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.542+0000 7f95a1eb9640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f959c071290 0x7f959c150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a16b8640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f959c155540 0x7f959c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a26ba640 1 -- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f959c155540 msgr2=0x7f959c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a26ba640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f959c155540 0x7f959c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a26ba640 1 -- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f959c071290 msgr2=0x7f959c150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:14.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a26ba640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f959c071290 0x7f959c150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:14.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a26ba640 1 -- 172.21.15.97:0/1254074834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900093a0 con 0x7f959c15b470 2023-11-24T08:08:14.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a16b8640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f959c155540 0x7f959c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:14.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a26ba640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c15b470 0x7f959c153f30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f959400d5d0 tx=0x7f959400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:14.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f959a7fc640 1 -- 172.21.15.97:0/1254074834 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940125f0 con 0x7f959c15b470 2023-11-24T08:08:14.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f959a7fc640 1 -- 172.21.15.97:0/1254074834 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594012770 con 0x7f959c15b470 2023-11-24T08:08:14.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f959a7fc640 1 -- 172.21.15.97:0/1254074834 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594012b20 con 0x7f959c15b470 2023-11-24T08:08:14.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c15d610 con 0x7f959c15b470 2023-11-24T08:08:14.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.543+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c1512b0 con 0x7f959c15b470 2023-11-24T08:08:14.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.545+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c15de10 con 0x7f959c15b470 2023-11-24T08:08:14.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.545+0000 7f959a7fc640 1 -- 172.21.15.97:0/1254074834 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9594012c80 con 0x7f959c15b470 2023-11-24T08:08:14.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.546+0000 7f959a7fc640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f958806ae70 0x7f958806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:14.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.546+0000 7f959a7fc640 1 -- 172.21.15.97:0/1254074834 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9594089b30 con 0x7f959c15b470 2023-11-24T08:08:14.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.547+0000 7f95a1eb9640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f958806ae70 0x7f958806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:14.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.547+0000 7f95a1eb9640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f958806ae70 0x7f958806d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f958c001560 tx=0x7f958c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:14.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.551+0000 7f959a7fc640 1 -- 172.21.15.97:0/1254074834 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f959c15de10 con 0x7f959c15b470 2023-11-24T08:08:14.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:14.780+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f959c15de10 con 0x7f959c15b470 2023-11-24T08:08:15.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.312+0000 7f959a7fc640 1 -- 172.21.15.97:0/1254074834 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f959c15de10 con 0x7f959c15b470 2023-11-24T08:08:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f958806ae70 msgr2=0x7f958806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f958806ae70 0x7f958806d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f958c001560 tx=0x7f958c009040 comp rx=0 tx=0).stop 2023-11-24T08:08:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c15b470 msgr2=0x7f959c153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c15b470 0x7f959c153f30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f959400d5d0 tx=0x7f959400da90 comp rx=0 tx=0).stop 2023-11-24T08:08:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 shutdown_connections 2023-11-24T08:08:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f958806ae70 0x7f958806d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f959c15b470 0x7f959c153f30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f959c155540 0x7f959c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 --2- 172.21.15.97:0/1254074834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f959c071290 0x7f959c150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.316+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 >> 172.21.15.97:0/1254074834 conn(0x7f959c0cc1d0 msgr2=0x7f959c06ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.317+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 shutdown_connections 2023-11-24T08:08:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.317+0000 7f95a2ebb640 1 -- 172.21.15.97:0/1254074834 wait complete. 2023-11-24T08:08:15.339 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:08:15.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.551+0000 7f7b55153640 1 Processor -- start 2023-11-24T08:08:15.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.551+0000 7f7b55153640 1 -- start start 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b55153640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7b500cd240 0x7f7b500b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b55153640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7b5009a170 0x7f7b500cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b55153640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5006cea0 con 0x7f7b5006c6b0 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b55153640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5006cbc0 con 0x7f7b5009a170 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b55153640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5006f350 con 0x7f7b500cd240 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b4f59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7b5009a170 0x7f7b500cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b4f59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7b5009a170 0x7f7b500cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42406/0 (socket says 172.21.15.97:42406) 2023-11-24T08:08:15.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.553+0000 7f7b4f59e640 1 -- 172.21.15.97:0/235875900 learned_addr learned my addr 172.21.15.97:0/235875900 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:15.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.554+0000 7f7b4ed9d640 1 --2- 172.21.15.97:0/235875900 >> v2:172.21.15.183:3300/0 conn(0x7f7b500cd240 0x7f7b500b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:15.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.554+0000 7f7b4f59e640 1 -- 172.21.15.97:0/235875900 >> v2:172.21.15.183:3300/0 conn(0x7f7b500cd240 msgr2=0x7f7b500b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:15.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.554+0000 7f7b4f59e640 1 --2- 172.21.15.97:0/235875900 >> v2:172.21.15.183:3300/0 conn(0x7f7b500cd240 0x7f7b500b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.554+0000 7f7b4f59e640 1 -- 172.21.15.97:0/235875900 >> v1:172.21.15.183:6789/0 conn(0x7f7b5006c6b0 legacy=0x7f7b50099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:15.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.554+0000 7f7b4f59e640 1 -- 172.21.15.97:0/235875900 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5006f630 con 0x7f7b5009a170 2023-11-24T08:08:15.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.554+0000 7f7b4ed9d640 1 --2- 172.21.15.97:0/235875900 >> v2:172.21.15.183:3300/0 conn(0x7f7b500cd240 0x7f7b500b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:15.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.555+0000 7f7b4f59e640 1 --2- 172.21.15.97:0/235875900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b500cf640 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7b50070a10 tx=0x7f7b4802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f8497c1f6202b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.555+0000 7f7b4e59c640 1 -- 172.21.15.97:0/235875900 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4802ca80 con 0x7f7b5009a170 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.555+0000 7f7b4e59c640 1 -- 172.21.15.97:0/235875900 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4802cbe0 con 0x7f7b5009a170 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.555+0000 7f7b4e59c640 1 -- 172.21.15.97:0/235875900 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b480343f0 con 0x7f7b5009a170 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 -- 172.21.15.97:0/235875900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 msgr2=0x7f7b500cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 --2- 172.21.15.97:0/235875900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b500cf640 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7b50070a10 tx=0x7f7b4802bee0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 -- 172.21.15.97:0/235875900 shutdown_connections 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 --2- 172.21.15.97:0/235875900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b500cf640 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 --2- 172.21.15.97:0/235875900 >> v2:172.21.15.183:3300/0 conn(0x7f7b500cd240 0x7f7b500b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 -- 172.21.15.97:0/235875900 >> 172.21.15.97:0/235875900 conn(0x7f7b500b2d00 msgr2=0x7f7b500b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:15.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 -- 172.21.15.97:0/235875900 shutdown_connections 2023-11-24T08:08:15.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.556+0000 7f7b55153640 1 -- 172.21.15.97:0/235875900 wait complete. 2023-11-24T08:08:15.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.558+0000 7f7b55153640 1 Processor -- start 2023-11-24T08:08:15.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.558+0000 7f7b55153640 1 -- start start 2023-11-24T08:08:15.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.559+0000 7f7b55153640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b5006c6b0 0x7f7b500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:15.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.559+0000 7f7b55153640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b5006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:15.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.559+0000 7f7b55153640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b500cd240 0x7f7b5006ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.559+0000 7f7b55153640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500b64f0 con 0x7f7b5009a170 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.559+0000 7f7b55153640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500c9330 con 0x7f7b500cd240 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.559+0000 7f7b55153640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500b5c50 con 0x7f7b5006c6b0 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.559+0000 7f7b47fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b5006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b5006b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42408/0 (socket says 172.21.15.97:42408) 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 -- 172.21.15.97:0/3520835582 learned_addr learned my addr 172.21.15.97:0/3520835582 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b4f59e640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b500cd240 0x7f7b5006ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b4ed9d640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b5006c6b0 0x7f7b500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 -- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b5006c6b0 msgr2=0x7f7b500b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b5006c6b0 0x7f7b500b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 -- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b500cd240 msgr2=0x7f7b5006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b500cd240 0x7f7b5006ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 -- 172.21.15.97:0/3520835582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48009b30 con 0x7f7b5009a170 2023-11-24T08:08:15.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.560+0000 7f7b47fff640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b5006b4f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800b3c0 tx=0x7f7b3800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:15.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.561+0000 7f7b477fe640 1 -- 172.21.15.97:0/3520835582 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38011830 con 0x7f7b5009a170 2023-11-24T08:08:15.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.561+0000 7f7b477fe640 1 -- 172.21.15.97:0/3520835582 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b38011990 con 0x7f7b5009a170 2023-11-24T08:08:15.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.561+0000 7f7b477fe640 1 -- 172.21.15.97:0/3520835582 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38011d60 con 0x7f7b5009a170 2023-11-24T08:08:15.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.561+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500b5f30 con 0x7f7b5009a170 2023-11-24T08:08:15.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.561+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b500c9580 con 0x7f7b5009a170 2023-11-24T08:08:15.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.562+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b500675d0 con 0x7f7b5009a170 2023-11-24T08:08:15.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.563+0000 7f7b477fe640 1 -- 172.21.15.97:0/3520835582 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b3801b460 con 0x7f7b5009a170 2023-11-24T08:08:15.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.564+0000 7f7b477fe640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b3006ae40 0x7f7b3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:15.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.564+0000 7f7b477fe640 1 -- 172.21.15.97:0/3520835582 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b38089360 con 0x7f7b5009a170 2023-11-24T08:08:15.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.564+0000 7f7b4ed9d640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b3006ae40 0x7f7b3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:15.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.565+0000 7f7b4ed9d640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b3006ae40 0x7f7b3006d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b40008850 tx=0x7f7b40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:15.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.570+0000 7f7b477fe640 1 -- 172.21.15.97:0/3520835582 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b38054410 con 0x7f7b5009a170 2023-11-24T08:08:15.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.788+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b500b2210 con 0x7f7b3006ae40 2023-11-24T08:08:15.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.791+0000 7f7b477fe640 1 -- 172.21.15.97:0/3520835582 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7b500b2210 con 0x7f7b3006ae40 2023-11-24T08:08:15.793 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-11-24T08:08:15.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:15.793 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cephfs" 2023-11-24T08:08:15.793 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:15.793 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-11-24T08:08:15.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b3006ae40 msgr2=0x7f7b3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:15.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b3006ae40 0x7f7b3006d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b40008850 tx=0x7f7b40008040 comp rx=0 tx=0).stop 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 msgr2=0x7f7b5006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b5006b4f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800b3c0 tx=0x7f7b3800b880 comp rx=0 tx=0).stop 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 shutdown_connections 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7b3006ae40 0x7f7b3006d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b500cd240 0x7f7b5006ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7b5009a170 0x7f7b5006b4f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 --2- 172.21.15.97:0/3520835582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b5006c6b0 0x7f7b500b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 >> 172.21.15.97:0/3520835582 conn(0x7f7b500b2d00 msgr2=0x7f7b50099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 shutdown_connections 2023-11-24T08:08:15.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:15.794+0000 7f7b55153640 1 -- 172.21.15.97:0/3520835582 wait complete. 2023-11-24T08:08:15.813 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:08:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.016+0000 7f409bc15640 1 Processor -- start 2023-11-24T08:08:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.017+0000 7f409bc15640 1 -- start start 2023-11-24T08:08:16.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.018+0000 7f409bc15640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f409415e3b0 0x7f4094164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.018+0000 7f409bc15640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940b1ee0 con 0x7f40940cf9a0 2023-11-24T08:08:16.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.018+0000 7f409bc15640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940b2780 con 0x7f4094143ae0 2023-11-24T08:08:16.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.018+0000 7f409bc15640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409415e990 con 0x7f409415e3b0 2023-11-24T08:08:16.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.018+0000 7f40991b0640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f40940cf9a0 0x7f409415dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51872/0 (socket says 172.21.15.97:51872) 2023-11-24T08:08:16.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.018+0000 7f40991b0640 1 -- 172.21.15.97:0/3123046728 learned_addr learned my addr 172.21.15.97:0/3123046728 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:16.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898460030 0 0) 0x7f40940b1ee0 con 0x7f40940cf9a0 2023-11-24T08:08:16.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4080005730 con 0x7f40940cf9a0 2023-11-24T08:08:16.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f409a1b2640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f409415e3b0 0x7f4094164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259514307 0 0) 0x7f4080005730 con 0x7f40940cf9a0 2023-11-24T08:08:16.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f409415e3b0 msgr2=0x7f4094164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f409415e3b0 0x7f4094164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 >> v1:172.21.15.183:6789/0 conn(0x7f4094143ae0 legacy=0x7f40940cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940b2130 con 0x7f40940cf9a0 2023-11-24T08:08:16.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f4084001670 con 0x7f40940cf9a0 2023-11-24T08:08:16.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 >> v1:172.21.15.97:6789/0 conn(0x7f40940cf9a0 legacy=0x7f409415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f409415e3b0 0x7f4080005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800061e0 0x7f40800069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4080006f10 0x7f4080007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409415e990 con 0x7f40800061e0 2023-11-24T08:08:16.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408000dd50 con 0x7f4080006f10 2023-11-24T08:08:16.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.019+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408000df10 con 0x7f409415e3b0 2023-11-24T08:08:16.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.020+0000 7f40991b0640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800061e0 0x7f40800069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.020+0000 7f40991b0640 1 -- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f409415e3b0 msgr2=0x7f4080005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.020+0000 7f40991b0640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f409415e3b0 0x7f4080005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.020+0000 7f40991b0640 1 -- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4080006f10 msgr2=0x7f4080007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.020+0000 7f40991b0640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4080006f10 0x7f4080007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.020+0000 7f40991b0640 1 -- 172.21.15.97:0/3123046728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080005730 con 0x7f40800061e0 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.021+0000 7f40991b0640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800061e0 0x7f40800069d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f408400c190 tx=0x7f4080007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fba7dc43a6bd8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.021+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084005ad0 con 0x7f40800061e0 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.021+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4084005c30 con 0x7f40800061e0 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.021+0000 7f40989af640 1 -- 172.21.15.97:0/3123046728 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408402cae0 con 0x7f40800061e0 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.022+0000 7f409bc15640 1 -- 172.21.15.97:0/3123046728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800061e0 msgr2=0x7f40800069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.022+0000 7f409bc15640 1 --2- 172.21.15.97:0/3123046728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800061e0 0x7f40800069d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f408400c190 tx=0x7f4080007a00 comp rx=0 tx=0).stop 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.022+0000 7f409a1b2640 1 -- 172.21.15.97:0/3123046728 reap_dead start 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.022+0000 7f409bc15640 1 -- 172.21.15.97:0/3123046728 shutdown_connections 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.022+0000 7f409bc15640 1 -- 172.21.15.97:0/3123046728 >> 172.21.15.97:0/3123046728 conn(0x7f409406a800 msgr2=0x7f409406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:16.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.022+0000 7f409bc15640 1 -- 172.21.15.97:0/3123046728 shutdown_connections 2023-11-24T08:08:16.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.022+0000 7f409bc15640 1 -- 172.21.15.97:0/3123046728 wait complete. 2023-11-24T08:08:16.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.024+0000 7f409bc15640 1 Processor -- start 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.024+0000 7f409bc15640 1 -- start start 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f409bc15640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40800061e0 0x7f40941595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f409bc15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40940af650 0x7f40941eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f409bc15640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40940b0d20 0x7f40940b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f409bc15640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941396f0 con 0x7f40940af650 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f409bc15640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940ccb30 con 0x7f40800061e0 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f409bc15640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940cce10 con 0x7f40940b0d20 2023-11-24T08:08:16.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40991b0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40940af650 0x7f40941eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40991b0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40940af650 0x7f40941eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34632/0 (socket says 172.21.15.97:34632) 2023-11-24T08:08:16.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40991b0640 1 -- 172.21.15.97:0/1876403209 learned_addr learned my addr 172.21.15.97:0/1876403209 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:16.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40999b1640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40800061e0 0x7f40941595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40991b0640 1 -- 172.21.15.97:0/1876403209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40940b0d20 msgr2=0x7f40940b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40991b0640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40940b0d20 0x7f40940b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40991b0640 1 -- 172.21.15.97:0/1876403209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40800061e0 msgr2=0x7f40941595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.025+0000 7f40991b0640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40800061e0 0x7f40941595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.026+0000 7f40991b0640 1 -- 172.21.15.97:0/1876403209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940cd0f0 con 0x7f40940af650 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.026+0000 7f40991b0640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40940af650 0x7f40941eefa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f408400c190 tx=0x7f40940b26f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.026+0000 7f408a7fc640 1 -- 172.21.15.97:0/1876403209 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084039070 con 0x7f40940af650 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.026+0000 7f408a7fc640 1 -- 172.21.15.97:0/1876403209 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408402ccb0 con 0x7f40940af650 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.026+0000 7f408a7fc640 1 -- 172.21.15.97:0/1876403209 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408403c040 con 0x7f40940af650 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.026+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40940cd3d0 con 0x7f40940af650 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.026+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40941ef4e0 con 0x7f40940af650 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.027+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40940cd560 con 0x7f40940af650 2023-11-24T08:08:16.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.028+0000 7f408a7fc640 1 -- 172.21.15.97:0/1876403209 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4084032070 con 0x7f40940af650 2023-11-24T08:08:16.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.029+0000 7f408a7fc640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f407806ae70 0x7f407806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.029+0000 7f408a7fc640 1 -- 172.21.15.97:0/1876403209 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40840aa8e0 con 0x7f40940af650 2023-11-24T08:08:16.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.029+0000 7f40999b1640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f407806ae70 0x7f407806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.030+0000 7f40999b1640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f407806ae70 0x7f407806d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4090001640 tx=0x7f4090009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.034+0000 7f408a7fc640 1 -- 172.21.15.97:0/1876403209 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4084075990 con 0x7f40940af650 2023-11-24T08:08:16.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.210+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f409406c3f0 con 0x7f40940af650 2023-11-24T08:08:16.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.211+0000 7f408a7fc640 1 -- 172.21.15.97:0/1876403209 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4084078fb0 con 0x7f40940af650 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f407806ae70 msgr2=0x7f407806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f407806ae70 0x7f407806d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4090001640 tx=0x7f4090009040 comp rx=0 tx=0).stop 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40940af650 msgr2=0x7f40941eefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40940af650 0x7f40941eefa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f408400c190 tx=0x7f40940b26f0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 shutdown_connections 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f407806ae70 0x7f407806d330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40940b0d20 0x7f40940b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40940af650 0x7f40941eefa0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 --2- 172.21.15.97:0/1876403209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40800061e0 0x7f40941595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 >> 172.21.15.97:0/1876403209 conn(0x7f409406a800 msgr2=0x7f40940cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:16.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 shutdown_connections 2023-11-24T08:08:16.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.214+0000 7f409bc15640 1 -- 172.21.15.97:0/1876403209 wait complete. 2023-11-24T08:08:16.234 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:08:16.234 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:08:16.355 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:08:16.476 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:08:16.476 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:08:16.476 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:16.537 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:16.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.748+0000 7fa7e6168640 1 Processor -- start 2023-11-24T08:08:16.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.748+0000 7fa7e6168640 1 -- start start 2023-11-24T08:08:16.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.750+0000 7fa7e6168640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 0x7fa7e0071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.750+0000 7fa7e6168640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e0071690 con 0x7fa7e014b2c0 2023-11-24T08:08:16.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.750+0000 7fa7e6168640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e0071970 con 0x7fa7e00cf9a0 2023-11-24T08:08:16.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.750+0000 7fa7e6168640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e014b6a0 con 0x7fa7e00cd170 2023-11-24T08:08:16.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.750+0000 7fa7df7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa7e014b2c0 0x7fa7e00cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51874/0 (socket says 172.21.15.97:51874) 2023-11-24T08:08:16.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.750+0000 7fa7df7fe640 1 -- 172.21.15.97:0/351213837 learned_addr learned my addr 172.21.15.97:0/351213837 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:16.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7dffff640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 0x7fa7e0071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028712229 0 0) 0x7fa7e0071690 con 0x7fa7e014b2c0 2023-11-24T08:08:16.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c8003520 con 0x7fa7e014b2c0 2023-11-24T08:08:16.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2245902599 0 0) 0x7fa7c8003520 con 0x7fa7e014b2c0 2023-11-24T08:08:16.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 msgr2=0x7fa7e0071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 0x7fa7e0071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 >> v1:172.21.15.183:6789/0 conn(0x7fa7e00cf9a0 legacy=0x7fa7e0070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0071c50 con 0x7fa7e014b2c0 2023-11-24T08:08:16.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fa7d0001670 con 0x7fa7e014b2c0 2023-11-24T08:08:16.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 >> v1:172.21.15.97:6789/0 conn(0x7fa7e014b2c0 legacy=0x7fa7e00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7c80039a0 0x7fa7c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 0x7fa7c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c8004d00 0x7fa7c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e014b6a0 con 0x7fa7c80039a0 2023-11-24T08:08:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c800ba60 con 0x7fa7c8004d00 2023-11-24T08:08:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.751+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c800bc20 con 0x7fa7e00cd170 2023-11-24T08:08:16.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7c80039a0 0x7fa7c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7deffd640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 0x7fa7c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7dffff640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c8004d00 0x7fa7c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7df7fe640 1 -- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 msgr2=0x7fa7c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 0x7fa7c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7df7fe640 1 -- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c8004d00 msgr2=0x7fa7c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c8004d00 0x7fa7c8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7df7fe640 1 -- 172.21.15.97:0/351213837 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8003520 con 0x7fa7c80039a0 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.752+0000 7fa7deffd640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e00cd170 0x7fa7c80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.753+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7c80039a0 0x7fa7c8003dc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000c210 tx=0x7fa7c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a27dfbe5731a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0005ad0 con 0x7fa7c80039a0 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0005c50 con 0x7fa7c80039a0 2023-11-24T08:08:16.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7de7fc640 1 -- 172.21.15.97:0/351213837 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d002c890 con 0x7fa7c80039a0 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7e6168640 1 -- 172.21.15.97:0/351213837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7c80039a0 msgr2=0x7fa7c8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7e6168640 1 --2- 172.21.15.97:0/351213837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7c80039a0 0x7fa7c8003dc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000c210 tx=0x7fa7c80057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7dffff640 1 -- 172.21.15.97:0/351213837 reap_dead start 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7e6168640 1 -- 172.21.15.97:0/351213837 shutdown_connections 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7e6168640 1 -- 172.21.15.97:0/351213837 >> 172.21.15.97:0/351213837 conn(0x7fa7e006a800 msgr2=0x7fa7e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:16.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7e6168640 1 -- 172.21.15.97:0/351213837 shutdown_connections 2023-11-24T08:08:16.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.754+0000 7fa7e6168640 1 -- 172.21.15.97:0/351213837 wait complete. 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.756+0000 7fa7e6168640 1 Processor -- start 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.756+0000 7fa7e6168640 1 -- start start 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.757+0000 7fa7e6168640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c80039a0 0x7fa7e01f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.757+0000 7fa7e6168640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e006cbe0 0x7fa7e01f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.757+0000 7fa7e6168640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e0141f50 0x7fa7e00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.757+0000 7fa7e6168640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01f4bc0 con 0x7fa7e0141f50 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.757+0000 7fa7e6168640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e013f840 con 0x7fa7c80039a0 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.757+0000 7fa7e6168640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01417c0 con 0x7fa7e006cbe0 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e0141f50 0x7fa7e00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e0141f50 0x7fa7e00cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34638/0 (socket says 172.21.15.97:34638) 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 -- 172.21.15.97:0/3528035817 learned_addr learned my addr 172.21.15.97:0/3528035817 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7deffd640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e006cbe0 0x7fa7e01f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c80039a0 0x7fa7e01f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 -- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e006cbe0 msgr2=0x7fa7e01f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e006cbe0 0x7fa7e01f7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 -- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c80039a0 msgr2=0x7fa7e01f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c80039a0 0x7fa7e01f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 -- 172.21.15.97:0/3528035817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e01f80f0 con 0x7fa7e0141f50 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7deffd640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e006cbe0 0x7fa7e01f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7dffff640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e0141f50 0x7fa7e00cdbd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00cd600 tx=0x7fa7d800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.758+0000 7fa7c7fff640 1 -- 172.21.15.97:0/3528035817 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8017400 con 0x7fa7e0141f50 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.759+0000 7fa7c7fff640 1 -- 172.21.15.97:0/3528035817 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8011040 con 0x7fa7e0141f50 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.759+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e013fa90 con 0x7fa7e0141f50 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.759+0000 7fa7c7fff640 1 -- 172.21.15.97:0/3528035817 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80177a0 con 0x7fa7e0141f50 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.759+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e0141a30 con 0x7fa7e0141f50 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.760+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e0141620 con 0x7fa7e0141f50 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.761+0000 7fa7c7fff640 1 -- 172.21.15.97:0/3528035817 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7d8017900 con 0x7fa7e0141f50 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.762+0000 7fa7c7fff640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa7cc06ae70 0x7fa7cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.762+0000 7fa7c7fff640 1 -- 172.21.15.97:0/3528035817 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7d8089770 con 0x7fa7e0141f50 2023-11-24T08:08:16.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.762+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa7cc06ae70 0x7fa7cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.763+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa7cc06ae70 0x7fa7cc06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0034000 tx=0x7fa7d0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.768+0000 7fa7c7fff640 1 -- 172.21.15.97:0/3528035817 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7e0141620 con 0x7fa7e0141f50 2023-11-24T08:08:16.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.958+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7e0141620 con 0x7fa7e0141f50 2023-11-24T08:08:16.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.961+0000 7fa7c7fff640 1 -- 172.21.15.97:0/3528035817 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fa7e0141620 con 0x7fa7e0141f50 2023-11-24T08:08:16.964 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:16.964 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:04.217727+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:16.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa7cc06ae70 msgr2=0x7fa7cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa7cc06ae70 0x7fa7cc06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0034000 tx=0x7fa7d0009030 comp rx=0 tx=0).stop 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e0141f50 msgr2=0x7fa7e00cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e0141f50 0x7fa7e00cdbd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00cd600 tx=0x7fa7d800f4a0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 shutdown_connections 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa7cc06ae70 0x7fa7cc06d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e0141f50 0x7fa7e00cdbd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7e006cbe0 0x7fa7e01f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 --2- 172.21.15.97:0/3528035817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7c80039a0 0x7fa7e01f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.964+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 >> 172.21.15.97:0/3528035817 conn(0x7fa7e006a800 msgr2=0x7fa7e00b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:16.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.965+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 shutdown_connections 2023-11-24T08:08:16.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:16.965+0000 7fa7e6168640 1 -- 172.21.15.97:0/3528035817 wait complete. 2023-11-24T08:08:16.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:08:00.468087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:08:01.668047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:08:16.987 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:08:17.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.200+0000 7f52e97d5640 1 Processor -- start 2023-11-24T08:08:17.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.200+0000 7f52e97d5640 1 -- start start 2023-11-24T08:08:17.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e97d5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f52e40cf9a0 0x7f52e4166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e97d5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e415c5f0 con 0x7f52e413e360 2023-11-24T08:08:17.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e97d5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e406c470 con 0x7f52e413df80 2023-11-24T08:08:17.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e97d5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e406c750 con 0x7f52e40cf9a0 2023-11-24T08:08:17.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e27fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f52e413e360 0x7f52e40cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51884/0 (socket says 172.21.15.97:51884) 2023-11-24T08:08:17.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e27fc640 1 -- 172.21.15.97:0/2286287453 learned_addr learned my addr 172.21.15.97:0/2286287453 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e37fe640 1 --2- 172.21.15.97:0/2286287453 >> v2:172.21.15.183:3300/0 conn(0x7f52e40cf9a0 0x7f52e4166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733696619 0 0) 0x7f52e415c5f0 con 0x7f52e413e360 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.202+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52cc003520 con 0x7f52e413e360 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 360071910 0 0) 0x7f52cc003520 con 0x7f52e413e360 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 >> v2:172.21.15.183:3300/0 conn(0x7f52e40cf9a0 msgr2=0x7f52e4166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 --2- 172.21.15.97:0/2286287453 >> v2:172.21.15.183:3300/0 conn(0x7f52e40cf9a0 0x7f52e4166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 >> v1:172.21.15.183:6789/0 conn(0x7f52e413df80 legacy=0x7f52e415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e406ca30 con 0x7f52e413e360 2023-11-24T08:08:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f52d8001670 con 0x7f52e413e360 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 >> v1:172.21.15.97:6789/0 conn(0x7f52e413e360 legacy=0x7f52e40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52cc0039c0 0x7f52cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52cc0047c0 0x7f52cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0051d0 0x7f52cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e406c750 con 0x7f52cc0047c0 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc00c120 con 0x7f52cc0051d0 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc00c2e0 con 0x7f52cc0039c0 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e37fe640 1 --2- 172.21.15.97:0/2286287453 >> v2:172.21.15.183:3300/0 conn(0x7f52e40cf9a0 0x7f52e4166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.203+0000 7f52e27fc640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52cc0047c0 0x7f52cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e2ffd640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52cc0039c0 0x7f52cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e37fe640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0051d0 0x7f52cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e27fc640 1 -- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52cc0039c0 msgr2=0x7f52cc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e27fc640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52cc0039c0 0x7f52cc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e27fc640 1 -- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0051d0 msgr2=0x7f52cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e27fc640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0051d0 0x7f52cc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e37fe640 1 -- 172.21.15.97:0/2286287453 reap_dead start 2023-11-24T08:08:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.204+0000 7f52e27fc640 1 -- 172.21.15.97:0/2286287453 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc003520 con 0x7f52cc0047c0 2023-11-24T08:08:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.205+0000 7f52e27fc640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52cc0047c0 0x7f52cc004c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f52e40cc790 tx=0x7f52cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21721dc410388c43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.205+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8005ad0 con 0x7f52cc0047c0 2023-11-24T08:08:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.205+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d8005c30 con 0x7f52cc0047c0 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.205+0000 7f52e1ffb640 1 -- 172.21.15.97:0/2286287453 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d802ca00 con 0x7f52cc0047c0 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.206+0000 7f52e97d5640 1 -- 172.21.15.97:0/2286287453 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52cc0047c0 msgr2=0x7f52cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.206+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52cc0047c0 0x7f52cc004c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f52e40cc790 tx=0x7f52cc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.206+0000 7f52e97d5640 1 -- 172.21.15.97:0/2286287453 shutdown_connections 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.206+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2286287453 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52cc0047c0 0x7f52cc004c40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.206+0000 7f52e97d5640 1 -- 172.21.15.97:0/2286287453 >> 172.21.15.97:0/2286287453 conn(0x7f52e406a800 msgr2=0x7f52e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.206+0000 7f52e97d5640 1 -- 172.21.15.97:0/2286287453 shutdown_connections 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.206+0000 7f52e97d5640 1 -- 172.21.15.97:0/2286287453 wait complete. 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.208+0000 7f52e97d5640 1 Processor -- start 2023-11-24T08:08:17.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.208+0000 7f52e97d5640 1 -- start start 2023-11-24T08:08:17.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e97d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0047c0 0x7f52e40b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e97d5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52e40b2960 0x7f52e414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e97d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52e414bf80 0x7f52e40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e97d5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e414c400 con 0x7f52e40b2960 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e97d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40b2e70 con 0x7f52cc0047c0 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e97d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40b3150 con 0x7f52e414bf80 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52e40b2960 0x7f52e414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52e40b2960 0x7f52e414ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34648/0 (socket says 172.21.15.97:34648) 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e27fc640 1 -- 172.21.15.97:0/2096056521 learned_addr learned my addr 172.21.15.97:0/2096056521 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.209+0000 7f52e37fe640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52e414bf80 0x7f52e40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e27fc640 1 -- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52e414bf80 msgr2=0x7f52e40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e2ffd640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0047c0 0x7f52e40b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e27fc640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52e414bf80 0x7f52e40702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e27fc640 1 -- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0047c0 msgr2=0x7f52e40b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e27fc640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0047c0 0x7f52e40b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e27fc640 1 -- 172.21.15.97:0/2096056521 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40b3430 con 0x7f52e40b2960 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e37fe640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52e414bf80 0x7f52e40702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e27fc640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52e40b2960 0x7f52e414ba40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f52d802c360 tx=0x7f52d802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52cb7fe640 1 -- 172.21.15.97:0/2096056521 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d803c040 con 0x7f52e40b2960 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52cb7fe640 1 -- 172.21.15.97:0/2096056521 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d802cd10 con 0x7f52e40b2960 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e40b3710 con 0x7f52e40b2960 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52cb7fe640 1 -- 172.21.15.97:0/2096056521 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8007270 con 0x7f52e40b2960 2023-11-24T08:08:17.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.210+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e414dd40 con 0x7f52e40b2960 2023-11-24T08:08:17.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.212+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e40675d0 con 0x7f52e40b2960 2023-11-24T08:08:17.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.212+0000 7f52cb7fe640 1 -- 172.21.15.97:0/2096056521 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52d8032070 con 0x7f52e40b2960 2023-11-24T08:08:17.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.213+0000 7f52cb7fe640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52d006ae70 0x7f52d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.213+0000 7f52cb7fe640 1 -- 172.21.15.97:0/2096056521 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52d80aacc0 con 0x7f52e40b2960 2023-11-24T08:08:17.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.214+0000 7f52e2ffd640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52d006ae70 0x7f52d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.214+0000 7f52e2ffd640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52d006ae70 0x7f52d006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001550 tx=0x7f52d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.218+0000 7f52cb7fe640 1 -- 172.21.15.97:0/2096056521 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52d80b1080 con 0x7f52e40b2960 2023-11-24T08:08:17.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.408+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52e406df00 con 0x7f52e40b2960 2023-11-24T08:08:17.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.409+0000 7f52cb7fe640 1 -- 172.21.15.97:0/2096056521 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52d8046070 con 0x7f52e40b2960 2023-11-24T08:08:17.411 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:08:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52d006ae70 msgr2=0x7f52d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52d006ae70 0x7f52d006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001550 tx=0x7f52d4009040 comp rx=0 tx=0).stop 2023-11-24T08:08:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52e40b2960 msgr2=0x7f52e414ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52e40b2960 0x7f52e414ba40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f52d802c360 tx=0x7f52d802e070 comp rx=0 tx=0).stop 2023-11-24T08:08:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 shutdown_connections 2023-11-24T08:08:17.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f52d006ae70 0x7f52d006d330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52e414bf80 0x7f52e40702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52e40b2960 0x7f52e414ba40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 --2- 172.21.15.97:0/2096056521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52cc0047c0 0x7f52e40b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 >> 172.21.15.97:0/2096056521 conn(0x7f52e406a800 msgr2=0x7f52e415de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 shutdown_connections 2023-11-24T08:08:17.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.412+0000 7f52e97d5640 1 -- 172.21.15.97:0/2096056521 wait complete. 2023-11-24T08:08:17.433 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:08:17.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.648+0000 7fdaa2013640 1 Processor -- start 2023-11-24T08:08:17.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.648+0000 7fdaa2013640 1 -- start start 2023-11-24T08:08:17.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa2013640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fda9c0ccb50 0x7fda9c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa2013640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda9c15bf10 0x7fda9c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa2013640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c15f4e0 con 0x7fda9c0adf20 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa2013640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c15f970 con 0x7fda9c0ccb50 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa2013640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c071130 con 0x7fda9c15bf10 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa0810640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fda9c0ccb50 0x7fda9c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa0810640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fda9c0ccb50 0x7fda9c070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34660/0 (socket says 172.21.15.97:34660) 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa0810640 1 -- 172.21.15.97:0/1357703218 learned_addr learned my addr 172.21.15.97:0/1357703218 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:17.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.650+0000 7fdaa1011640 1 --1- 172.21.15.97:0/1357703218 >> v1:172.21.15.97:6789/0 conn(0x7fda9c0adf20 0x7fda9c0cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51892/0 (socket says 172.21.15.97:51892) 2023-11-24T08:08:17.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.651+0000 7fdaa0810640 1 -- 172.21.15.97:0/1357703218 >> v2:172.21.15.183:3300/0 conn(0x7fda9c15bf10 msgr2=0x7fda9c143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:17.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.651+0000 7fdaa0810640 1 --2- 172.21.15.97:0/1357703218 >> v2:172.21.15.183:3300/0 conn(0x7fda9c15bf10 0x7fda9c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.651+0000 7fdaa0810640 1 -- 172.21.15.97:0/1357703218 >> v1:172.21.15.97:6789/0 conn(0x7fda9c0adf20 legacy=0x7fda9c0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.651+0000 7fdaa0810640 1 -- 172.21.15.97:0/1357703218 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c15ebb0 con 0x7fda9c0ccb50 2023-11-24T08:08:17.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.652+0000 7fdaa0810640 1 --2- 172.21.15.97:0/1357703218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0ccb50 0x7fda9c070a30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06ff20 tx=0x7fda8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7b723cdd24fcf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.652+0000 7fda93fff640 1 -- 172.21.15.97:0/1357703218 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031870 con 0x7fda9c0ccb50 2023-11-24T08:08:17.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.652+0000 7fda93fff640 1 -- 172.21.15.97:0/1357703218 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c0319d0 con 0x7fda9c0ccb50 2023-11-24T08:08:17.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.652+0000 7fda93fff640 1 -- 172.21.15.97:0/1357703218 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031d60 con 0x7fda9c0ccb50 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.652+0000 7fdaa2013640 1 -- 172.21.15.97:0/1357703218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0ccb50 msgr2=0x7fda9c070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.652+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1357703218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0ccb50 0x7fda9c070a30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06ff20 tx=0x7fda8c02b910 comp rx=0 tx=0).stop 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.653+0000 7fdaa2013640 1 -- 172.21.15.97:0/1357703218 shutdown_connections 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.653+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1357703218 >> v2:172.21.15.183:3300/0 conn(0x7fda9c15bf10 0x7fda9c143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.653+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1357703218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0ccb50 0x7fda9c070a30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.653+0000 7fdaa2013640 1 -- 172.21.15.97:0/1357703218 >> 172.21.15.97:0/1357703218 conn(0x7fda9c06a7d0 msgr2=0x7fda9c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.653+0000 7fdaa2013640 1 -- 172.21.15.97:0/1357703218 shutdown_connections 2023-11-24T08:08:17.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.653+0000 7fdaa2013640 1 -- 172.21.15.97:0/1357703218 wait complete. 2023-11-24T08:08:17.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.654+0000 7fdaa2013640 1 Processor -- start 2023-11-24T08:08:17.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.654+0000 7fdaa2013640 1 -- start start 2023-11-24T08:08:17.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.655+0000 7fdaa2013640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0adf20 0x7fda9c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.655+0000 7fdaa2013640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0ccb50 0x7fda9c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.655+0000 7fdaa2013640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c15bf10 0x7fda9c071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.655+0000 7fdaa2013640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0c4840 con 0x7fda9c0adf20 2023-11-24T08:08:17.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.655+0000 7fdaa2013640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0c51a0 con 0x7fda9c15bf10 2023-11-24T08:08:17.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.655+0000 7fdaa2013640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0c3ea0 con 0x7fda9c0ccb50 2023-11-24T08:08:17.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0adf20 0x7fda9c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0adf20 0x7fda9c0c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34674/0 (socket says 172.21.15.97:34674) 2023-11-24T08:08:17.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 -- 172.21.15.97:0/1415737726 learned_addr learned my addr 172.21.15.97:0/1415737726 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 -- 172.21.15.97:0/1415737726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0ccb50 msgr2=0x7fda9c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0ccb50 0x7fda9c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 -- 172.21.15.97:0/1415737726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c15bf10 msgr2=0x7fda9c071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c15bf10 0x7fda9c071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 -- 172.21.15.97:0/1415737726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0094d0 con 0x7fda9c0adf20 2023-11-24T08:08:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.656+0000 7fdaa1011640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0adf20 0x7fda9c0c4c60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c4d0 tx=0x7fda9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.657+0000 7fda91ffb640 1 -- 172.21.15.97:0/1415737726 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98007480 con 0x7fda9c0adf20 2023-11-24T08:08:17.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.657+0000 7fda91ffb640 1 -- 172.21.15.97:0/1415737726 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda980075e0 con 0x7fda9c0adf20 2023-11-24T08:08:17.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.657+0000 7fda91ffb640 1 -- 172.21.15.97:0/1415737726 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980049e0 con 0x7fda9c0adf20 2023-11-24T08:08:17.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.657+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c0c4180 con 0x7fda9c0adf20 2023-11-24T08:08:17.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.657+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c15ac20 con 0x7fda9c0adf20 2023-11-24T08:08:17.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.658+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0c4980 con 0x7fda9c0adf20 2023-11-24T08:08:17.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.659+0000 7fda91ffb640 1 -- 172.21.15.97:0/1415737726 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda98004b40 con 0x7fda9c0adf20 2023-11-24T08:08:17.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.660+0000 7fda91ffb640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fda8006ae40 0x7fda8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.660+0000 7fda91ffb640 1 -- 172.21.15.97:0/1415737726 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda98088690 con 0x7fda9c0adf20 2023-11-24T08:08:17.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.660+0000 7fdaa0810640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fda8006ae40 0x7fda8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.661+0000 7fdaa0810640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fda8006ae40 0x7fda8006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda8c036000 tx=0x7fda8c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.664+0000 7fda91ffb640 1 -- 172.21.15.97:0/1415737726 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda980537e0 con 0x7fda9c0adf20 2023-11-24T08:08:17.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.852+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda9c067450 con 0x7fda9c0adf20 2023-11-24T08:08:17.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.853+0000 7fda91ffb640 1 -- 172.21.15.97:0/1415737726 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda98056e00 con 0x7fda9c0adf20 2023-11-24T08:08:17.855 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fda8006ae40 msgr2=0x7fda8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fda8006ae40 0x7fda8006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda8c036000 tx=0x7fda8c030000 comp rx=0 tx=0).stop 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0adf20 msgr2=0x7fda9c0c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0adf20 0x7fda9c0c4c60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c4d0 tx=0x7fda9800c990 comp rx=0 tx=0).stop 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 shutdown_connections 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fda8006ae40 0x7fda8006d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda9c15bf10 0x7fda9c071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda9c0ccb50 0x7fda9c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 --2- 172.21.15.97:0/1415737726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda9c0adf20 0x7fda9c0c4c60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 >> 172.21.15.97:0/1415737726 conn(0x7fda9c06a7d0 msgr2=0x7fda9c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 shutdown_connections 2023-11-24T08:08:17.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:17.856+0000 7fdaa2013640 1 -- 172.21.15.97:0/1415737726 wait complete. 2023-11-24T08:08:17.876 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:08:18.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.079+0000 7f50e17c5640 1 Processor -- start 2023-11-24T08:08:18.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.079+0000 7f50e17c5640 1 -- start start 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50e17c5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50dc13df80 0x7f50dc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50e17c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f50dc13e360 0x7f50dc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50e17c5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc06c470 con 0x7f50dc15f9c0 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50e17c5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc06c750 con 0x7f50dc13e360 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50e17c5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc06ca30 con 0x7f50dc13df80 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50d3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f50dc13e360 0x7f50dc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50d3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f50dc13e360 0x7f50dc0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34684/0 (socket says 172.21.15.97:34684) 2023-11-24T08:08:18.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.081+0000 7f50d3fff640 1 -- 172.21.15.97:0/806057157 learned_addr learned my addr 172.21.15.97:0/806057157 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:18.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.082+0000 7f50daffd640 1 --2- 172.21.15.97:0/806057157 >> v2:172.21.15.183:3300/0 conn(0x7f50dc13df80 0x7f50dc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.082+0000 7f50d3fff640 1 -- 172.21.15.97:0/806057157 >> v2:172.21.15.183:3300/0 conn(0x7f50dc13df80 msgr2=0x7f50dc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:18.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.082+0000 7f50d3fff640 1 --2- 172.21.15.97:0/806057157 >> v2:172.21.15.183:3300/0 conn(0x7f50dc13df80 0x7f50dc15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.082+0000 7f50d3fff640 1 -- 172.21.15.97:0/806057157 >> v1:172.21.15.97:6789/0 conn(0x7f50dc15f9c0 legacy=0x7f50dc1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.082+0000 7f50d3fff640 1 -- 172.21.15.97:0/806057157 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc06cd10 con 0x7f50dc13e360 2023-11-24T08:08:18.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.083+0000 7f50d3fff640 1 --2- 172.21.15.97:0/806057157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc13e360 0x7f50dc0cf290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f50dc072770 tx=0x7f50c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3390cd7401365f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:18.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.083+0000 7f50da7fc640 1 -- 172.21.15.97:0/806057157 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4030860 con 0x7f50dc13e360 2023-11-24T08:08:18.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.083+0000 7f50da7fc640 1 -- 172.21.15.97:0/806057157 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c40309c0 con 0x7f50dc13e360 2023-11-24T08:08:18.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.083+0000 7f50da7fc640 1 -- 172.21.15.97:0/806057157 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4030d50 con 0x7f50dc13e360 2023-11-24T08:08:18.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 -- 172.21.15.97:0/806057157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc13e360 msgr2=0x7f50dc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 --2- 172.21.15.97:0/806057157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc13e360 0x7f50dc0cf290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f50dc072770 tx=0x7f50c402b9a0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 -- 172.21.15.97:0/806057157 shutdown_connections 2023-11-24T08:08:18.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 --2- 172.21.15.97:0/806057157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc13e360 0x7f50dc0cf290 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 --2- 172.21.15.97:0/806057157 >> v2:172.21.15.183:3300/0 conn(0x7f50dc13df80 0x7f50dc15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 -- 172.21.15.97:0/806057157 >> 172.21.15.97:0/806057157 conn(0x7f50dc06a800 msgr2=0x7f50dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:18.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 -- 172.21.15.97:0/806057157 shutdown_connections 2023-11-24T08:08:18.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.084+0000 7f50e17c5640 1 -- 172.21.15.97:0/806057157 wait complete. 2023-11-24T08:08:18.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.086+0000 7f50e17c5640 1 Processor -- start 2023-11-24T08:08:18.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.086+0000 7f50e17c5640 1 -- start start 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50e17c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc13df80 0x7f50dc15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50e17c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc13e360 0x7f50dc13d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50e17c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc15f9c0 0x7f50dc15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50e17c5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc15b150 con 0x7f50dc15f9c0 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50e17c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1e7120 con 0x7f50dc13e360 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50e17c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0a8660 con 0x7f50dc13df80 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc15f9c0 0x7f50dc15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc15f9c0 0x7f50dc15ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34700/0 (socket says 172.21.15.97:34700) 2023-11-24T08:08:18.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 -- 172.21.15.97:0/2320386175 learned_addr learned my addr 172.21.15.97:0/2320386175 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 -- 172.21.15.97:0/2320386175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc13df80 msgr2=0x7f50dc15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc13df80 0x7f50dc15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 -- 172.21.15.97:0/2320386175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc13e360 msgr2=0x7f50dc13d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc13e360 0x7f50dc13d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.087+0000 7f50db7fe640 1 -- 172.21.15.97:0/2320386175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40094d0 con 0x7f50dc15f9c0 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.088+0000 7f50db7fe640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc15f9c0 0x7f50dc15ce60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c790 tx=0x7f50d400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.088+0000 7f50d37fe640 1 -- 172.21.15.97:0/2320386175 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d400cea0 con 0x7f50dc15f9c0 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.088+0000 7f50d37fe640 1 -- 172.21.15.97:0/2320386175 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4003b70 con 0x7f50dc15f9c0 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.088+0000 7f50d37fe640 1 -- 172.21.15.97:0/2320386175 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d400a850 con 0x7f50dc15f9c0 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.088+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc13d590 con 0x7f50dc15f9c0 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.088+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc13daa0 con 0x7f50dc15f9c0 2023-11-24T08:08:18.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.089+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc0675d0 con 0x7f50dc15f9c0 2023-11-24T08:08:18.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.090+0000 7f50d37fe640 1 -- 172.21.15.97:0/2320386175 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50d400a9b0 con 0x7f50dc15f9c0 2023-11-24T08:08:18.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.091+0000 7f50d37fe640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f50bc06ae40 0x7f50bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.091+0000 7f50d37fe640 1 -- 172.21.15.97:0/2320386175 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50d40893d0 con 0x7f50dc15f9c0 2023-11-24T08:08:18.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.091+0000 7f50daffd640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f50bc06ae40 0x7f50bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.092+0000 7f50daffd640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f50bc06ae40 0x7f50bc06d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00a810 tx=0x7f50cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:18.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.095+0000 7f50d37fe640 1 -- 172.21.15.97:0/2320386175 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50d4054350 con 0x7f50dc15f9c0 2023-11-24T08:08:18.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.274+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50dc13d590 con 0x7f50dc15f9c0 2023-11-24T08:08:18.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.275+0000 7f50d37fe640 1 -- 172.21.15.97:0/2320386175 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50dc13d590 con 0x7f50dc15f9c0 2023-11-24T08:08:18.276 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:08:18.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f50bc06ae40 msgr2=0x7f50bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f50bc06ae40 0x7f50bc06d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00a810 tx=0x7f50cc008040 comp rx=0 tx=0).stop 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc15f9c0 msgr2=0x7f50dc15ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc15f9c0 0x7f50dc15ce60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c790 tx=0x7f50d400cc50 comp rx=0 tx=0).stop 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 shutdown_connections 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f50bc06ae40 0x7f50bc06d300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50dc15f9c0 0x7f50dc15ce60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.277+0000 7f50e17c5640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc13e360 0x7f50dc13d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.278+0000 7f50e17c5640 1 --2- 172.21.15.97:0/2320386175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc13df80 0x7f50dc15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.278+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 >> 172.21.15.97:0/2320386175 conn(0x7f50dc06a800 msgr2=0x7f50dc153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.278+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 shutdown_connections 2023-11-24T08:08:18.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.278+0000 7f50e17c5640 1 -- 172.21.15.97:0/2320386175 wait complete. 2023-11-24T08:08:18.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:08:18.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.506+0000 7f58d0161640 1 Processor -- start 2023-11-24T08:08:18.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.506+0000 7f58d0161640 1 -- start start 2023-11-24T08:08:18.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.508+0000 7f58d0161640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f58c815e3b0 0x7f58c8164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.508+0000 7f58d0161640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c80b1ee0 con 0x7f58c8143ae0 2023-11-24T08:08:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.508+0000 7f58d0161640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c80b2780 con 0x7f58c80cf9a0 2023-11-24T08:08:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.508+0000 7f58d0161640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c815e990 con 0x7f58c815e3b0 2023-11-24T08:08:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.508+0000 7f58cdefd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f58c8143ae0 0x7f58c80cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51914/0 (socket says 172.21.15.97:51914) 2023-11-24T08:08:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.508+0000 7f58cdefd640 1 -- 172.21.15.97:0/2900289394 learned_addr learned my addr 172.21.15.97:0/2900289394 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ce6fe640 1 --2- 172.21.15.97:0/2900289394 >> v2:172.21.15.183:3300/0 conn(0x7f58c815e3b0 0x7f58c8164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417560115 0 0) 0x7f58c80b1ee0 con 0x7f58c8143ae0 2023-11-24T08:08:18.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b4005730 con 0x7f58c8143ae0 2023-11-24T08:08:18.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100822246 0 0) 0x7f58b4005730 con 0x7f58c8143ae0 2023-11-24T08:08:18.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 >> v2:172.21.15.183:3300/0 conn(0x7f58c815e3b0 msgr2=0x7f58c8164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 --2- 172.21.15.97:0/2900289394 >> v2:172.21.15.183:3300/0 conn(0x7f58c815e3b0 0x7f58c8164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 >> v1:172.21.15.183:6789/0 conn(0x7f58c80cf9a0 legacy=0x7f58c815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80b2130 con 0x7f58c8143ae0 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f58c4001670 con 0x7f58c8143ae0 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.509+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 >> v1:172.21.15.97:6789/0 conn(0x7f58c8143ae0 legacy=0x7f58c80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ccefb640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b4005b80 0x7f58b4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ccefb640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58b40069d0 0x7f58b4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ccefb640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58b4007390 0x7f58b400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c815e990 con 0x7f58b40069d0 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b400e230 con 0x7f58b4007390 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b400e3f0 con 0x7f58b4005b80 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58cd6fc640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58b40069d0 0x7f58b4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58cdefd640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b4005b80 0x7f58b4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58cd6fc640 1 -- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b4005b80 msgr2=0x7f58b4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ce6fe640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58b4007390 0x7f58b400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58cd6fc640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b4005b80 0x7f58b4005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58cd6fc640 1 -- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58b4007390 msgr2=0x7f58b400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58cd6fc640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58b4007390 0x7f58b400db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58cd6fc640 1 -- 172.21.15.97:0/2900289394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4005730 con 0x7f58b40069d0 2023-11-24T08:08:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.510+0000 7f58ce6fe640 1 -- 172.21.15.97:0/2900289394 reap_dead start 2023-11-24T08:08:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.511+0000 7f58cd6fc640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58b40069d0 0x7f58b4006e50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f58b8001750 tx=0x7f58b4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1057b0519896125 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80052d0 con 0x7f58b40069d0 2023-11-24T08:08:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b802e050 con 0x7f58b40069d0 2023-11-24T08:08:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58ccefb640 1 -- 172.21.15.97:0/2900289394 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8003830 con 0x7f58b40069d0 2023-11-24T08:08:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58d0161640 1 -- 172.21.15.97:0/2900289394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58b40069d0 msgr2=0x7f58b4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58d0161640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58b40069d0 0x7f58b4006e50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f58b8001750 tx=0x7f58b4007a00 comp rx=0 tx=0).stop 2023-11-24T08:08:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58d0161640 1 -- 172.21.15.97:0/2900289394 shutdown_connections 2023-11-24T08:08:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58d0161640 1 --2- 172.21.15.97:0/2900289394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58b40069d0 0x7f58b4006e50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.512+0000 7f58d0161640 1 -- 172.21.15.97:0/2900289394 >> 172.21.15.97:0/2900289394 conn(0x7f58c806a800 msgr2=0x7f58c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.513+0000 7f58d0161640 1 -- 172.21.15.97:0/2900289394 shutdown_connections 2023-11-24T08:08:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.513+0000 7f58d0161640 1 -- 172.21.15.97:0/2900289394 wait complete. 2023-11-24T08:08:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.514+0000 7f58d0161640 1 Processor -- start 2023-11-24T08:08:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.514+0000 7f58d0161640 1 -- start start 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.515+0000 7f58d0161640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b40069d0 0x7f58c80af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.515+0000 7f58d0161640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c80af920 0x7f58c81f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.515+0000 7f58d0161640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c81f6600 0x7f58c80c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.515+0000 7f58d0161640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c815be90 con 0x7f58c80af920 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.515+0000 7f58d0161640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80afda0 con 0x7f58c81f6600 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.515+0000 7f58d0161640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c815b530 con 0x7f58b40069d0 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c80af920 0x7f58c81f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c80af920 0x7f58c81f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34724/0 (socket says 172.21.15.97:34724) 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 -- 172.21.15.97:0/3078918525 learned_addr learned my addr 172.21.15.97:0/3078918525 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cdefd640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b40069d0 0x7f58c80af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58ce6fe640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c81f6600 0x7f58c80c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 -- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b40069d0 msgr2=0x7f58c80af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b40069d0 0x7f58c80af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 -- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c81f6600 msgr2=0x7f58c80c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c81f6600 0x7f58c80c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58cd6fc640 1 -- 172.21.15.97:0/3078918525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c81f6e40 con 0x7f58c80af920 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.516+0000 7f58ce6fe640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c81f6600 0x7f58c80c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.517+0000 7f58cd6fc640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c80af920 0x7f58c81f60c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f58b802bc00 tx=0x7f58b8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.517+0000 7f58be7fc640 1 -- 172.21.15.97:0/3078918525 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80076c0 con 0x7f58c80af920 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.517+0000 7f58be7fc640 1 -- 172.21.15.97:0/3078918525 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8007a30 con 0x7f58c80af920 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.517+0000 7f58be7fc640 1 -- 172.21.15.97:0/3078918525 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8006be0 con 0x7f58c80af920 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.517+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c815b7d0 con 0x7f58c80af920 2023-11-24T08:08:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.517+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c81f6a80 con 0x7f58c80af920 2023-11-24T08:08:18.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.518+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c81f6c10 con 0x7f58c80af920 2023-11-24T08:08:18.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.519+0000 7f58be7fc640 1 -- 172.21.15.97:0/3078918525 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58b8006d40 con 0x7f58c80af920 2023-11-24T08:08:18.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.520+0000 7f58be7fc640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f58ac06ae40 0x7f58ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:18.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.520+0000 7f58be7fc640 1 -- 172.21.15.97:0/3078918525 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58b80ab1e0 con 0x7f58c80af920 2023-11-24T08:08:18.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.520+0000 7f58cdefd640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f58ac06ae40 0x7f58ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:18.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.521+0000 7f58cdefd640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f58ac06ae40 0x7f58ac06d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58c4001200 tx=0x7f58c4001530 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:18.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.525+0000 7f58be7fc640 1 -- 172.21.15.97:0/3078918525 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58b8076280 con 0x7f58c80af920 2023-11-24T08:08:18.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.729+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f58c815c100 con 0x7f58c80af920 2023-11-24T08:08:18.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.729+0000 7f58be7fc640 1 -- 172.21.15.97:0/3078918525 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f58b80798a0 con 0x7f58c80af920 2023-11-24T08:08:18.731 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f58ac06ae40 msgr2=0x7f58ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f58ac06ae40 0x7f58ac06d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58c4001200 tx=0x7f58c4001530 comp rx=0 tx=0).stop 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c80af920 msgr2=0x7f58c81f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c80af920 0x7f58c81f60c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f58b802bc00 tx=0x7f58b8001120 comp rx=0 tx=0).stop 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 shutdown_connections 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f58ac06ae40 0x7f58ac06d300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58c81f6600 0x7f58c80c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58c80af920 0x7f58c81f60c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 --2- 172.21.15.97:0/3078918525 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58b40069d0 0x7f58c80af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:18.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 >> 172.21.15.97:0/3078918525 conn(0x7f58c806a800 msgr2=0x7f58c80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:18.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 shutdown_connections 2023-11-24T08:08:18.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:18.732+0000 7f58d0161640 1 -- 172.21.15.97:0/3078918525 wait complete. 2023-11-24T08:08:18.753 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi097.front.sepia.ceph.com... 2023-11-24T08:08:18.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:18.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T08:08:18.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi097.stderr:ceph-fuse[102312]: fuse finished with error 0 and tester_r 0 2023-11-24T08:08:18.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:08:18.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:18.847 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:08:19.022 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:08:19.022 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:19.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:19.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.307+0000 7fb39811d640 1 Processor -- start 2023-11-24T08:08:19.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.307+0000 7fb39811d640 1 -- start start 2023-11-24T08:08:19.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.308+0000 7fb39811d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb390143ae0 0x7fb3900cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.308+0000 7fb39811d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb3900cf7d0 0x7fb39015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.308+0000 7fb39811d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3900cfc30 con 0x7fb39015e1e0 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.308+0000 7fb39811d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900b1ee0 con 0x7fb390143ae0 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.308+0000 7fb39811d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900b2780 con 0x7fb3900cf7d0 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb395eb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb390143ae0 0x7fb3900cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb395eb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb390143ae0 0x7fb3900cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34736/0 (socket says 172.21.15.97:34736) 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb395eb9640 1 -- 172.21.15.97:0/919358399 learned_addr learned my addr 172.21.15.97:0/919358399 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb3956b8640 1 --2- 172.21.15.97:0/919358399 >> v2:172.21.15.183:3300/0 conn(0x7fb3900cf7d0 0x7fb39015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb395eb9640 1 -- 172.21.15.97:0/919358399 >> v2:172.21.15.183:3300/0 conn(0x7fb3900cf7d0 msgr2=0x7fb39015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb395eb9640 1 --2- 172.21.15.97:0/919358399 >> v2:172.21.15.183:3300/0 conn(0x7fb3900cf7d0 0x7fb39015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb395eb9640 1 -- 172.21.15.97:0/919358399 >> v1:172.21.15.183:6789/0 conn(0x7fb39015e1e0 legacy=0x7fb39015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:19.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.309+0000 7fb395eb9640 1 -- 172.21.15.97:0/919358399 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39015e990 con 0x7fb390143ae0 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.310+0000 7fb395eb9640 1 --2- 172.21.15.97:0/919358399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb390143ae0 0x7fb3900cf290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cb830 tx=0x7fb38c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2566ef0f7c16b2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.310+0000 7fb394eb7640 1 -- 172.21.15.97:0/919358399 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c031870 con 0x7fb390143ae0 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.310+0000 7fb394eb7640 1 -- 172.21.15.97:0/919358399 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c0319d0 con 0x7fb390143ae0 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.310+0000 7fb394eb7640 1 -- 172.21.15.97:0/919358399 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c031d60 con 0x7fb390143ae0 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 -- 172.21.15.97:0/919358399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb390143ae0 msgr2=0x7fb3900cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 --2- 172.21.15.97:0/919358399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb390143ae0 0x7fb3900cf290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb3900cb830 tx=0x7fb38c02b910 comp rx=0 tx=0).stop 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 -- 172.21.15.97:0/919358399 shutdown_connections 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 --2- 172.21.15.97:0/919358399 >> v2:172.21.15.183:3300/0 conn(0x7fb3900cf7d0 0x7fb39015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 --2- 172.21.15.97:0/919358399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb390143ae0 0x7fb3900cf290 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 -- 172.21.15.97:0/919358399 >> 172.21.15.97:0/919358399 conn(0x7fb39006a800 msgr2=0x7fb39006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 -- 172.21.15.97:0/919358399 shutdown_connections 2023-11-24T08:08:19.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.311+0000 7fb39811d640 1 -- 172.21.15.97:0/919358399 wait complete. 2023-11-24T08:08:19.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.313+0000 7fb39811d640 1 Processor -- start 2023-11-24T08:08:19.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.313+0000 7fb39811d640 1 -- start start 2023-11-24T08:08:19.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb39811d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900cf7d0 0x7fb39013f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb39811d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390143ae0 0x7fb39013d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb39811d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015e1e0 0x7fb3901662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb39811d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901412d0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb39811d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390141520 con 0x7fb390143ae0 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb39811d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb390141800 con 0x7fb39015e1e0 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb395eb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900cf7d0 0x7fb39013f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb395eb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900cf7d0 0x7fb39013f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34738/0 (socket says 172.21.15.97:34738) 2023-11-24T08:08:19.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb395eb9640 1 -- 172.21.15.97:0/1145681654 learned_addr learned my addr 172.21.15.97:0/1145681654 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.314+0000 7fb3956b8640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390143ae0 0x7fb39013d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb395eb9640 1 -- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015e1e0 msgr2=0x7fb3901662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb3966ba640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015e1e0 0x7fb3901662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb395eb9640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015e1e0 0x7fb3901662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb395eb9640 1 -- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390143ae0 msgr2=0x7fb39013d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb395eb9640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390143ae0 0x7fb39013d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb395eb9640 1 -- 172.21.15.97:0/1145681654 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c0094d0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb3956b8640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390143ae0 0x7fb39013d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb3966ba640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015e1e0 0x7fb3901662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb395eb9640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900cf7d0 0x7fb39013f950 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb38c02b950 tx=0x7fb38c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb3867fc640 1 -- 172.21.15.97:0/1145681654 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c031860 con 0x7fb3900cf7d0 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb3867fc640 1 -- 172.21.15.97:0/1145681654 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c0443f0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb390141ae0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb3867fc640 1 -- 172.21.15.97:0/1145681654 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0447a0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.315+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3901420a0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.317+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3900675d0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.318+0000 7fb3867fc640 1 -- 172.21.15.97:0/1145681654 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb38c04d450 con 0x7fb3900cf7d0 2023-11-24T08:08:19.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.318+0000 7fb3867fc640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb37406ae40 0x7fb37406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.319+0000 7fb3867fc640 1 -- 172.21.15.97:0/1145681654 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb38c02d040 con 0x7fb3900cf7d0 2023-11-24T08:08:19.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.319+0000 7fb3956b8640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb37406ae40 0x7fb37406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.320+0000 7fb3956b8640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb37406ae40 0x7fb37406d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb390140170 tx=0x7fb380008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:19.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.323+0000 7fb3867fc640 1 -- 172.21.15.97:0/1145681654 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb38c076e50 con 0x7fb3900cf7d0 2023-11-24T08:08:19.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.514+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3900ce8e0 con 0x7fb3900cf7d0 2023-11-24T08:08:19.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.516+0000 7fb3867fc640 1 -- 172.21.15.97:0/1145681654 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fb38c035020 con 0x7fb3900cf7d0 2023-11-24T08:08:19.519 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:19.519 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:04.217727+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:19.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb37406ae40 msgr2=0x7fb37406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb37406ae40 0x7fb37406d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb390140170 tx=0x7fb380008040 comp rx=0 tx=0).stop 2023-11-24T08:08:19.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900cf7d0 msgr2=0x7fb39013f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900cf7d0 0x7fb39013f950 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb38c02b950 tx=0x7fb38c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 shutdown_connections 2023-11-24T08:08:19.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb37406ae40 0x7fb37406d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015e1e0 0x7fb3901662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390143ae0 0x7fb39013d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 --2- 172.21.15.97:0/1145681654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900cf7d0 0x7fb39013f950 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 >> 172.21.15.97:0/1145681654 conn(0x7fb39006a800 msgr2=0x7fb39015b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:19.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 shutdown_connections 2023-11-24T08:08:19.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.519+0000 7fb39811d640 1 -- 172.21.15.97:0/1145681654 wait complete. 2023-11-24T08:08:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:08:00.468087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:08:01.668047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:08:19.542 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:08:19.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.755+0000 7fe135d16640 1 Processor -- start 2023-11-24T08:08:19.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.756+0000 7fe135d16640 1 -- start start 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135d16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1300cf9a0 0x7fe1300cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135d16640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1300b31d0 0x7fe1300b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135d16640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1300d0320 con 0x7fe13015d4b0 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135d16640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1300d1c60 con 0x7fe1300b31d0 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135d16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300b2730 con 0x7fe1300cf9a0 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135515640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1300b31d0 0x7fe1300b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135515640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1300b31d0 0x7fe1300b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34744/0 (socket says 172.21.15.97:34744) 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe135515640 1 -- 172.21.15.97:0/3175055300 learned_addr learned my addr 172.21.15.97:0/3175055300 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:19.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.757+0000 7fe12ffff640 1 --2- 172.21.15.97:0/3175055300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1300cf9a0 0x7fe1300cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.758+0000 7fe135515640 1 -- 172.21.15.97:0/3175055300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1300cf9a0 msgr2=0x7fe1300cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:19.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.758+0000 7fe135515640 1 --2- 172.21.15.97:0/3175055300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1300cf9a0 0x7fe1300cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.758+0000 7fe135515640 1 -- 172.21.15.97:0/3175055300 >> v1:172.21.15.183:6789/0 conn(0x7fe13015d4b0 legacy=0x7fe1300d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:19.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.758+0000 7fe135515640 1 -- 172.21.15.97:0/3175055300 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300d1ec0 con 0x7fe1300b31d0 2023-11-24T08:08:19.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.759+0000 7fe135515640 1 --2- 172.21.15.97:0/3175055300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300b31d0 0x7fe1300b3660 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe1280098a0 tx=0x7fe12802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1058a806979c37cc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:19.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.759+0000 7fe12f7fe640 1 -- 172.21.15.97:0/3175055300 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128031640 con 0x7fe1300b31d0 2023-11-24T08:08:19.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.759+0000 7fe12f7fe640 1 -- 172.21.15.97:0/3175055300 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1280317a0 con 0x7fe1300b31d0 2023-11-24T08:08:19.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.759+0000 7fe12f7fe640 1 -- 172.21.15.97:0/3175055300 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128031b30 con 0x7fe1300b31d0 2023-11-24T08:08:19.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 -- 172.21.15.97:0/3175055300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300b31d0 msgr2=0x7fe1300b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 --2- 172.21.15.97:0/3175055300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300b31d0 0x7fe1300b3660 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe1280098a0 tx=0x7fe12802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 -- 172.21.15.97:0/3175055300 shutdown_connections 2023-11-24T08:08:19.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 --2- 172.21.15.97:0/3175055300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300b31d0 0x7fe1300b3660 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 --2- 172.21.15.97:0/3175055300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1300cf9a0 0x7fe1300cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 -- 172.21.15.97:0/3175055300 >> 172.21.15.97:0/3175055300 conn(0x7fe1300d3000 msgr2=0x7fe1300d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:19.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 -- 172.21.15.97:0/3175055300 shutdown_connections 2023-11-24T08:08:19.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.760+0000 7fe135d16640 1 -- 172.21.15.97:0/3175055300 wait complete. 2023-11-24T08:08:19.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.762+0000 7fe135d16640 1 Processor -- start 2023-11-24T08:08:19.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.762+0000 7fe135d16640 1 -- start start 2023-11-24T08:08:19.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe135d16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1300b31d0 0x7fe13015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe135d16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300cf9a0 0x7fe13015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe135d16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe13015d4b0 0x7fe1300b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe135d16640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300cb3f0 con 0x7fe1300cf9a0 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe135d16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13015bb80 con 0x7fe1300b31d0 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe135d16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300caa90 con 0x7fe13015d4b0 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe12ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300cf9a0 0x7fe13015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe12ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300cf9a0 0x7fe13015b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34760/0 (socket says 172.21.15.97:34760) 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.763+0000 7fe12ffff640 1 -- 172.21.15.97:0/1405121380 learned_addr learned my addr 172.21.15.97:0/1405121380 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe134d14640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1300b31d0 0x7fe13015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12ffff640 1 -- 172.21.15.97:0/1405121380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe13015d4b0 msgr2=0x7fe1300b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12ffff640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe13015d4b0 0x7fe1300b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12ffff640 1 -- 172.21.15.97:0/1405121380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1300b31d0 msgr2=0x7fe13015bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12ffff640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1300b31d0 0x7fe13015bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12ffff640 1 -- 172.21.15.97:0/1405121380 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280094d0 con 0x7fe1300cf9a0 2023-11-24T08:08:19.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12ffff640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300cf9a0 0x7fe13015b640 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe11800d5f0 tx=0x7fe11800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:19.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12d7fa640 1 -- 172.21.15.97:0/1405121380 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1180125f0 con 0x7fe1300cf9a0 2023-11-24T08:08:19.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12d7fa640 1 -- 172.21.15.97:0/1405121380 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe118012750 con 0x7fe1300cf9a0 2023-11-24T08:08:19.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe12d7fa640 1 -- 172.21.15.97:0/1405121380 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118012b00 con 0x7fe1300cf9a0 2023-11-24T08:08:19.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1300b8a40 con 0x7fe1300cf9a0 2023-11-24T08:08:19.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.764+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1300cb010 con 0x7fe1300cf9a0 2023-11-24T08:08:19.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.766+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1300cb530 con 0x7fe1300cf9a0 2023-11-24T08:08:19.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.767+0000 7fe12d7fa640 1 -- 172.21.15.97:0/1405121380 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe118012c60 con 0x7fe1300cf9a0 2023-11-24T08:08:19.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.768+0000 7fe12d7fa640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe11006ae40 0x7fe11006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:19.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.768+0000 7fe12d7fa640 1 -- 172.21.15.97:0/1405121380 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe118089ba0 con 0x7fe1300cf9a0 2023-11-24T08:08:19.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.768+0000 7fe134d14640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe11006ae40 0x7fe11006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:19.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.769+0000 7fe134d14640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe11006ae40 0x7fe11006d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe120007bf0 tx=0x7fe120007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:19.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.772+0000 7fe12d7fa640 1 -- 172.21.15.97:0/1405121380 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1300cb530 con 0x7fe1300cf9a0 2023-11-24T08:08:19.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.963+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1300cb530 con 0x7fe1300cf9a0 2023-11-24T08:08:19.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.964+0000 7fe12d7fa640 1 -- 172.21.15.97:0/1405121380 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1300cb530 con 0x7fe1300cf9a0 2023-11-24T08:08:19.966 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe11006ae40 msgr2=0x7fe11006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe11006ae40 0x7fe11006d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe120007bf0 tx=0x7fe120007240 comp rx=0 tx=0).stop 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300cf9a0 msgr2=0x7fe13015b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300cf9a0 0x7fe13015b640 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe11800d5f0 tx=0x7fe11800dab0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 shutdown_connections 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe11006ae40 0x7fe11006d300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe13015d4b0 0x7fe1300b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1300cf9a0 0x7fe13015b640 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 --2- 172.21.15.97:0/1405121380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1300b31d0 0x7fe13015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:19.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 >> 172.21.15.97:0/1405121380 conn(0x7fe1300d3000 msgr2=0x7fe13006ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:19.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 shutdown_connections 2023-11-24T08:08:19.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:19.967+0000 7fe135d16640 1 -- 172.21.15.97:0/1405121380 wait complete. 2023-11-24T08:08:19.987 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:08:20.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.200+0000 7ff886e32640 1 Processor -- start 2023-11-24T08:08:20.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.201+0000 7ff886e32640 1 -- start start 2023-11-24T08:08:20.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.202+0000 7ff886e32640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 0x7ff8800b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.202+0000 7ff886e32640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff88009a170 0x7ff8800cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.202+0000 7ff886e32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88006cea0 con 0x7ff88006c6b0 2023-11-24T08:08:20.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.202+0000 7ff886e32640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88006cbc0 con 0x7ff88009a170 2023-11-24T08:08:20.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.202+0000 7ff886e32640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88006f350 con 0x7ff8800cd240 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff88006c6b0 0x7ff880099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51924/0 (socket says 172.21.15.97:51924) 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87ffff640 1 -- 172.21.15.97:0/3707953483 learned_addr learned my addr 172.21.15.97:0/3707953483 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff884bce640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 0x7ff8800b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff8853cf640 1 --2- 172.21.15.97:0/3707953483 >> v2:172.21.15.183:3300/0 conn(0x7ff88009a170 0x7ff8800cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026025036 0 0) 0x7ff88006cea0 con 0x7ff88006c6b0 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff86c003520 con 0x7ff88006c6b0 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1759529033 0 0) 0x7ff86c003520 con 0x7ff88006c6b0 2023-11-24T08:08:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 msgr2=0x7ff8800b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 0x7ff8800b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 >> v2:172.21.15.183:3300/0 conn(0x7ff88009a170 msgr2=0x7ff8800cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 --2- 172.21.15.97:0/3707953483 >> v2:172.21.15.183:3300/0 conn(0x7ff88009a170 0x7ff8800cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88006f630 con 0x7ff88006c6b0 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7ff868001670 con 0x7ff88006c6b0 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.203+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 >> v1:172.21.15.97:6789/0 conn(0x7ff88006c6b0 legacy=0x7ff880099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff87f7fe640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 0x7ff86c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff87f7fe640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff86c003ef0 0x7ff86c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff87f7fe640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff86c004d00 0x7ff86c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88006cbc0 con 0x7ff86c004d00 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88006f350 con 0x7ff86c003ef0 2023-11-24T08:08:20.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c00b980 con 0x7ff8800cd240 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff8853cf640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff86c004d00 0x7ff86c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff87ffff640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff86c003ef0 0x7ff86c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff884bce640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 0x7ff86c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff8853cf640 1 -- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 msgr2=0x7ff86c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff8853cf640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8800cd240 0x7ff86c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff8853cf640 1 -- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff86c003ef0 msgr2=0x7ff86c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff8853cf640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff86c003ef0 0x7ff86c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.204+0000 7ff8853cf640 1 -- 172.21.15.97:0/3707953483 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c003520 con 0x7ff86c004d00 2023-11-24T08:08:20.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff8853cf640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff86c004d00 0x7ff86c005180 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff878009fc0 tx=0x7ff86c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb0e924d07207ea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87802cc40 con 0x7ff86c004d00 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87800f040 con 0x7ff86c004d00 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff87f7fe640 1 -- 172.21.15.97:0/3707953483 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878034440 con 0x7ff86c004d00 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff886e32640 1 -- 172.21.15.97:0/3707953483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff86c004d00 msgr2=0x7ff86c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff886e32640 1 --2- 172.21.15.97:0/3707953483 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff86c004d00 0x7ff86c005180 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff878009fc0 tx=0x7ff86c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff8853cf640 1 -- 172.21.15.97:0/3707953483 reap_dead start 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff886e32640 1 -- 172.21.15.97:0/3707953483 shutdown_connections 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.206+0000 7ff886e32640 1 -- 172.21.15.97:0/3707953483 >> 172.21.15.97:0/3707953483 conn(0x7ff8800b2d00 msgr2=0x7ff8800b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.207+0000 7ff886e32640 1 -- 172.21.15.97:0/3707953483 shutdown_connections 2023-11-24T08:08:20.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.207+0000 7ff886e32640 1 -- 172.21.15.97:0/3707953483 wait complete. 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.208+0000 7ff886e32640 1 Processor -- start 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.208+0000 7ff886e32640 1 -- start start 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.209+0000 7ff886e32640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff86c004d00 0x7ff88015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.209+0000 7ff886e32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8800aff90 0x7ff8800b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.209+0000 7ff886e32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8800b4260 0x7ff8800b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.209+0000 7ff886e32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800b0950 con 0x7ff8800aff90 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.209+0000 7ff886e32640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800c6290 con 0x7ff8800b4260 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.209+0000 7ff886e32640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88015f3a0 con 0x7ff86c004d00 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8800aff90 0x7ff8800b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8800aff90 0x7ff8800b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34780/0 (socket says 172.21.15.97:34780) 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 -- 172.21.15.97:0/1969614899 learned_addr learned my addr 172.21.15.97:0/1969614899 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff884bce640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff86c004d00 0x7ff88015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 -- 172.21.15.97:0/1969614899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff86c004d00 msgr2=0x7ff88015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff86c004d00 0x7ff88015ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 -- 172.21.15.97:0/1969614899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8800b4260 msgr2=0x7ff8800b46e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8800b4260 0x7ff8800b46e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 -- 172.21.15.97:0/1969614899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800b5000 con 0x7ff8800aff90 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.210+0000 7ff87ffff640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8800aff90 0x7ff8800b0410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff86800e820 tx=0x7ff86800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.211+0000 7ff87d7fa640 1 -- 172.21.15.97:0/1969614899 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86800c7f0 con 0x7ff8800aff90 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.211+0000 7ff87d7fa640 1 -- 172.21.15.97:0/1969614899 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86800c950 con 0x7ff8800aff90 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.211+0000 7ff87d7fa640 1 -- 172.21.15.97:0/1969614899 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86800cd00 con 0x7ff8800aff90 2023-11-24T08:08:20.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.211+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8800b52e0 con 0x7ff8800aff90 2023-11-24T08:08:20.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.211+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8800b58a0 con 0x7ff8800aff90 2023-11-24T08:08:20.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.212+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8800c6060 con 0x7ff8800aff90 2023-11-24T08:08:20.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.213+0000 7ff87d7fa640 1 -- 172.21.15.97:0/1969614899 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff86801d460 con 0x7ff8800aff90 2023-11-24T08:08:20.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.214+0000 7ff87d7fa640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff86006ae40 0x7ff86006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.214+0000 7ff87d7fa640 1 -- 172.21.15.97:0/1969614899 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff868089750 con 0x7ff8800aff90 2023-11-24T08:08:20.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.214+0000 7ff884bce640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff86006ae40 0x7ff86006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.215+0000 7ff884bce640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff86006ae40 0x7ff86006d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff870009950 tx=0x7ff870008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:20.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.218+0000 7ff87d7fa640 1 -- 172.21.15.97:0/1969614899 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8800c6060 con 0x7ff8800aff90 2023-11-24T08:08:20.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.410+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8800c6060 con 0x7ff8800aff90 2023-11-24T08:08:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.411+0000 7ff87d7fa640 1 -- 172.21.15.97:0/1969614899 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8800c6060 con 0x7ff8800aff90 2023-11-24T08:08:20.413 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:08:20.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff86006ae40 msgr2=0x7ff86006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff86006ae40 0x7ff86006d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff870009950 tx=0x7ff870008040 comp rx=0 tx=0).stop 2023-11-24T08:08:20.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8800aff90 msgr2=0x7ff8800b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8800aff90 0x7ff8800b0410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff86800e820 tx=0x7ff86800ece0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 shutdown_connections 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff86006ae40 0x7ff86006d300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8800b4260 0x7ff8800b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8800aff90 0x7ff8800b0410 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.414+0000 7ff886e32640 1 --2- 172.21.15.97:0/1969614899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff86c004d00 0x7ff88015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.415+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 >> 172.21.15.97:0/1969614899 conn(0x7ff8800b2d00 msgr2=0x7ff880099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.415+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 shutdown_connections 2023-11-24T08:08:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.415+0000 7ff886e32640 1 -- 172.21.15.97:0/1969614899 wait complete. 2023-11-24T08:08:20.435 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:08:20.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.653+0000 7fdfe1b67640 1 Processor -- start 2023-11-24T08:08:20.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.653+0000 7fdfe1b67640 1 -- start start 2023-11-24T08:08:20.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe1b67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 0x7fdfdc0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe1b67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdfdc0cdc20 0x7fdfdc0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe1b67640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0ce440 con 0x7fdfdc13cf10 2023-11-24T08:08:20.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe1b67640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc0ce720 con 0x7fdfdc0cdc20 2023-11-24T08:08:20.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe1b67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0cea00 con 0x7fdfdc13fcb0 2023-11-24T08:08:20.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe0b65640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdfdc13cf10 0x7fdfdc13f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51936/0 (socket says 172.21.15.97:51936) 2023-11-24T08:08:20.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe0b65640 1 -- 172.21.15.97:0/1100037466 learned_addr learned my addr 172.21.15.97:0/1100037466 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018978610 0 0) 0x7fdfdc0ce440 con 0x7fdfdc13cf10 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfcc003520 con 0x7fdfdc13cf10 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfe1366640 1 --2- 172.21.15.97:0/1100037466 >> v2:172.21.15.183:3300/0 conn(0x7fdfdc0cdc20 0x7fdfdc0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.655+0000 7fdfdbfff640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 0x7fdfdc0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054006246 0 0) 0x7fdfcc003520 con 0x7fdfdc13cf10 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 msgr2=0x7fdfdc0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 0x7fdfdc0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 >> v2:172.21.15.183:3300/0 conn(0x7fdfdc0cdc20 msgr2=0x7fdfdc0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 --2- 172.21.15.97:0/1100037466 >> v2:172.21.15.183:3300/0 conn(0x7fdfdc0cdc20 0x7fdfdc0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0b1d90 con 0x7fdfdc13cf10 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fdfd0001670 con 0x7fdfdc13cf10 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 >> v1:172.21.15.97:6789/0 conn(0x7fdfdc13cf10 legacy=0x7fdfdc13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc003970 0x7fdfcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 0x7fdfcc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0ce720 con 0x7fdfcc004d00 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0cea00 con 0x7fdfcc003970 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc00bae0 con 0x7fdfdc13fcb0 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.656+0000 7fdfe1366640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.657+0000 7fdfdbfff640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 0x7fdfcc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.657+0000 7fdfe0b65640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc003970 0x7fdfcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.657+0000 7fdfe1366640 1 -- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 msgr2=0x7fdfcc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.657+0000 7fdfe1366640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc13fcb0 0x7fdfcc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.657+0000 7fdfe1366640 1 -- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc003970 msgr2=0x7fdfcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:20.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.657+0000 7fdfe1366640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc003970 0x7fdfcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.657+0000 7fdfe1366640 1 -- 172.21.15.97:0/1100037466 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc003520 con 0x7fdfcc004d00 2023-11-24T08:08:20.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.658+0000 7fdfe1366640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfcc005180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4007360 tx=0x7fdfcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fec563e2a755927 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:20.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.658+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd402ccf0 con 0x7fdfcc004d00 2023-11-24T08:08:20.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.658+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd402ce50 con 0x7fdfcc004d00 2023-11-24T08:08:20.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.658+0000 7fdfdb7fe640 1 -- 172.21.15.97:0/1100037466 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4034660 con 0x7fdfcc004d00 2023-11-24T08:08:20.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.659+0000 7fdfe1b67640 1 -- 172.21.15.97:0/1100037466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 msgr2=0x7fdfcc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.659+0000 7fdfe1b67640 1 --2- 172.21.15.97:0/1100037466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfcc005180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4007360 tx=0x7fdfcc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.659+0000 7fdfe1366640 1 -- 172.21.15.97:0/1100037466 reap_dead start 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.659+0000 7fdfe1b67640 1 -- 172.21.15.97:0/1100037466 shutdown_connections 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.659+0000 7fdfe1b67640 1 -- 172.21.15.97:0/1100037466 >> 172.21.15.97:0/1100037466 conn(0x7fdfdc06a7d0 msgr2=0x7fdfdc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.659+0000 7fdfe1b67640 1 -- 172.21.15.97:0/1100037466 shutdown_connections 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.659+0000 7fdfe1b67640 1 -- 172.21.15.97:0/1100037466 wait complete. 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.661+0000 7fdfe1b67640 1 Processor -- start 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.661+0000 7fdfe1b67640 1 -- start start 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.662+0000 7fdfe1b67640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfdc1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.662+0000 7fdfe1b67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc157560 0x7fdfdc136c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.662+0000 7fdfe1b67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc140690 0x7fdfdc140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.662+0000 7fdfe1b67640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc141050 con 0x7fdfcc004d00 2023-11-24T08:08:20.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.662+0000 7fdfe1b67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc13a0f0 con 0x7fdfdc157560 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.662+0000 7fdfe1b67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc153810 con 0x7fdfdc140690 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfdc1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfdc1539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34796/0 (socket says 172.21.15.97:34796) 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 -- 172.21.15.97:0/2824878585 learned_addr learned my addr 172.21.15.97:0/2824878585 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfdbfff640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc157560 0x7fdfdc136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe1366640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc140690 0x7fdfdc140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 -- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc140690 msgr2=0x7fdfdc140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc140690 0x7fdfdc140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 -- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc157560 msgr2=0x7fdfdc136c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc157560 0x7fdfdc136c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 -- 172.21.15.97:0/2824878585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc139240 con 0x7fdfcc004d00 2023-11-24T08:08:20.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfdbfff640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc157560 0x7fdfdc136c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:20.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.663+0000 7fdfe0b65640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfdc1539c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000e820 tx=0x7fdfd000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:20.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.664+0000 7fdfd97fa640 1 -- 172.21.15.97:0/2824878585 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000c870 con 0x7fdfcc004d00 2023-11-24T08:08:20.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.664+0000 7fdfd97fa640 1 -- 172.21.15.97:0/2824878585 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd000c9f0 con 0x7fdfcc004d00 2023-11-24T08:08:20.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.664+0000 7fdfd97fa640 1 -- 172.21.15.97:0/2824878585 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000cda0 con 0x7fdfcc004d00 2023-11-24T08:08:20.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.664+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc139470 con 0x7fdfcc004d00 2023-11-24T08:08:20.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.664+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc139a30 con 0x7fdfcc004d00 2023-11-24T08:08:20.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.665+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc067450 con 0x7fdfcc004d00 2023-11-24T08:08:20.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.666+0000 7fdfd97fa640 1 -- 172.21.15.97:0/2824878585 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfd001d460 con 0x7fdfcc004d00 2023-11-24T08:08:20.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.667+0000 7fdfd97fa640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdfc006ae40 0x7fdfc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:20.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.667+0000 7fdfd97fa640 1 -- 172.21.15.97:0/2824878585 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfd0089660 con 0x7fdfcc004d00 2023-11-24T08:08:20.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.667+0000 7fdfdbfff640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdfc006ae40 0x7fdfc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:20.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.668+0000 7fdfdbfff640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdfc006ae40 0x7fdfc006d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc15d470 tx=0x7fdfc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:20.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.672+0000 7fdfd97fa640 1 -- 172.21.15.97:0/2824878585 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdfd00546f0 con 0x7fdfcc004d00 2023-11-24T08:08:20.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.860+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfdc0cbf10 con 0x7fdfcc004d00 2023-11-24T08:08:21.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.861+0000 7fdfd97fa640 1 -- 172.21.15.97:0/2824878585 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfd0057d10 con 0x7fdfcc004d00 2023-11-24T08:08:21.026 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:08:21.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdfc006ae40 msgr2=0x7fdfc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:21.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdfc006ae40 0x7fdfc006d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc15d470 tx=0x7fdfc8008040 comp rx=0 tx=0).stop 2023-11-24T08:08:21.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 msgr2=0x7fdfdc1539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfdc1539c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000e820 tx=0x7fdfd000ece0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 shutdown_connections 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fdfc006ae40 0x7fdfc006d300 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc140690 0x7fdfdc140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc157560 0x7fdfdc136c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 --2- 172.21.15.97:0/2824878585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdfcc004d00 0x7fdfdc1539c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 >> 172.21.15.97:0/2824878585 conn(0x7fdfdc06a7d0 msgr2=0x7fdfdc06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 shutdown_connections 2023-11-24T08:08:21.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:20.864+0000 7fdfe1b67640 1 -- 172.21.15.97:0/2824878585 wait complete. 2023-11-24T08:08:21.029 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:08:21.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.253+0000 7fe3e2cda640 1 Processor -- start 2023-11-24T08:08:21.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.253+0000 7fe3e2cda640 1 -- start start 2023-11-24T08:08:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.255+0000 7fe3e2cda640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.255+0000 7fe3e2cda640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3dc13e360 0x7fe3dc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.255+0000 7fe3e2cda640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc06c470 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.255+0000 7fe3e2cda640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc06c750 con 0x7fe3dc13e360 2023-11-24T08:08:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.255+0000 7fe3e2cda640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc06ca30 con 0x7fe3dc13df80 2023-11-24T08:08:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3dbfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3dc13e360 0x7fe3dc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3dbfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3dc13e360 0x7fe3dc0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34808/0 (socket says 172.21.15.97:34808) 2023-11-24T08:08:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3e0a76640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3dbfff640 1 -- 172.21.15.97:0/2938325250 learned_addr learned my addr 172.21.15.97:0/2938325250 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3dbfff640 1 -- 172.21.15.97:0/2938325250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 msgr2=0x7fe3dc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3dbfff640 1 --2- 172.21.15.97:0/2938325250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3dbfff640 1 -- 172.21.15.97:0/2938325250 >> v1:172.21.15.183:6789/0 conn(0x7fe3dc15f9c0 legacy=0x7fe3dc1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.256+0000 7fe3dbfff640 1 -- 172.21.15.97:0/2938325250 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc06cd10 con 0x7fe3dc13e360 2023-11-24T08:08:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.257+0000 7fe3dbfff640 1 --2- 172.21.15.97:0/2938325250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc13e360 0x7fe3dc0cf290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009870 tx=0x7fe3c802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7675e9ec94f2e38 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3db7fe640 1 -- 172.21.15.97:0/2938325250 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8031640 con 0x7fe3dc13e360 2023-11-24T08:08:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3db7fe640 1 -- 172.21.15.97:0/2938325250 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c80317a0 con 0x7fe3dc13e360 2023-11-24T08:08:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3db7fe640 1 -- 172.21.15.97:0/2938325250 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8031b30 con 0x7fe3dc13e360 2023-11-24T08:08:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 -- 172.21.15.97:0/2938325250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc13e360 msgr2=0x7fe3dc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/2938325250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc13e360 0x7fe3dc0cf290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009870 tx=0x7fe3c802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 -- 172.21.15.97:0/2938325250 shutdown_connections 2023-11-24T08:08:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/2938325250 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc13e360 0x7fe3dc0cf290 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/2938325250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 -- 172.21.15.97:0/2938325250 >> 172.21.15.97:0/2938325250 conn(0x7fe3dc06a800 msgr2=0x7fe3dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:21.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 -- 172.21.15.97:0/2938325250 shutdown_connections 2023-11-24T08:08:21.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.258+0000 7fe3e2cda640 1 -- 172.21.15.97:0/2938325250 wait complete. 2023-11-24T08:08:21.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.260+0000 7fe3e2cda640 1 Processor -- start 2023-11-24T08:08:21.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.260+0000 7fe3e2cda640 1 -- start start 2023-11-24T08:08:21.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.261+0000 7fe3e2cda640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:21.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.261+0000 7fe3e2cda640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3dc13e360 0x7fe3dc14f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:21.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.261+0000 7fe3e2cda640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc15f9c0 0x7fe3dc1f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:21.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.261+0000 7fe3e2cda640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0b3b90 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.261+0000 7fe3e2cda640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc14de30 con 0x7fe3dc13e360 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.261+0000 7fe3e2cda640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc14d9a0 con 0x7fe3dc13df80 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.261+0000 7fe3e1277640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc15f9c0 0x7fe3dc1f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc15f9c0 0x7fe3dc1f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34812/0 (socket says 172.21.15.97:34812) 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 -- 172.21.15.97:0/3440655684 learned_addr learned my addr 172.21.15.97:0/3440655684 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3dbfff640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3dc13e360 0x7fe3dc14f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e0a76640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 -- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 msgr2=0x7fe3dc1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc1515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 -- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3dc13e360 msgr2=0x7fe3dc14f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3dc13e360 0x7fe3dc14f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 -- 172.21.15.97:0/3440655684 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80094d0 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e0a76640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:21.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e1277640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc15f9c0 0x7fe3dc1f45e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c7b0 tx=0x7fe3d400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:21.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3d97fa640 1 -- 172.21.15.97:0/3440655684 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4004b60 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3d97fa640 1 -- 172.21.15.97:0/3440655684 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d4004cc0 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3d97fa640 1 -- 172.21.15.97:0/3440655684 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400aa90 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.262+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc14c370 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.263+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc14d630 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.264+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc0675d0 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.265+0000 7fe3d97fa640 1 -- 172.21.15.97:0/3440655684 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3d400abf0 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.266+0000 7fe3d97fa640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe3c006ae70 0x7fe3c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:21.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.266+0000 7fe3d97fa640 1 -- 172.21.15.97:0/3440655684 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3d40897e0 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.266+0000 7fe3e0a76640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe3c006ae70 0x7fe3c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:21.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.267+0000 7fe3e0a76640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe3c006ae70 0x7fe3c006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009a20 tx=0x7fe3d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:21.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.270+0000 7fe3d97fa640 1 -- 172.21.15.97:0/3440655684 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3d4054800 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.473+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe3dc14dae0 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.474+0000 7fe3d97fa640 1 -- 172.21.15.97:0/3440655684 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe3d4057e20 con 0x7fe3dc15f9c0 2023-11-24T08:08:21.475 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-11-24T08:08:21.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe3c006ae70 msgr2=0x7fe3c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:21.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe3c006ae70 0x7fe3c006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009a20 tx=0x7fe3d0008040 comp rx=0 tx=0).stop 2023-11-24T08:08:21.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc15f9c0 msgr2=0x7fe3dc1f45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:21.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc15f9c0 0x7fe3dc1f45e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c7b0 tx=0x7fe3d400cc70 comp rx=0 tx=0).stop 2023-11-24T08:08:21.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 shutdown_connections 2023-11-24T08:08:21.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe3c006ae70 0x7fe3c006d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3dc15f9c0 0x7fe3dc1f45e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3dc13e360 0x7fe3dc14f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 --2- 172.21.15.97:0/3440655684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3dc13df80 0x7fe3dc1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:21.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 >> 172.21.15.97:0/3440655684 conn(0x7fe3dc06a800 msgr2=0x7fe3dc15d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:21.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 shutdown_connections 2023-11-24T08:08:21.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:21.476+0000 7fe3e2cda640 1 -- 172.21.15.97:0/3440655684 wait complete. 2023-11-24T08:08:21.498 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2023-11-24T08:08:21.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:21.498 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T08:08:21.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[95249]: fuse finished with error 0 and tester_r 0 2023-11-24T08:08:21.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:08:21.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:21.601 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:08:21.653 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:08:21.654 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:21.715 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:08:21.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:08:21.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:21.716 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:08:21.769 INFO:teuthology.orchestra.run.smithi097.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-24T08:08:21.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:21.770 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:08:21.770 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:21.831 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:08:21.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:08:21.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:21.831 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:08:21.885 INFO:teuthology.orchestra.run.smithi183.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-24T08:08:21.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:21.887 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:22.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.107+0000 7f7948927640 1 Processor -- start 2023-11-24T08:08:22.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.107+0000 7f7948927640 1 -- start start 2023-11-24T08:08:22.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f7948927640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 0x7f794406b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f7948927640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794406bd50 con 0x7f794415af30 2023-11-24T08:08:22.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f7948927640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7944071810 con 0x7f794415f3b0 2023-11-24T08:08:22.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f7948927640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7944071af0 con 0x7f794406b3f0 2023-11-24T08:08:22.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f79437fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f794415af30 0x7f794415e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51944/0 (socket says 172.21.15.97:51944) 2023-11-24T08:08:22.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f79437fe640 1 -- 172.21.15.97:0/3950912375 learned_addr learned my addr 172.21.15.97:0/3950912375 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480498863 0 0) 0x7f794406bd50 con 0x7f794415af30 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792c003520 con 0x7f794415af30 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.109+0000 7f7942ffd640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 0x7f794406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346125255 0 0) 0x7f792c003520 con 0x7f794415af30 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 msgr2=0x7f794406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 0x7f794406b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 >> v1:172.21.15.183:6789/0 conn(0x7f794415f3b0 legacy=0x7f794415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794415e8d0 con 0x7f794415af30 2023-11-24T08:08:22.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f7934001670 con 0x7f794415af30 2023-11-24T08:08:22.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 >> v1:172.21.15.97:6789/0 conn(0x7f794415af30 legacy=0x7f794415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f792c0039a0 0x7f792c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 0x7f792c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f792c004d00 0x7f792c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944071af0 con 0x7f792c004d00 2023-11-24T08:08:22.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c00bb10 con 0x7f792c0039a0 2023-11-24T08:08:22.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c00bca0 con 0x7f794406b3f0 2023-11-24T08:08:22.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f7943fff640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f792c004d00 0x7f792c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f7942ffd640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 0x7f792c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.110+0000 7f79437fe640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f792c0039a0 0x7f792c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.111+0000 7f7943fff640 1 -- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 msgr2=0x7f792c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:22.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.111+0000 7f7943fff640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794406b3f0 0x7f792c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.111+0000 7f7943fff640 1 -- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f792c0039a0 msgr2=0x7f792c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:22.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.111+0000 7f7943fff640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f792c0039a0 0x7f792c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.111+0000 7f7943fff640 1 -- 172.21.15.97:0/3950912375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c003520 con 0x7f792c004d00 2023-11-24T08:08:22.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.111+0000 7f79437fe640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f792c0039a0 0x7f792c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:22.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.112+0000 7f7943fff640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f792c004d00 0x7f792c005180 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f793c001e80 tx=0x7f792c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4998dee90042fc71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:22.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.112+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c003b70 con 0x7f792c004d00 2023-11-24T08:08:22.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.112+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c003cd0 con 0x7f792c004d00 2023-11-24T08:08:22.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.112+0000 7f79427fc640 1 -- 172.21.15.97:0/3950912375 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c005310 con 0x7f792c004d00 2023-11-24T08:08:22.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.113+0000 7f7948927640 1 -- 172.21.15.97:0/3950912375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f792c004d00 msgr2=0x7f792c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.113+0000 7f7948927640 1 --2- 172.21.15.97:0/3950912375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f792c004d00 0x7f792c005180 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f793c001e80 tx=0x7f792c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.113+0000 7f7943fff640 1 -- 172.21.15.97:0/3950912375 reap_dead start 2023-11-24T08:08:22.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.113+0000 7f7948927640 1 -- 172.21.15.97:0/3950912375 shutdown_connections 2023-11-24T08:08:22.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.113+0000 7f7948927640 1 -- 172.21.15.97:0/3950912375 >> 172.21.15.97:0/3950912375 conn(0x7f7944070950 msgr2=0x7f7944070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:22.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.113+0000 7f7948927640 1 -- 172.21.15.97:0/3950912375 shutdown_connections 2023-11-24T08:08:22.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.113+0000 7f7948927640 1 -- 172.21.15.97:0/3950912375 wait complete. 2023-11-24T08:08:22.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.115+0000 7f7948927640 1 Processor -- start 2023-11-24T08:08:22.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.116+0000 7f7948927640 1 -- start start 2023-11-24T08:08:22.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.116+0000 7f7948927640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794414b420 0x7f794415f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.116+0000 7f7948927640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79440c5010 0x7f794415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.116+0000 7f7948927640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f794414b800 0x7f794414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.116+0000 7f7948927640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c8bd0 con 0x7f794414b800 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.116+0000 7f7948927640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c4bf0 con 0x7f79440c5010 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.116+0000 7f7948927640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c5960 con 0x7f794414b420 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f794414b800 0x7f794414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f794414b800 0x7f794414bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34820/0 (socket says 172.21.15.97:34820) 2023-11-24T08:08:22.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 -- 172.21.15.97:0/2263013231 learned_addr learned my addr 172.21.15.97:0/2263013231 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f79437fe640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794414b420 0x7f794415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 -- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794414b420 msgr2=0x7f794415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7942ffd640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79440c5010 0x7f794415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794414b420 0x7f794415f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 -- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79440c5010 msgr2=0x7f794415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79440c5010 0x7f794415fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f7943fff640 1 -- 172.21.15.97:0/2263013231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794414c880 con 0x7f794414b800 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.117+0000 7f79437fe640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794414b420 0x7f794415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.118+0000 7f7943fff640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f794414b800 0x7f794414bc80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f793c005040 tx=0x7f793c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.118+0000 7f792bfff640 1 -- 172.21.15.97:0/2263013231 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c03e070 con 0x7f794414b800 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.118+0000 7f792bfff640 1 -- 172.21.15.97:0/2263013231 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c007db0 con 0x7f794414b800 2023-11-24T08:08:22.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.118+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794414c5a0 con 0x7f794414b800 2023-11-24T08:08:22.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.118+0000 7f792bfff640 1 -- 172.21.15.97:0/2263013231 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c006d70 con 0x7f794414b800 2023-11-24T08:08:22.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.118+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79440c4810 con 0x7f794414b800 2023-11-24T08:08:22.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.119+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79440c49d0 con 0x7f794414b800 2023-11-24T08:08:22.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.120+0000 7f792bfff640 1 -- 172.21.15.97:0/2263013231 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f793c007030 con 0x7f794414b800 2023-11-24T08:08:22.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.121+0000 7f792bfff640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f793006ae70 0x7f793006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.121+0000 7f792bfff640 1 -- 172.21.15.97:0/2263013231 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f793c0aaad0 con 0x7f794414b800 2023-11-24T08:08:22.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.121+0000 7f79437fe640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f793006ae70 0x7f793006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.122+0000 7f79437fe640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f793006ae70 0x7f793006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7934001eb0 tx=0x7f7934009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:22.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.126+0000 7f792bfff640 1 -- 172.21.15.97:0/2263013231 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f793c075b70 con 0x7f794414b800 2023-11-24T08:08:22.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.356+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79440c4d30 con 0x7f794414b800 2023-11-24T08:08:22.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.357+0000 7f792bfff640 1 -- 172.21.15.97:0/2263013231 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f79440c4d30 con 0x7f794414b800 2023-11-24T08:08:22.359 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:22.359 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3619089631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3619089631},{"type":"v1","addr":"172.21.15.183:6834","nonce":3619089631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1237344944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1237344944},{"type":"v1","addr":"172.21.15.97:6837","nonce":1237344944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1425639784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1425639784},{"type":"v1","addr":"172.21.15.183:6835","nonce":1425639784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:08:02.652077+0000","modified":"2023-11-24T08:08:05.725467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5244":{"gid":5244,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.97:6835/4116734497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4116734497},{"type":"v1","addr":"172.21.15.97:6835","nonce":4116734497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:08:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 18 2023-11-24T08:08:22.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.359+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f793006ae70 msgr2=0x7f793006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.359+0000 7f7948927640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f793006ae70 0x7f793006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7934001eb0 tx=0x7f7934009040 comp rx=0 tx=0).stop 2023-11-24T08:08:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.359+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f794414b800 msgr2=0x7f794414bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.359+0000 7f7948927640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f794414b800 0x7f794414bc80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f793c005040 tx=0x7f793c0014a0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 shutdown_connections 2023-11-24T08:08:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f793006ae70 0x7f793006d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f794414b800 0x7f794414bc80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79440c5010 0x7f794415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 --2- 172.21.15.97:0/2263013231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f794414b420 0x7f794415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 >> 172.21.15.97:0/2263013231 conn(0x7f7944070950 msgr2=0x7f7944073540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 shutdown_connections 2023-11-24T08:08:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.360+0000 7f7948927640 1 -- 172.21.15.97:0/2263013231 wait complete. 2023-11-24T08:08:22.380 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:22.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.588+0000 7f2d09683640 1 Processor -- start 2023-11-24T08:08:22.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.588+0000 7f2d09683640 1 -- start start 2023-11-24T08:08:22.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d09683640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d0413df80 0x7f2d0415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d09683640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2d040cf9a0 0x7f2d040cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d09683640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0406c470 con 0x7f2d0413e360 2023-11-24T08:08:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d09683640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406c750 con 0x7f2d0413df80 2023-11-24T08:08:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d09683640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406ca30 con 0x7f2d040cf9a0 2023-11-24T08:08:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d02ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d0413df80 0x7f2d0415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d02ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d0413df80 0x7f2d0415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34834/0 (socket says 172.21.15.97:34834) 2023-11-24T08:08:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.590+0000 7f2d02ffd640 1 -- 172.21.15.97:0/1358171629 learned_addr learned my addr 172.21.15.97:0/1358171629 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:22.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.591+0000 7f2d02ffd640 1 -- 172.21.15.97:0/1358171629 >> v2:172.21.15.183:3300/0 conn(0x7f2d040cf9a0 msgr2=0x7f2d040cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:22.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.591+0000 7f2d02ffd640 1 --2- 172.21.15.97:0/1358171629 >> v2:172.21.15.183:3300/0 conn(0x7f2d040cf9a0 0x7f2d040cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.591+0000 7f2d02ffd640 1 -- 172.21.15.97:0/1358171629 >> v1:172.21.15.183:6789/0 conn(0x7f2d0413e360 legacy=0x7f2d040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:22.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.591+0000 7f2d02ffd640 1 -- 172.21.15.97:0/1358171629 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0406cd10 con 0x7f2d0413df80 2023-11-24T08:08:22.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.592+0000 7f2d02ffd640 1 --2- 172.21.15.97:0/1358171629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413df80 0x7f2d0415bee0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2d040ccb10 tx=0x7f2cf402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1165db7326bd9bbd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:22.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.592+0000 7f2d01ffb640 1 -- 172.21.15.97:0/1358171629 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf402ca80 con 0x7f2d0413df80 2023-11-24T08:08:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.592+0000 7f2d01ffb640 1 -- 172.21.15.97:0/1358171629 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf402cbe0 con 0x7f2d0413df80 2023-11-24T08:08:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.592+0000 7f2d01ffb640 1 -- 172.21.15.97:0/1358171629 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40343f0 con 0x7f2d0413df80 2023-11-24T08:08:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 -- 172.21.15.97:0/1358171629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413df80 msgr2=0x7f2d0415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 --2- 172.21.15.97:0/1358171629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413df80 0x7f2d0415bee0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2d040ccb10 tx=0x7f2cf402bee0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 -- 172.21.15.97:0/1358171629 shutdown_connections 2023-11-24T08:08:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 --2- 172.21.15.97:0/1358171629 >> v2:172.21.15.183:3300/0 conn(0x7f2d040cf9a0 0x7f2d040cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 --2- 172.21.15.97:0/1358171629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413df80 0x7f2d0415bee0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 -- 172.21.15.97:0/1358171629 >> 172.21.15.97:0/1358171629 conn(0x7f2d0406a800 msgr2=0x7f2d0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:22.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 -- 172.21.15.97:0/1358171629 shutdown_connections 2023-11-24T08:08:22.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.593+0000 7f2d09683640 1 -- 172.21.15.97:0/1358171629 wait complete. 2023-11-24T08:08:22.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.595+0000 7f2d09683640 1 Processor -- start 2023-11-24T08:08:22.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.595+0000 7f2d09683640 1 -- start start 2023-11-24T08:08:22.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d09683640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d040cf9a0 0x7f2d0413d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d09683640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0413df80 0x7f2d04070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d09683640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413e360 0x7f2d0415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d09683640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d04072250 con 0x7f2d0413e360 2023-11-24T08:08:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d09683640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040715d0 con 0x7f2d040cf9a0 2023-11-24T08:08:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d09683640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040718b0 con 0x7f2d0413df80 2023-11-24T08:08:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413e360 0x7f2d0415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d037fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413e360 0x7f2d0415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34842/0 (socket says 172.21.15.97:34842) 2023-11-24T08:08:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.596+0000 7f2d037fe640 1 -- 172.21.15.97:0/1606798009 learned_addr learned my addr 172.21.15.97:0/1606798009 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:22.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d02ffd640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d040cf9a0 0x7f2d0413d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d027fc640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0413df80 0x7f2d04070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d037fe640 1 -- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0413df80 msgr2=0x7f2d04070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d037fe640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0413df80 0x7f2d04070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d037fe640 1 -- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d040cf9a0 msgr2=0x7f2d0413d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d037fe640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d040cf9a0 0x7f2d0413d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d037fe640 1 -- 172.21.15.97:0/1606798009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4009b30 con 0x7f2d0413e360 2023-11-24T08:08:22.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d037fe640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413e360 0x7f2d0415a180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b410 tx=0x7f2cfc00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:22.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2cfb7fe640 1 -- 172.21.15.97:0/1606798009 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc011830 con 0x7f2d0413e360 2023-11-24T08:08:22.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2cfb7fe640 1 -- 172.21.15.97:0/1606798009 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc011990 con 0x7f2d0413e360 2023-11-24T08:08:22.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2cfb7fe640 1 -- 172.21.15.97:0/1606798009 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc011d40 con 0x7f2d0413e360 2023-11-24T08:08:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.597+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d04071b90 con 0x7f2d0413e360 2023-11-24T08:08:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.598+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0413d950 con 0x7f2d0413e360 2023-11-24T08:08:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.599+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d040675d0 con 0x7f2d0413e360 2023-11-24T08:08:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.600+0000 7f2cfb7fe640 1 -- 172.21.15.97:0/1606798009 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cfc01a400 con 0x7f2d0413e360 2023-11-24T08:08:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.601+0000 7f2cfb7fe640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.601+0000 7f2cfb7fe640 1 -- 172.21.15.97:0/1606798009 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cfc0896b0 con 0x7f2d0413e360 2023-11-24T08:08:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.601+0000 7f2d02ffd640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.602+0000 7f2d02ffd640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2ce406ae40 0x7f2ce406d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4035000 tx=0x7f2cf4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:22.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.605+0000 7f2cfb7fe640 1 -- 172.21.15.97:0/1606798009 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2cfc0547f0 con 0x7f2d0413e360 2023-11-24T08:08:22.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.796+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d040b0350 con 0x7f2d0413e360 2023-11-24T08:08:22.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.799+0000 7f2cfb7fe640 1 -- 172.21.15.97:0/1606798009 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f2cfc057e10 con 0x7f2d0413e360 2023-11-24T08:08:22.801 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:22.801 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:04.217727+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:22.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.801+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2ce406ae40 msgr2=0x7f2ce406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.801+0000 7f2d09683640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2ce406ae40 0x7f2ce406d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4035000 tx=0x7f2cf4030000 comp rx=0 tx=0).stop 2023-11-24T08:08:22.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.801+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413e360 msgr2=0x7f2d0415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:22.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.801+0000 7f2d09683640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413e360 0x7f2d0415a180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b410 tx=0x7f2cfc00b810 comp rx=0 tx=0).stop 2023-11-24T08:08:22.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 shutdown_connections 2023-11-24T08:08:22.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d0413e360 0x7f2d0415a180 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0413df80 0x7f2d04070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 --2- 172.21.15.97:0/1606798009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d040cf9a0 0x7f2d0413d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:22.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 >> 172.21.15.97:0/1606798009 conn(0x7f2d0406a800 msgr2=0x7f2d0415cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:22.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 shutdown_connections 2023-11-24T08:08:22.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:22.802+0000 7f2d09683640 1 -- 172.21.15.97:0/1606798009 wait complete. 2023-11-24T08:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:08:00.468087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:08:01.668047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:08:22.824 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:08:23.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.036+0000 7fb42dba9640 1 Processor -- start 2023-11-24T08:08:23.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.036+0000 7fb42dba9640 1 -- start start 2023-11-24T08:08:23.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.037+0000 7fb42dba9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb428161740 0x7fb428168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.037+0000 7fb42dba9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4280cf260 con 0x7fb4280c9870 2023-11-24T08:08:23.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.037+0000 7fb42dba9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4280cf4c0 con 0x7fb4280d0560 2023-11-24T08:08:23.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.037+0000 7fb42dba9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4280d2ef0 con 0x7fb428161740 2023-11-24T08:08:23.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.037+0000 7fb4277fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb4280c9870 0x7fb4280ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51960/0 (socket says 172.21.15.97:51960) 2023-11-24T08:08:23.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4277fe640 1 -- 172.21.15.97:0/2454707280 learned_addr learned my addr 172.21.15.97:0/2454707280 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:23.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611015972 0 0) 0x7fb4280cf260 con 0x7fb4280c9870 2023-11-24T08:08:23.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb408003520 con 0x7fb4280c9870 2023-11-24T08:08:23.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb427fff640 1 --2- 172.21.15.97:0/2454707280 >> v2:172.21.15.183:3300/0 conn(0x7fb428161740 0x7fb428168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471460363 0 0) 0x7fb408003520 con 0x7fb4280c9870 2023-11-24T08:08:23.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 >> v2:172.21.15.183:3300/0 conn(0x7fb428161740 msgr2=0x7fb428168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 --2- 172.21.15.97:0/2454707280 >> v2:172.21.15.183:3300/0 conn(0x7fb428161740 0x7fb428168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 >> v1:172.21.15.183:6789/0 conn(0x7fb4280d0560 legacy=0x7fb428161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280cf7a0 con 0x7fb4280c9870 2023-11-24T08:08:23.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fb418001670 con 0x7fb4280c9870 2023-11-24T08:08:23.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 >> v1:172.21.15.97:6789/0 conn(0x7fb4280c9870 legacy=0x7fb4280ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.038+0000 7fb4267fc640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb408003970 0x7fb408003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb4267fc640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4080047c0 0x7fb408004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb4267fc640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb408005180 0x7fb40800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280d2ef0 con 0x7fb408005180 2023-11-24T08:08:23.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40800c0d0 con 0x7fb408003970 2023-11-24T08:08:23.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40800c290 con 0x7fb4080047c0 2023-11-24T08:08:23.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb427fff640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb408005180 0x7fb40800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb427fff640 1 -- 172.21.15.97:0/2454707280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4080047c0 msgr2=0x7fb408004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb427fff640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4080047c0 0x7fb408004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb427fff640 1 -- 172.21.15.97:0/2454707280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb408003970 msgr2=0x7fb408003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb427fff640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb408003970 0x7fb408003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.039+0000 7fb427fff640 1 -- 172.21.15.97:0/2454707280 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408003520 con 0x7fb408005180 2023-11-24T08:08:23.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.040+0000 7fb427fff640 1 -- 172.21.15.97:0/2454707280 reap_dead start 2023-11-24T08:08:23.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.040+0000 7fb427fff640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb408005180 0x7fb40800b980 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb42000ba30 tx=0x7fb4080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e495f172cde91f34 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420004020 con 0x7fb408005180 2023-11-24T08:08:23.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb420004180 con 0x7fb408005180 2023-11-24T08:08:23.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb4267fc640 1 -- 172.21.15.97:0/2454707280 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420003610 con 0x7fb408005180 2023-11-24T08:08:23.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb42dba9640 1 -- 172.21.15.97:0/2454707280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb408005180 msgr2=0x7fb40800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb42dba9640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb408005180 0x7fb40800b980 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb42000ba30 tx=0x7fb4080057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb42dba9640 1 -- 172.21.15.97:0/2454707280 shutdown_connections 2023-11-24T08:08:23.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb42dba9640 1 --2- 172.21.15.97:0/2454707280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb408005180 0x7fb40800b980 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb42dba9640 1 -- 172.21.15.97:0/2454707280 >> 172.21.15.97:0/2454707280 conn(0x7fb42809c560 msgr2=0x7fb4280d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:23.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb42dba9640 1 -- 172.21.15.97:0/2454707280 shutdown_connections 2023-11-24T08:08:23.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.041+0000 7fb42dba9640 1 -- 172.21.15.97:0/2454707280 wait complete. 2023-11-24T08:08:23.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.043+0000 7fb42dba9640 1 Processor -- start 2023-11-24T08:08:23.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.043+0000 7fb42dba9640 1 -- start start 2023-11-24T08:08:23.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.044+0000 7fb42dba9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb408005180 0x7fb42815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.044+0000 7fb42dba9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb42815ef60 0x7fb428148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.044+0000 7fb42dba9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb42815f3c0 0x7fb428148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.044+0000 7fb42dba9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb428148cb0 con 0x7fb42815ef60 2023-11-24T08:08:23.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.044+0000 7fb42dba9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280ccd40 con 0x7fb42815f3c0 2023-11-24T08:08:23.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.044+0000 7fb42dba9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb428159320 con 0x7fb408005180 2023-11-24T08:08:23.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb42815ef60 0x7fb428148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb42815ef60 0x7fb428148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34848/0 (socket says 172.21.15.97:34848) 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 -- 172.21.15.97:0/3576122292 learned_addr learned my addr 172.21.15.97:0/3576122292 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb4277fe640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb408005180 0x7fb42815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 -- 172.21.15.97:0/3576122292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb408005180 msgr2=0x7fb42815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb408005180 0x7fb42815a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 -- 172.21.15.97:0/3576122292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb42815f3c0 msgr2=0x7fb428148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb42815f3c0 0x7fb428148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 -- 172.21.15.97:0/3576122292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428159600 con 0x7fb42815ef60 2023-11-24T08:08:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb426ffd640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb42815ef60 0x7fb428148230 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c7a0 tx=0x7fb41000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.045+0000 7fb41ffff640 1 -- 172.21.15.97:0/3576122292 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410003b90 con 0x7fb42815ef60 2023-11-24T08:08:23.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.046+0000 7fb41ffff640 1 -- 172.21.15.97:0/3576122292 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410003cf0 con 0x7fb42815ef60 2023-11-24T08:08:23.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.046+0000 7fb41ffff640 1 -- 172.21.15.97:0/3576122292 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41000aa90 con 0x7fb42815ef60 2023-11-24T08:08:23.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.046+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4281598e0 con 0x7fb42815ef60 2023-11-24T08:08:23.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.046+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4280cc050 con 0x7fb42815ef60 2023-11-24T08:08:23.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.047+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4280675d0 con 0x7fb42815ef60 2023-11-24T08:08:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.048+0000 7fb41ffff640 1 -- 172.21.15.97:0/3576122292 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb41000abf0 con 0x7fb42815ef60 2023-11-24T08:08:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.049+0000 7fb41ffff640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb40c06ae70 0x7fb40c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.049+0000 7fb41ffff640 1 -- 172.21.15.97:0/3576122292 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4100895a0 con 0x7fb42815ef60 2023-11-24T08:08:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.050+0000 7fb4277fe640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb40c06ae70 0x7fb40c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.050+0000 7fb4277fe640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb40c06ae70 0x7fb40c06d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb418001820 tx=0x7fb4180015b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.054+0000 7fb41ffff640 1 -- 172.21.15.97:0/3576122292 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb410054520 con 0x7fb42815ef60 2023-11-24T08:08:23.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.243+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4280d0a20 con 0x7fb42815ef60 2023-11-24T08:08:23.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.244+0000 7fb41ffff640 1 -- 172.21.15.97:0/3576122292 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb410003e60 con 0x7fb42815ef60 2023-11-24T08:08:23.247 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:08:23.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.246+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb40c06ae70 msgr2=0x7fb40c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.246+0000 7fb42dba9640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb40c06ae70 0x7fb40c06d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb418001820 tx=0x7fb4180015b0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.246+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb42815ef60 msgr2=0x7fb428148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.246+0000 7fb42dba9640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb42815ef60 0x7fb428148230 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c7a0 tx=0x7fb41000cc60 comp rx=0 tx=0).stop 2023-11-24T08:08:23.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 shutdown_connections 2023-11-24T08:08:23.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fb40c06ae70 0x7fb40c06d330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb42815f3c0 0x7fb428148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb42815ef60 0x7fb428148230 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 --2- 172.21.15.97:0/3576122292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb408005180 0x7fb42815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 >> 172.21.15.97:0/3576122292 conn(0x7fb42809c560 msgr2=0x7fb4280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:23.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 shutdown_connections 2023-11-24T08:08:23.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.247+0000 7fb42dba9640 1 -- 172.21.15.97:0/3576122292 wait complete. 2023-11-24T08:08:23.266 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:08:23.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.470+0000 7f0af51a9640 1 Processor -- start 2023-11-24T08:08:23.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.470+0000 7f0af51a9640 1 -- start start 2023-11-24T08:08:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.472+0000 7f0af51a9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0af00cf9a0 0x7f0af015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.472+0000 7f0af51a9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00b1ee0 con 0x7f0af0143ae0 2023-11-24T08:08:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.472+0000 7f0af51a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00b2780 con 0x7f0af015e1e0 2023-11-24T08:08:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.472+0000 7f0af51a9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af015e990 con 0x7f0af00cf9a0 2023-11-24T08:08:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.472+0000 7f0aeed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0af0143ae0 0x7f0af00cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51974/0 (socket says 172.21.15.97:51974) 2023-11-24T08:08:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.472+0000 7f0aeed9d640 1 -- 172.21.15.97:0/3628346015 learned_addr learned my addr 172.21.15.97:0/3628346015 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.472+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807614647 0 0) 0x7f0af00b1ee0 con 0x7f0af0143ae0 2023-11-24T08:08:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0adc003520 con 0x7f0af0143ae0 2023-11-24T08:08:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aee59c640 1 --2- 172.21.15.97:0/3628346015 >> v2:172.21.15.183:3300/0 conn(0x7f0af00cf9a0 0x7f0af015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915762361 0 0) 0x7f0adc003520 con 0x7f0af0143ae0 2023-11-24T08:08:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 >> v2:172.21.15.183:3300/0 conn(0x7f0af00cf9a0 msgr2=0x7f0af015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 --2- 172.21.15.97:0/3628346015 >> v2:172.21.15.183:3300/0 conn(0x7f0af00cf9a0 0x7f0af015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 >> v1:172.21.15.183:6789/0 conn(0x7f0af015e1e0 legacy=0x7f0af00702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00b2130 con 0x7f0af0143ae0 2023-11-24T08:08:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f0ae0001670 con 0x7f0af0143ae0 2023-11-24T08:08:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 >> v1:172.21.15.97:6789/0 conn(0x7f0af0143ae0 legacy=0x7f0af00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0039c0 0x7f0adc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0047c0 0x7f0adc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc0051d0 0x7f0adc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af015e990 con 0x7f0adc0039c0 2023-11-24T08:08:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc00c120 con 0x7f0adc0051d0 2023-11-24T08:08:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc00c2e0 con 0x7f0adc0047c0 2023-11-24T08:08:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.473+0000 7f0aeed9d640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0039c0 0x7f0adc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.474+0000 7f0aeed9d640 1 -- 172.21.15.97:0/3628346015 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0047c0 msgr2=0x7f0adc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.474+0000 7f0aeed9d640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0047c0 0x7f0adc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.474+0000 7f0aeed9d640 1 -- 172.21.15.97:0/3628346015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc0051d0 msgr2=0x7f0adc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.474+0000 7f0aeed9d640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0adc0051d0 0x7f0adc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.474+0000 7f0aeed9d640 1 -- 172.21.15.97:0/3628346015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc003520 con 0x7f0adc0039c0 2023-11-24T08:08:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.474+0000 7f0aef59e640 1 -- 172.21.15.97:0/3628346015 reap_dead start 2023-11-24T08:08:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.475+0000 7f0aeed9d640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0039c0 0x7f0adc003de0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c0e0 tx=0x7f0adc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4b24cd0b8f845 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.475+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0005ad0 con 0x7f0adc0039c0 2023-11-24T08:08:23.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.475+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0005c30 con 0x7f0adc0039c0 2023-11-24T08:08:23.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.475+0000 7f0aedd9b640 1 -- 172.21.15.97:0/3628346015 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae002ca50 con 0x7f0adc0039c0 2023-11-24T08:08:23.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.475+0000 7f0af51a9640 1 -- 172.21.15.97:0/3628346015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0039c0 msgr2=0x7f0adc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.475+0000 7f0af51a9640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0039c0 0x7f0adc003de0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c0e0 tx=0x7f0adc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.476+0000 7f0af51a9640 1 -- 172.21.15.97:0/3628346015 shutdown_connections 2023-11-24T08:08:23.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.476+0000 7f0af51a9640 1 --2- 172.21.15.97:0/3628346015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0adc0039c0 0x7f0adc003de0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.476+0000 7f0af51a9640 1 -- 172.21.15.97:0/3628346015 >> 172.21.15.97:0/3628346015 conn(0x7f0af006a800 msgr2=0x7f0af006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:23.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.476+0000 7f0af51a9640 1 -- 172.21.15.97:0/3628346015 shutdown_connections 2023-11-24T08:08:23.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.476+0000 7f0af51a9640 1 -- 172.21.15.97:0/3628346015 wait complete. 2023-11-24T08:08:23.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.477+0000 7f0af51a9640 1 Processor -- start 2023-11-24T08:08:23.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.478+0000 7f0af51a9640 1 -- start start 2023-11-24T08:08:23.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.478+0000 7f0af51a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0039c0 0x7f0af00cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0af51a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af00cd8c0 0x7f0af01ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0af51a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af01eebe0 0x7f0af01ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0af51a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af01ef5d0 con 0x7f0af01eebe0 2023-11-24T08:08:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0af51a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00ce0f0 con 0x7f0af00cd8c0 2023-11-24T08:08:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0af51a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00ce3d0 con 0x7f0adc0039c0 2023-11-24T08:08:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0aef59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af01eebe0 0x7f0af01ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0aeed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0039c0 0x7f0af00cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0aef59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af01eebe0 0x7f0af01ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34862/0 (socket says 172.21.15.97:34862) 2023-11-24T08:08:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0aef59e640 1 -- 172.21.15.97:0/2931444094 learned_addr learned my addr 172.21.15.97:0/2931444094 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0aeed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0039c0 0x7f0af00cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:59878/0 (socket says 172.21.15.97:59878) 2023-11-24T08:08:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.479+0000 7f0aee59c640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af00cd8c0 0x7f0af01ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0aef59e640 1 -- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0039c0 msgr2=0x7f0af00cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0aef59e640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0039c0 0x7f0af00cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0aef59e640 1 -- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af00cd8c0 msgr2=0x7f0af01ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0aef59e640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af00cd8c0 0x7f0af01ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0aef59e640 1 -- 172.21.15.97:0/2931444094 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00ce6b0 con 0x7f0af01eebe0 2023-11-24T08:08:23.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0aee59c640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af00cd8c0 0x7f0af01ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0aef59e640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af01eebe0 0x7f0af01ef090 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0af0071f10 tx=0x7f0ae800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0ae77fe640 1 -- 172.21.15.97:0/2931444094 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8005d40 con 0x7f0af01eebe0 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0ae77fe640 1 -- 172.21.15.97:0/2931444094 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae800f040 con 0x7f0af01eebe0 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af00ce990 con 0x7f0af01eebe0 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0ae77fe640 1 -- 172.21.15.97:0/2931444094 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8005ea0 con 0x7f0af01eebe0 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.480+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af013de20 con 0x7f0af01eebe0 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.481+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af00675d0 con 0x7f0af01eebe0 2023-11-24T08:08:23.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.483+0000 7f0ae77fe640 1 -- 172.21.15.97:0/2931444094 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ae800c850 con 0x7f0af01eebe0 2023-11-24T08:08:23.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.483+0000 7f0ae77fe640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ad006ae70 0x7f0ad006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.484+0000 7f0ae77fe640 1 -- 172.21.15.97:0/2931444094 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ae8089220 con 0x7f0af01eebe0 2023-11-24T08:08:23.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.484+0000 7f0aeed9d640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ad006ae70 0x7f0ad006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.485+0000 7f0aeed9d640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ad006ae70 0x7f0ad006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0034000 tx=0x7f0ae003e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.488+0000 7f0ae77fe640 1 -- 172.21.15.97:0/2931444094 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ae8054230 con 0x7f0af01eebe0 2023-11-24T08:08:23.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.676+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0af00cf390 con 0x7f0af01eebe0 2023-11-24T08:08:23.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.677+0000 7f0ae77fe640 1 -- 172.21.15.97:0/2931444094 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ae8057850 con 0x7f0af01eebe0 2023-11-24T08:08:23.679 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-11-24T08:08:23.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ad006ae70 msgr2=0x7f0ad006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ad006ae70 0x7f0ad006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0034000 tx=0x7f0ae003e040 comp rx=0 tx=0).stop 2023-11-24T08:08:23.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af01eebe0 msgr2=0x7f0af01ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af01eebe0 0x7f0af01ef090 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0af0071f10 tx=0x7f0ae800db80 comp rx=0 tx=0).stop 2023-11-24T08:08:23.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 shutdown_connections 2023-11-24T08:08:23.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f0ad006ae70 0x7f0ad006d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0af01eebe0 0x7f0af01ef090 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af00cd8c0 0x7f0af01ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 --2- 172.21.15.97:0/2931444094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0adc0039c0 0x7f0af00cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 >> 172.21.15.97:0/2931444094 conn(0x7f0af006a800 msgr2=0x7f0af00b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:23.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 shutdown_connections 2023-11-24T08:08:23.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.679+0000 7f0af51a9640 1 -- 172.21.15.97:0/2931444094 wait complete. 2023-11-24T08:08:23.700 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:08:23.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.910+0000 7fcbe8ebb640 1 Processor -- start 2023-11-24T08:08:23.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.910+0000 7fcbe8ebb640 1 -- start start 2023-11-24T08:08:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe8ebb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe8ebb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcbe415d770 0x7fcbe415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe8ebb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe415e140 con 0x7fcbe40ae170 2023-11-24T08:08:23.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe8ebb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe4143bf0 con 0x7fcbe415d770 2023-11-24T08:08:23.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe8ebb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe406c730 con 0x7fcbe4143810 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcbe415d770 0x7fcbe415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcbe415d770 0x7fcbe415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34868/0 (socket says 172.21.15.97:34868) 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.912+0000 7fcbe3fff640 1 -- 172.21.15.97:0/813319462 learned_addr learned my addr 172.21.15.97:0/813319462 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.913+0000 7fcbe37fe640 1 --2- 172.21.15.97:0/813319462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.913+0000 7fcbe3fff640 1 -- 172.21.15.97:0/813319462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 msgr2=0x7fcbe4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.913+0000 7fcbe3fff640 1 --2- 172.21.15.97:0/813319462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe4071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.913+0000 7fcbe3fff640 1 -- 172.21.15.97:0/813319462 >> v1:172.21.15.183:6789/0 conn(0x7fcbe40ae170 legacy=0x7fcbe415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.913+0000 7fcbe3fff640 1 -- 172.21.15.97:0/813319462 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40ae5f0 con 0x7fcbe415d770 2023-11-24T08:08:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.914+0000 7fcbe3fff640 1 --2- 172.21.15.97:0/813319462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe415dc00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009e50 tx=0x7fcbdc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13816e2bdecab261 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.914+0000 7fcbe2ffd640 1 -- 172.21.15.97:0/813319462 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc02c9e0 con 0x7fcbe415d770 2023-11-24T08:08:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.914+0000 7fcbe2ffd640 1 -- 172.21.15.97:0/813319462 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc02cb40 con 0x7fcbe415d770 2023-11-24T08:08:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.914+0000 7fcbe2ffd640 1 -- 172.21.15.97:0/813319462 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0343f0 con 0x7fcbe415d770 2023-11-24T08:08:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/813319462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 msgr2=0x7fcbe415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/813319462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe415dc00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009e50 tx=0x7fcbdc02be40 comp rx=0 tx=0).stop 2023-11-24T08:08:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/813319462 shutdown_connections 2023-11-24T08:08:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/813319462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe415dc00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/813319462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe4071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/813319462 >> 172.21.15.97:0/813319462 conn(0x7fcbe406a7d0 msgr2=0x7fcbe406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:23.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/813319462 shutdown_connections 2023-11-24T08:08:23.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.915+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/813319462 wait complete. 2023-11-24T08:08:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.917+0000 7fcbe8ebb640 1 Processor -- start 2023-11-24T08:08:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.917+0000 7fcbe8ebb640 1 -- start start 2023-11-24T08:08:23.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.918+0000 7fcbe8ebb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbe40ae170 0x7fcbe40b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.918+0000 7fcbe8ebb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.918+0000 7fcbe8ebb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.918+0000 7fcbe8ebb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe412e6d0 con 0x7fcbe415d770 2023-11-24T08:08:23.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.918+0000 7fcbe8ebb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4130a10 con 0x7fcbe40ae170 2023-11-24T08:08:23.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.918+0000 7fcbe8ebb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4071bb0 con 0x7fcbe4143810 2023-11-24T08:08:23.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.918+0000 7fcbe3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe41304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34872/0 (socket says 172.21.15.97:34872) 2023-11-24T08:08:23.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 -- 172.21.15.97:0/3432471623 learned_addr learned my addr 172.21.15.97:0/3432471623 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:23.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe37fe640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbe40ae170 0x7fcbe40b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbdbfff640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 -- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 msgr2=0x7fcbe412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 -- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbe40ae170 msgr2=0x7fcbe40b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbe40ae170 0x7fcbe40b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 -- 172.21.15.97:0/3432471623 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009b30 con 0x7fcbe415d770 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbdbfff640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.919+0000 7fcbe3fff640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe41304d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc036040 tx=0x7fcbdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.920+0000 7fcbe0ff9640 1 -- 172.21.15.97:0/3432471623 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc009510 con 0x7fcbe415d770 2023-11-24T08:08:23.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.920+0000 7fcbe0ff9640 1 -- 172.21.15.97:0/3432471623 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc03e450 con 0x7fcbe415d770 2023-11-24T08:08:23.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.920+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe4130ef0 con 0x7fcbe415d770 2023-11-24T08:08:23.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.920+0000 7fcbe0ff9640 1 -- 172.21.15.97:0/3432471623 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc03e800 con 0x7fcbe415d770 2023-11-24T08:08:23.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.920+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe412e010 con 0x7fcbe415d770 2023-11-24T08:08:23.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.921+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe412e810 con 0x7fcbe415d770 2023-11-24T08:08:23.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.922+0000 7fcbe0ff9640 1 -- 172.21.15.97:0/3432471623 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbdc03e960 con 0x7fcbe415d770 2023-11-24T08:08:23.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.922+0000 7fcbe0ff9640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcbc406ae40 0x7fcbc406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:23.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.923+0000 7fcbe0ff9640 1 -- 172.21.15.97:0/3432471623 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbdc0ac420 con 0x7fcbe415d770 2023-11-24T08:08:23.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.923+0000 7fcbe37fe640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcbc406ae40 0x7fcbc406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:23.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.923+0000 7fcbe37fe640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcbc406ae40 0x7fcbc406d300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4006fd0 tx=0x7fcbd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:23.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:23.927+0000 7fcbe0ff9640 1 -- 172.21.15.97:0/3432471623 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbe412e810 con 0x7fcbe415d770 2023-11-24T08:08:24.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.115+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbe412e810 con 0x7fcbe415d770 2023-11-24T08:08:24.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.116+0000 7fcbe0ff9640 1 -- 172.21.15.97:0/3432471623 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbe412e810 con 0x7fcbe415d770 2023-11-24T08:08:24.118 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-11-24T08:08:24.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.118+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcbc406ae40 msgr2=0x7fcbc406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.118+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcbc406ae40 0x7fcbc406d300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4006fd0 tx=0x7fcbd4008040 comp rx=0 tx=0).stop 2023-11-24T08:08:24.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.118+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 msgr2=0x7fcbe41304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.118+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe41304d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc036040 tx=0x7fcbdc004a40 comp rx=0 tx=0).stop 2023-11-24T08:08:24.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 shutdown_connections 2023-11-24T08:08:24.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcbc406ae40 0x7fcbc406d300 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbe415d770 0x7fcbe41304d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbe4143810 0x7fcbe412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 --2- 172.21.15.97:0/3432471623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbe40ae170 0x7fcbe40b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 >> 172.21.15.97:0/3432471623 conn(0x7fcbe406a7d0 msgr2=0x7fcbe4140600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:24.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 shutdown_connections 2023-11-24T08:08:24.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.119+0000 7fcbe8ebb640 1 -- 172.21.15.97:0/3432471623 wait complete. 2023-11-24T08:08:24.137 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:24.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.332+0000 7f958da0e640 1 Processor -- start 2023-11-24T08:08:24.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.332+0000 7f958da0e640 1 -- start start 2023-11-24T08:08:24.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.333+0000 7f958da0e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880b3ae0 0x7f958815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.333+0000 7f958da0e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f95880cf290 0x7f95880cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.333+0000 7f958da0e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9588070c40 con 0x7f95880ae5a0 2023-11-24T08:08:24.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.333+0000 7f958da0e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9588071450 con 0x7f95880cf290 2023-11-24T08:08:24.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.333+0000 7f958da0e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880cfc60 con 0x7f95880b3ae0 2023-11-24T08:08:24.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.334+0000 7f95867fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880b3ae0 0x7f958815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.334+0000 7f9586ffd640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f95880ae5a0 0x7f958806cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:41434/0 (socket says 172.21.15.97:41434) 2023-11-24T08:08:24.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.334+0000 7f95867fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880b3ae0 0x7f958815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:59910/0 (socket says 172.21.15.97:59910) 2023-11-24T08:08:24.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.334+0000 7f9586ffd640 1 -- 172.21.15.97:0/3772569819 learned_addr learned my addr 172.21.15.97:0/3772569819 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:24.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.334+0000 7f95877fe640 1 --2- 172.21.15.97:0/3772569819 >> v2:172.21.15.183:3300/0 conn(0x7f95880cf290 0x7f95880cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.335+0000 7f95867fc640 1 -- 172.21.15.97:0/3772569819 >> v2:172.21.15.183:3300/0 conn(0x7f95880cf290 msgr2=0x7f95880cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:24.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.335+0000 7f95867fc640 1 --2- 172.21.15.97:0/3772569819 >> v2:172.21.15.183:3300/0 conn(0x7f95880cf290 0x7f95880cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.335+0000 7f95867fc640 1 -- 172.21.15.97:0/3772569819 >> v1:172.21.15.183:6789/0 conn(0x7f95880ae5a0 legacy=0x7f958806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.335+0000 7f95867fc640 1 -- 172.21.15.97:0/3772569819 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958806c470 con 0x7f95880b3ae0 2023-11-24T08:08:24.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.335+0000 7f9585ffb640 1 -- 172.21.15.97:0/3772569819 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428757764 0 0) 0x7f9588070c40 con 0x7f95880ae5a0 2023-11-24T08:08:24.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.337+0000 7f95867fc640 1 --2- 172.21.15.97:0/3772569819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880b3ae0 0x7f958815e430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097a0 tx=0x7f957c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a0055458ff3284 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.337+0000 7f9585ffb640 1 -- 172.21.15.97:0/3772569819 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c030800 con 0x7f95880b3ae0 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.337+0000 7f9585ffb640 1 -- 172.21.15.97:0/3772569819 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c030960 con 0x7f95880b3ae0 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.337+0000 7f9585ffb640 1 -- 172.21.15.97:0/3772569819 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c030cf0 con 0x7f95880b3ae0 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 -- 172.21.15.97:0/3772569819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880b3ae0 msgr2=0x7f958815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 --2- 172.21.15.97:0/3772569819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880b3ae0 0x7f958815e430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097a0 tx=0x7f957c02b940 comp rx=0 tx=0).stop 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 -- 172.21.15.97:0/3772569819 shutdown_connections 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 --2- 172.21.15.97:0/3772569819 >> v2:172.21.15.183:3300/0 conn(0x7f95880cf290 0x7f95880cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 --2- 172.21.15.97:0/3772569819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880b3ae0 0x7f958815e430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 -- 172.21.15.97:0/3772569819 >> 172.21.15.97:0/3772569819 conn(0x7f958806a800 msgr2=0x7f958806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:24.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 -- 172.21.15.97:0/3772569819 shutdown_connections 2023-11-24T08:08:24.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.338+0000 7f958da0e640 1 -- 172.21.15.97:0/3772569819 wait complete. 2023-11-24T08:08:24.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.340+0000 7f958da0e640 1 Processor -- start 2023-11-24T08:08:24.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.340+0000 7f958da0e640 1 -- start start 2023-11-24T08:08:24.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f958da0e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880ae5a0 0x7f95881f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f958da0e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95880b3ae0 0x7f95881f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f958da0e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95880cf290 0x7f95881f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f958da0e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95881f4f10 con 0x7f95880cf290 2023-11-24T08:08:24.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f958da0e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95881f3c60 con 0x7f95880b3ae0 2023-11-24T08:08:24.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f958da0e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95881f4290 con 0x7f95880ae5a0 2023-11-24T08:08:24.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f95877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95880cf290 0x7f95881f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f95877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95880cf290 0x7f95881f3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34886/0 (socket says 172.21.15.97:34886) 2023-11-24T08:08:24.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f95877fe640 1 -- 172.21.15.97:0/595056211 learned_addr learned my addr 172.21.15.97:0/595056211 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:24.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.341+0000 7f9586ffd640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880ae5a0 0x7f95881f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95877fe640 1 -- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880ae5a0 msgr2=0x7f95881f0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95877fe640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880ae5a0 0x7f95881f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95867fc640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95880b3ae0 0x7f95881f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95877fe640 1 -- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95880b3ae0 msgr2=0x7f95881f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95877fe640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95880b3ae0 0x7f95881f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95877fe640 1 -- 172.21.15.97:0/595056211 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009400 con 0x7f95880cf290 2023-11-24T08:08:24.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95867fc640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95880b3ae0 0x7f95881f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:24.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f95877fe640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95880cf290 0x7f95881f3720 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f958000efc0 tx=0x7f958000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:24.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f956ffff640 1 -- 172.21.15.97:0/595056211 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580009ba0 con 0x7f95880cf290 2023-11-24T08:08:24.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f956ffff640 1 -- 172.21.15.97:0/595056211 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958000f040 con 0x7f95880cf290 2023-11-24T08:08:24.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95881f4570 con 0x7f95880cf290 2023-11-24T08:08:24.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f956ffff640 1 -- 172.21.15.97:0/595056211 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800146c0 con 0x7f95880cf290 2023-11-24T08:08:24.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.342+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95881f4b30 con 0x7f95880cf290 2023-11-24T08:08:24.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.343+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95881f5050 con 0x7f95880cf290 2023-11-24T08:08:24.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.344+0000 7f956ffff640 1 -- 172.21.15.97:0/595056211 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9580014820 con 0x7f95880cf290 2023-11-24T08:08:24.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.345+0000 7f956ffff640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f957406ae40 0x7f957406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.345+0000 7f956ffff640 1 -- 172.21.15.97:0/595056211 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f958008a0e0 con 0x7f95880cf290 2023-11-24T08:08:24.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.346+0000 7f9586ffd640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f957406ae40 0x7f957406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.346+0000 7f9586ffd640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f957406ae40 0x7f957406d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9578007fd0 tx=0x7f9578009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:24.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.350+0000 7f956ffff640 1 -- 172.21.15.97:0/595056211 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95881f5050 con 0x7f95880cf290 2023-11-24T08:08:24.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.576+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95881f5050 con 0x7f95880cf290 2023-11-24T08:08:24.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.577+0000 7f956ffff640 1 -- 172.21.15.97:0/595056211 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f95881f5050 con 0x7f95880cf290 2023-11-24T08:08:24.579 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:24.579 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3619089631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3619089631},{"type":"v1","addr":"172.21.15.183:6834","nonce":3619089631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1237344944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1237344944},{"type":"v1","addr":"172.21.15.97:6837","nonce":1237344944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1425639784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1425639784},{"type":"v1","addr":"172.21.15.183:6835","nonce":1425639784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:08:02.652077+0000","modified":"2023-11-24T08:08:05.725467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5244":{"gid":5244,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.97:6835/4116734497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4116734497},{"type":"v1","addr":"172.21.15.97:6835","nonce":4116734497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:08:24.579 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 18 2023-11-24T08:08:24.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.579+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f957406ae40 msgr2=0x7f957406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.579+0000 7f958da0e640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f957406ae40 0x7f957406d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9578007fd0 tx=0x7f9578009040 comp rx=0 tx=0).stop 2023-11-24T08:08:24.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.579+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95880cf290 msgr2=0x7f95881f3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.579+0000 7f958da0e640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95880cf290 0x7f95881f3720 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f958000efc0 tx=0x7f958000c490 comp rx=0 tx=0).stop 2023-11-24T08:08:24.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 shutdown_connections 2023-11-24T08:08:24.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f957406ae40 0x7f957406d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95880cf290 0x7f95881f3720 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95880b3ae0 0x7f95881f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 --2- 172.21.15.97:0/595056211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95880ae5a0 0x7f95881f0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 >> 172.21.15.97:0/595056211 conn(0x7f958806a800 msgr2=0x7f95880b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:24.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 shutdown_connections 2023-11-24T08:08:24.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.580+0000 7f958da0e640 1 -- 172.21.15.97:0/595056211 wait complete. 2023-11-24T08:08:24.601 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:24.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.798+0000 7f3957fff640 1 Processor -- start 2023-11-24T08:08:24.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.798+0000 7f3957fff640 1 -- start start 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.799+0000 7f3957fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f395813cfa0 0x7f395815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.799+0000 7f3957fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 0x7f395813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.799+0000 7f3957fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f39580cd9b0 0x7f395813fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.799+0000 7f3957fff640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580cdec0 con 0x7f395813cfa0 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.799+0000 7f3957fff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580ce1a0 con 0x7f39580cd9b0 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.799+0000 7f3957fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39580ce480 con 0x7f39580cd530 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f395813cfa0 0x7f395815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f395813cfa0 0x7f395815afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34900/0 (socket says 172.21.15.97:34900) 2023-11-24T08:08:24.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 -- 172.21.15.97:0/3888111059 learned_addr learned my addr 172.21.15.97:0/3888111059 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:24.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 -- 172.21.15.97:0/3888111059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 msgr2=0x7f395813f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:24.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 --2- 172.21.15.97:0/3888111059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 0x7f395813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 -- 172.21.15.97:0/3888111059 >> v2:172.21.15.183:3300/0 conn(0x7f39580cd9b0 msgr2=0x7f395813fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:24.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 --2- 172.21.15.97:0/3888111059 >> v2:172.21.15.183:3300/0 conn(0x7f39580cd9b0 0x7f395813fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.800+0000 7f3956ffd640 1 -- 172.21.15.97:0/3888111059 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580ce760 con 0x7f395813cfa0 2023-11-24T08:08:24.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.801+0000 7f3956ffd640 1 --2- 172.21.15.97:0/3888111059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f395813cfa0 0x7f395815afb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f395806ce70 tx=0x7f394802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c025051efc556be5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:24.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.801+0000 7f39567fc640 1 -- 172.21.15.97:0/3888111059 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480317e0 con 0x7f395813cfa0 2023-11-24T08:08:24.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f39567fc640 1 -- 172.21.15.97:0/3888111059 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948031940 con 0x7f395813cfa0 2023-11-24T08:08:24.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f39567fc640 1 -- 172.21.15.97:0/3888111059 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948031cd0 con 0x7f395813cfa0 2023-11-24T08:08:24.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 -- 172.21.15.97:0/3888111059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f395813cfa0 msgr2=0x7f395815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 --2- 172.21.15.97:0/3888111059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f395813cfa0 0x7f395815afb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f395806ce70 tx=0x7f394802b880 comp rx=0 tx=0).stop 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 -- 172.21.15.97:0/3888111059 shutdown_connections 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 --2- 172.21.15.97:0/3888111059 >> v2:172.21.15.183:3300/0 conn(0x7f39580cd9b0 0x7f395813fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 --2- 172.21.15.97:0/3888111059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 0x7f395813f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 --2- 172.21.15.97:0/3888111059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f395813cfa0 0x7f395815afb0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 -- 172.21.15.97:0/3888111059 >> 172.21.15.97:0/3888111059 conn(0x7f395806a800 msgr2=0x7f395806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 -- 172.21.15.97:0/3888111059 shutdown_connections 2023-11-24T08:08:24.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.802+0000 7f3957fff640 1 -- 172.21.15.97:0/3888111059 wait complete. 2023-11-24T08:08:24.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.804+0000 7f3957fff640 1 Processor -- start 2023-11-24T08:08:24.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.804+0000 7f3957fff640 1 -- start start 2023-11-24T08:08:24.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f3957fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 0x7f3958150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f3957fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39580cd9b0 0x7f39581301b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f3957fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395813cfa0 0x7f39581f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f3957fff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395814d5a0 con 0x7f39580cd9b0 2023-11-24T08:08:24.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f3957fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39581306f0 con 0x7f395813cfa0 2023-11-24T08:08:24.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f3957fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395814c990 con 0x7f39580cd530 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39580cd9b0 0x7f39581301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f394e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39580cd9b0 0x7f39581301b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34916/0 (socket says 172.21.15.97:34916) 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.805+0000 7f394e7fc640 1 -- 172.21.15.97:0/3051411636 learned_addr learned my addr 172.21.15.97:0/3051411636 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f3956ffd640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 0x7f3958150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f394e7fc640 1 -- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 msgr2=0x7f3958150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f39577fe640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395813cfa0 0x7f39581f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f394e7fc640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 0x7f3958150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f394e7fc640 1 -- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395813cfa0 msgr2=0x7f39581f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f394e7fc640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395813cfa0 0x7f39581f0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f394e7fc640 1 -- 172.21.15.97:0/3051411636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39480094d0 con 0x7f39580cd9b0 2023-11-24T08:08:24.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f394e7fc640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39580cd9b0 0x7f39581301b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f394000b450 tx=0x7f394000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:24.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f3954ff9640 1 -- 172.21.15.97:0/3051411636 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940011890 con 0x7f39580cd9b0 2023-11-24T08:08:24.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f3954ff9640 1 -- 172.21.15.97:0/3051411636 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39400119f0 con 0x7f39580cd9b0 2023-11-24T08:08:24.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395814cc70 con 0x7f39580cd9b0 2023-11-24T08:08:24.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f3954ff9640 1 -- 172.21.15.97:0/3051411636 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940011da0 con 0x7f39580cd9b0 2023-11-24T08:08:24.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.806+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395814d230 con 0x7f39580cd9b0 2023-11-24T08:08:24.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.807+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3958151100 con 0x7f39580cd9b0 2023-11-24T08:08:24.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.808+0000 7f3954ff9640 1 -- 172.21.15.97:0/3051411636 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f394001a400 con 0x7f39580cd9b0 2023-11-24T08:08:24.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.809+0000 7f3954ff9640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f393806ae40 0x7f393806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:24.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.809+0000 7f3954ff9640 1 -- 172.21.15.97:0/3051411636 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3940089ad0 con 0x7f39580cd9b0 2023-11-24T08:08:24.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.809+0000 7f3956ffd640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f393806ae40 0x7f393806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:24.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.810+0000 7f3956ffd640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f393806ae40 0x7f393806d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3948036000 tx=0x7f394803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:24.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.813+0000 7f3954ff9640 1 -- 172.21.15.97:0/3051411636 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3940054ae0 con 0x7f39580cd9b0 2023-11-24T08:08:24.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.989+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3958067450 con 0x7f39580cd9b0 2023-11-24T08:08:24.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.991+0000 7f3954ff9640 1 -- 172.21.15.97:0/3051411636 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f3940015020 con 0x7f39580cd9b0 2023-11-24T08:08:24.994 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:24.994 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:04.217727+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:24.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.993+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f393806ae40 msgr2=0x7f393806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.993+0000 7f3957fff640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f393806ae40 0x7f393806d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3948036000 tx=0x7f394803d040 comp rx=0 tx=0).stop 2023-11-24T08:08:24.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.993+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39580cd9b0 msgr2=0x7f39581301b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:24.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.993+0000 7f3957fff640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39580cd9b0 0x7f39581301b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f394000b450 tx=0x7f394000b910 comp rx=0 tx=0).stop 2023-11-24T08:08:24.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 shutdown_connections 2023-11-24T08:08:24.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f393806ae40 0x7f393806d300 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395813cfa0 0x7f39581f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39580cd9b0 0x7f39581301b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 --2- 172.21.15.97:0/3051411636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580cd530 0x7f3958150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:24.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 >> 172.21.15.97:0/3051411636 conn(0x7f395806a800 msgr2=0x7f395815c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:24.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 shutdown_connections 2023-11-24T08:08:24.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:24.994+0000 7f3957fff640 1 -- 172.21.15.97:0/3051411636 wait complete. 2023-11-24T08:08:25.013 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:08:25.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:25.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.214+0000 7f0692d0f640 1 Processor -- start 2023-11-24T08:08:25.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.214+0000 7f0692d0f640 1 -- start start 2023-11-24T08:08:25.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.216+0000 7f0692d0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f068c0cf9a0 0x7f068c166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.216+0000 7f0692d0f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c15c5f0 con 0x7f068c13df80 2023-11-24T08:08:25.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.216+0000 7f0692d0f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c06c470 con 0x7f068c13e360 2023-11-24T08:08:25.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.216+0000 7f0692d0f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c06c750 con 0x7f068c0cf9a0 2023-11-24T08:08:25.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.216+0000 7f0690aab640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f068c13df80 0x7f068c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51984/0 (socket says 172.21.15.97:51984) 2023-11-24T08:08:25.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.216+0000 7f0690aab640 1 -- 172.21.15.97:0/4075626012 learned_addr learned my addr 172.21.15.97:0/4075626012 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:25.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.216+0000 7f06912ac640 1 --2- 172.21.15.97:0/4075626012 >> v2:172.21.15.97:3300/0 conn(0x7f068c0cf9a0 0x7f068c166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.217+0000 7f068b7fe640 1 -- 172.21.15.97:0/4075626012 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307525739 0 0) 0x7f068c15c5f0 con 0x7f068c13df80 2023-11-24T08:08:25.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.217+0000 7f068b7fe640 1 -- 172.21.15.97:0/4075626012 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f067c003520 con 0x7f068c13df80 2023-11-24T08:08:25.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.217+0000 7f06912ac640 1 -- 172.21.15.97:0/4075626012 >> v1:172.21.15.183:6789/0 conn(0x7f068c13e360 legacy=0x7f068c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.217+0000 7f06912ac640 1 -- 172.21.15.97:0/4075626012 >> v1:172.21.15.97:6789/0 conn(0x7f068c13df80 legacy=0x7f068c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.217+0000 7f06912ac640 1 -- 172.21.15.97:0/4075626012 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c06ca30 con 0x7f068c0cf9a0 2023-11-24T08:08:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.218+0000 7f06912ac640 1 --2- 172.21.15.97:0/4075626012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c0cf9a0 0x7f068c166030 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0684009d90 tx=0x7f068402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d75d06b0db70a83 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.218+0000 7f068b7fe640 1 -- 172.21.15.97:0/4075626012 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068402cd00 con 0x7f068c0cf9a0 2023-11-24T08:08:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f068b7fe640 1 -- 172.21.15.97:0/4075626012 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068402ce60 con 0x7f068c0cf9a0 2023-11-24T08:08:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f068b7fe640 1 -- 172.21.15.97:0/4075626012 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684034660 con 0x7f068c0cf9a0 2023-11-24T08:08:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f0692d0f640 1 -- 172.21.15.97:0/4075626012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c0cf9a0 msgr2=0x7f068c166030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f0692d0f640 1 --2- 172.21.15.97:0/4075626012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c0cf9a0 0x7f068c166030 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0684009d90 tx=0x7f068402bf50 comp rx=0 tx=0).stop 2023-11-24T08:08:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f0692d0f640 1 -- 172.21.15.97:0/4075626012 shutdown_connections 2023-11-24T08:08:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f0692d0f640 1 --2- 172.21.15.97:0/4075626012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c0cf9a0 0x7f068c166030 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f0692d0f640 1 -- 172.21.15.97:0/4075626012 >> 172.21.15.97:0/4075626012 conn(0x7f068c06a800 msgr2=0x7f068c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:25.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f0692d0f640 1 -- 172.21.15.97:0/4075626012 shutdown_connections 2023-11-24T08:08:25.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.219+0000 7f0692d0f640 1 -- 172.21.15.97:0/4075626012 wait complete. 2023-11-24T08:08:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.221+0000 7f0692d0f640 1 Processor -- start 2023-11-24T08:08:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.221+0000 7f0692d0f640 1 -- start start 2023-11-24T08:08:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f0692d0f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f068c0cf9a0 0x7f068c137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f0692d0f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f068c13df80 0x7f068c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f0692d0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c13e360 0x7f068c0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f0692d0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c139650 con 0x7f068c13e360 2023-11-24T08:08:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f0692d0f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c1398f0 con 0x7f068c0cf9a0 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f0692d0f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c139bd0 con 0x7f068c13df80 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f06912ac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c13e360 0x7f068c0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f06912ac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c13e360 0x7f068c0b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34934/0 (socket says 172.21.15.97:34934) 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.222+0000 7f06912ac640 1 -- 172.21.15.97:0/1930321048 learned_addr learned my addr 172.21.15.97:0/1930321048 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f0690aab640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f068c0cf9a0 0x7f068c137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06912ac640 1 -- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f068c13df80 msgr2=0x7f068c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06912ac640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f068c13df80 0x7f068c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06912ac640 1 -- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f068c0cf9a0 msgr2=0x7f068c137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06912ac640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f068c0cf9a0 0x7f068c137700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06912ac640 1 -- 172.21.15.97:0/1930321048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684009a70 con 0x7f068c13e360 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f0690aab640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f068c0cf9a0 0x7f068c137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06912ac640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c13e360 0x7f068c0b3230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0684009d90 tx=0x7f0684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:25.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06897fa640 1 -- 172.21.15.97:0/1930321048 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068403d600 con 0x7f068c13e360 2023-11-24T08:08:25.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06897fa640 1 -- 172.21.15.97:0/1930321048 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068403d780 con 0x7f068c13e360 2023-11-24T08:08:25.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.223+0000 7f06897fa640 1 -- 172.21.15.97:0/1930321048 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068403db30 con 0x7f068c13e360 2023-11-24T08:08:25.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.224+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c139eb0 con 0x7f068c13e360 2023-11-24T08:08:25.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.224+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c137c40 con 0x7f068c13e360 2023-11-24T08:08:25.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.225+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c0675d0 con 0x7f068c13e360 2023-11-24T08:08:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.226+0000 7f06897fa640 1 -- 172.21.15.97:0/1930321048 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f068403b040 con 0x7f068c13e360 2023-11-24T08:08:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.226+0000 7f06897fa640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067006ae40 0x7f067006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.227+0000 7f06897fa640 1 -- 172.21.15.97:0/1930321048 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06840abb80 con 0x7f068c13e360 2023-11-24T08:08:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.227+0000 7f0690aab640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067006ae40 0x7f067006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.227+0000 7f0690aab640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067006ae40 0x7f067006d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06800011e0 tx=0x7f0680009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:25.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.231+0000 7f06897fa640 1 -- 172.21.15.97:0/1930321048 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0684076c30 con 0x7f068c13e360 2023-11-24T08:08:25.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.442+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f068c15ed20 con 0x7f068c13e360 2023-11-24T08:08:25.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.443+0000 7f06897fa640 1 -- 172.21.15.97:0/1930321048 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f068404e090 con 0x7f068c13e360 2023-11-24T08:08:25.445 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:25.445 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3619089631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3619089631},{"type":"v1","addr":"172.21.15.183:6834","nonce":3619089631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1237344944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1237344944},{"type":"v1","addr":"172.21.15.97:6837","nonce":1237344944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1425639784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1425639784},{"type":"v1","addr":"172.21.15.183:6835","nonce":1425639784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:08:02.652077+0000","modified":"2023-11-24T08:08:05.725467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5244":{"gid":5244,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.97:6835/4116734497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4116734497},{"type":"v1","addr":"172.21.15.97:6835","nonce":4116734497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:08:25.446 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 18 2023-11-24T08:08:25.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067006ae40 msgr2=0x7f067006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067006ae40 0x7f067006d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06800011e0 tx=0x7f0680009040 comp rx=0 tx=0).stop 2023-11-24T08:08:25.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c13e360 msgr2=0x7f068c0b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c13e360 0x7f068c0b3230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0684009d90 tx=0x7f0684004a40 comp rx=0 tx=0).stop 2023-11-24T08:08:25.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 shutdown_connections 2023-11-24T08:08:25.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f067006ae40 0x7f067006d300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f068c13e360 0x7f068c0b3230 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f068c13df80 0x7f068c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 --2- 172.21.15.97:0/1930321048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f068c0cf9a0 0x7f068c137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 >> 172.21.15.97:0/1930321048 conn(0x7f068c06a800 msgr2=0x7f068c0b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:25.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 shutdown_connections 2023-11-24T08:08:25.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.445+0000 7f0692d0f640 1 -- 172.21.15.97:0/1930321048 wait complete. 2023-11-24T08:08:25.468 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:25.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.671+0000 7efc1d948640 1 Processor -- start 2023-11-24T08:08:25.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.671+0000 7efc1d948640 1 -- start start 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.673+0000 7efc1d948640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc1813df80 0x7efc1815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.673+0000 7efc1d948640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc180cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.673+0000 7efc1d948640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc1815f9c0 0x7efc180cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.673+0000 7efc1d948640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1806c470 con 0x7efc1813df80 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.673+0000 7efc1d948640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1806c750 con 0x7efc1815f9c0 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.673+0000 7efc1d948640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1806ca30 con 0x7efc1813e360 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.673+0000 7efc16ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc1813df80 0x7efc1815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc16ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc1813df80 0x7efc1815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34950/0 (socket says 172.21.15.97:34950) 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc16ffd640 1 -- 172.21.15.97:0/78691864 learned_addr learned my addr 172.21.15.97:0/78691864 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:25.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc0ffff640 1 --2- 172.21.15.97:0/78691864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc180cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc177fe640 1 --2- 172.21.15.97:0/78691864 >> v2:172.21.15.183:3300/0 conn(0x7efc1815f9c0 0x7efc180cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc16ffd640 1 -- 172.21.15.97:0/78691864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 msgr2=0x7efc180cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:25.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc16ffd640 1 --2- 172.21.15.97:0/78691864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc180cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc16ffd640 1 -- 172.21.15.97:0/78691864 >> v2:172.21.15.183:3300/0 conn(0x7efc1815f9c0 msgr2=0x7efc180cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:25.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc16ffd640 1 --2- 172.21.15.97:0/78691864 >> v2:172.21.15.183:3300/0 conn(0x7efc1815f9c0 0x7efc180cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.674+0000 7efc16ffd640 1 -- 172.21.15.97:0/78691864 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1806cd10 con 0x7efc1813df80 2023-11-24T08:08:25.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.676+0000 7efc16ffd640 1 --2- 172.21.15.97:0/78691864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1813df80 0x7efc1815bee0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efc1806e6d0 tx=0x7efc0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0d1a9c64682737 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:25.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.676+0000 7efc167fc640 1 -- 172.21.15.97:0/78691864 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08031870 con 0x7efc1813df80 2023-11-24T08:08:25.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.676+0000 7efc167fc640 1 -- 172.21.15.97:0/78691864 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc080319d0 con 0x7efc1813df80 2023-11-24T08:08:25.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.676+0000 7efc167fc640 1 -- 172.21.15.97:0/78691864 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08031d60 con 0x7efc1813df80 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 -- 172.21.15.97:0/78691864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1813df80 msgr2=0x7efc1815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 --2- 172.21.15.97:0/78691864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1813df80 0x7efc1815bee0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efc1806e6d0 tx=0x7efc0802b910 comp rx=0 tx=0).stop 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 -- 172.21.15.97:0/78691864 shutdown_connections 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 --2- 172.21.15.97:0/78691864 >> v2:172.21.15.183:3300/0 conn(0x7efc1815f9c0 0x7efc180cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 --2- 172.21.15.97:0/78691864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc180cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 --2- 172.21.15.97:0/78691864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1813df80 0x7efc1815bee0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 -- 172.21.15.97:0/78691864 >> 172.21.15.97:0/78691864 conn(0x7efc1806a800 msgr2=0x7efc1806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 -- 172.21.15.97:0/78691864 shutdown_connections 2023-11-24T08:08:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.677+0000 7efc1d948640 1 -- 172.21.15.97:0/78691864 wait complete. 2023-11-24T08:08:25.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.679+0000 7efc1d948640 1 Processor -- start 2023-11-24T08:08:25.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.680+0000 7efc1d948640 1 -- start start 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc1d948640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1813df80 0x7efc18133620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc1d948640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc1815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc1d948640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1815f9c0 0x7efc1815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc1d948640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180710f0 con 0x7efc1815f9c0 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc1d948640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180713d0 con 0x7efc1813df80 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc1d948640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180716b0 con 0x7efc1813e360 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1815f9c0 0x7efc1815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1815f9c0 0x7efc1815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34962/0 (socket says 172.21.15.97:34962) 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.681+0000 7efc177fe640 1 -- 172.21.15.97:0/3068708073 learned_addr learned my addr 172.21.15.97:0/3068708073 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc0ffff640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc1815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc16ffd640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1813df80 0x7efc18133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc177fe640 1 -- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 msgr2=0x7efc1815a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc177fe640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc1815a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc177fe640 1 -- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1813df80 msgr2=0x7efc18133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc177fe640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1813df80 0x7efc18133620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc177fe640 1 -- 172.21.15.97:0/3068708073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080094d0 con 0x7efc1815f9c0 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc177fe640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1815f9c0 0x7efc1815a680 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7efc1000cd70 tx=0x7efc1000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc14ff9640 1 -- 172.21.15.97:0/3068708073 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10003b90 con 0x7efc1815f9c0 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc14ff9640 1 -- 172.21.15.97:0/3068708073 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10003cf0 con 0x7efc1815f9c0 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc14ff9640 1 -- 172.21.15.97:0/3068708073 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10004240 con 0x7efc1815f9c0 2023-11-24T08:08:25.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.682+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc18071990 con 0x7efc1815f9c0 2023-11-24T08:08:25.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.683+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc18133b60 con 0x7efc1815f9c0 2023-11-24T08:08:25.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.684+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc18071eb0 con 0x7efc1815f9c0 2023-11-24T08:08:25.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.685+0000 7efc14ff9640 1 -- 172.21.15.97:0/3068708073 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc100043a0 con 0x7efc1815f9c0 2023-11-24T08:08:25.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.685+0000 7efc14ff9640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efbf806ae40 0x7efbf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:25.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.685+0000 7efc14ff9640 1 -- 172.21.15.97:0/3068708073 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc10012070 con 0x7efc1815f9c0 2023-11-24T08:08:25.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.686+0000 7efc16ffd640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efbf806ae40 0x7efbf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:25.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.686+0000 7efc16ffd640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efbf806ae40 0x7efbf806d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efc08036000 tx=0x7efc0803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:25.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.690+0000 7efc14ff9640 1 -- 172.21.15.97:0/3068708073 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc18071eb0 con 0x7efc1815f9c0 2023-11-24T08:08:25.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.916+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc18071eb0 con 0x7efc1815f9c0 2023-11-24T08:08:25.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.917+0000 7efc14ff9640 1 -- 172.21.15.97:0/3068708073 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7efc18071eb0 con 0x7efc1815f9c0 2023-11-24T08:08:25.920 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:25.920 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3619089631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3619089631},{"type":"v1","addr":"172.21.15.183:6834","nonce":3619089631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1237344944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1237344944},{"type":"v1","addr":"172.21.15.97:6837","nonce":1237344944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1425639784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1425639784},{"type":"v1","addr":"172.21.15.183:6835","nonce":1425639784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:08:02.652077+0000","modified":"2023-11-24T08:08:05.725467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5244":{"gid":5244,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.97:6835/4116734497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":4116734497},{"type":"v1","addr":"172.21.15.97:6835","nonce":4116734497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:08:25.920 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 18 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efbf806ae40 msgr2=0x7efbf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efbf806ae40 0x7efbf806d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efc08036000 tx=0x7efc0803c040 comp rx=0 tx=0).stop 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1815f9c0 msgr2=0x7efc1815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1815f9c0 0x7efc1815a680 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7efc1000cd70 tx=0x7efc1000a660 comp rx=0 tx=0).stop 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 shutdown_connections 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7efbf806ae40 0x7efbf806d300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc1815f9c0 0x7efc1815a680 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1813e360 0x7efc1815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 --2- 172.21.15.97:0/3068708073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1813df80 0x7efc18133620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:25.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 >> 172.21.15.97:0/3068708073 conn(0x7efc1806a800 msgr2=0x7efc180ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:25.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 shutdown_connections 2023-11-24T08:08:25.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:25.920+0000 7efc1d948640 1 -- 172.21.15.97:0/3068708073 wait complete. 2023-11-24T08:08:25.941 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:26.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.148+0000 7fd5e2cec640 1 Processor -- start 2023-11-24T08:08:26.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.148+0000 7fd5e2cec640 1 -- start start 2023-11-24T08:08:26.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.150+0000 7fd5e2cec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc143ae0 0x7fd5dc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.150+0000 7fd5e2cec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd5dc15e3b0 0x7fd5dc0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.150+0000 7fd5e2cec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc0cfc30 con 0x7fd5dc0cf7d0 2023-11-24T08:08:26.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.150+0000 7fd5e2cec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b1ee0 con 0x7fd5dc15e3b0 2023-11-24T08:08:26.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.150+0000 7fd5e2cec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b2780 con 0x7fd5dc143ae0 2023-11-24T08:08:26.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.151+0000 7fd5e0a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc143ae0 0x7fd5dc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.151+0000 7fd5e0a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc143ae0 0x7fd5dc0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:33610/0 (socket says 172.21.15.97:33610) 2023-11-24T08:08:26.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.151+0000 7fd5e0a88640 1 -- 172.21.15.97:0/946260888 learned_addr learned my addr 172.21.15.97:0/946260888 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:26.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.151+0000 7fd5e1289640 1 --2- 172.21.15.97:0/946260888 >> v2:172.21.15.183:3300/0 conn(0x7fd5dc15e3b0 0x7fd5dc0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.152+0000 7fd5e0a88640 1 -- 172.21.15.97:0/946260888 >> v2:172.21.15.183:3300/0 conn(0x7fd5dc15e3b0 msgr2=0x7fd5dc0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:26.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.152+0000 7fd5e0a88640 1 --2- 172.21.15.97:0/946260888 >> v2:172.21.15.183:3300/0 conn(0x7fd5dc15e3b0 0x7fd5dc0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.152+0000 7fd5e0a88640 1 -- 172.21.15.97:0/946260888 >> v1:172.21.15.183:6789/0 conn(0x7fd5dc0cf7d0 legacy=0x7fd5dc15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.152+0000 7fd5db7fe640 1 -- 172.21.15.97:0/946260888 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071574026 0 0) 0x7fd5dc0cfc30 con 0x7fd5dc0cf7d0 2023-11-24T08:08:26.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.152+0000 7fd5e0a88640 1 -- 172.21.15.97:0/946260888 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc15e990 con 0x7fd5dc143ae0 2023-11-24T08:08:26.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.154+0000 7fd5e0a88640 1 --2- 172.21.15.97:0/946260888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc143ae0 0x7fd5dc0cf290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009870 tx=0x7fd5d002db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd5c0080f0dd8b6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:26.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.154+0000 7fd5db7fe640 1 -- 172.21.15.97:0/946260888 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d002e940 con 0x7fd5dc143ae0 2023-11-24T08:08:26.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.154+0000 7fd5db7fe640 1 -- 172.21.15.97:0/946260888 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d002eaa0 con 0x7fd5dc143ae0 2023-11-24T08:08:26.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.154+0000 7fd5db7fe640 1 -- 172.21.15.97:0/946260888 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d002ee30 con 0x7fd5dc143ae0 2023-11-24T08:08:26.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 -- 172.21.15.97:0/946260888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc143ae0 msgr2=0x7fd5dc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/946260888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc143ae0 0x7fd5dc0cf290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009870 tx=0x7fd5d002db90 comp rx=0 tx=0).stop 2023-11-24T08:08:26.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 -- 172.21.15.97:0/946260888 shutdown_connections 2023-11-24T08:08:26.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/946260888 >> v2:172.21.15.183:3300/0 conn(0x7fd5dc15e3b0 0x7fd5dc0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/946260888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc143ae0 0x7fd5dc0cf290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 -- 172.21.15.97:0/946260888 >> 172.21.15.97:0/946260888 conn(0x7fd5dc06a800 msgr2=0x7fd5dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:26.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 -- 172.21.15.97:0/946260888 shutdown_connections 2023-11-24T08:08:26.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.155+0000 7fd5e2cec640 1 -- 172.21.15.97:0/946260888 wait complete. 2023-11-24T08:08:26.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.157+0000 7fd5e2cec640 1 Processor -- start 2023-11-24T08:08:26.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.157+0000 7fd5e2cec640 1 -- start start 2023-11-24T08:08:26.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.158+0000 7fd5e2cec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc0cf7d0 0x7fd5dc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.158+0000 7fd5e2cec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5dc143ae0 0x7fd5dc141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.158+0000 7fd5e2cec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5dc15e3b0 0x7fd5dc13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.158+0000 7fd5e2cec640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc13c360 con 0x7fd5dc143ae0 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.158+0000 7fd5e2cec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc1f3df0 con 0x7fd5dc15e3b0 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.158+0000 7fd5e2cec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc1f3270 con 0x7fd5dc0cf7d0 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.158+0000 7fd5dbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5dc143ae0 0x7fd5dc141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5dc143ae0 0x7fd5dc141c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55148/0 (socket says 172.21.15.97:55148) 2023-11-24T08:08:26.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 -- 172.21.15.97:0/2092384910 learned_addr learned my addr 172.21.15.97:0/2092384910 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:26.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5e0a88640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc0cf7d0 0x7fd5dc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5e1289640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5dc15e3b0 0x7fd5dc13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 -- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc0cf7d0 msgr2=0x7fd5dc1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc0cf7d0 0x7fd5dc1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 -- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5dc15e3b0 msgr2=0x7fd5dc13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5dc15e3b0 0x7fd5dc13e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 -- 172.21.15.97:0/2092384910 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d00094d0 con 0x7fd5dc143ae0 2023-11-24T08:08:26.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5dbfff640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5dc143ae0 0x7fd5dc141c50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c4e0 tx=0x7fd5c800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:26.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.159+0000 7fd5d97fa640 1 -- 172.21.15.97:0/2092384910 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8005480 con 0x7fd5dc143ae0 2023-11-24T08:08:26.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.160+0000 7fd5d97fa640 1 -- 172.21.15.97:0/2092384910 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80035f0 con 0x7fd5dc143ae0 2023-11-24T08:08:26.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.160+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc1f3550 con 0x7fd5dc143ae0 2023-11-24T08:08:26.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.160+0000 7fd5d97fa640 1 -- 172.21.15.97:0/2092384910 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80039c0 con 0x7fd5dc143ae0 2023-11-24T08:08:26.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.160+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc1f3b10 con 0x7fd5dc143ae0 2023-11-24T08:08:26.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.161+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc13c4d0 con 0x7fd5dc143ae0 2023-11-24T08:08:26.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.162+0000 7fd5d97fa640 1 -- 172.21.15.97:0/2092384910 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5c8003b20 con 0x7fd5dc143ae0 2023-11-24T08:08:26.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.163+0000 7fd5d97fa640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd5c006ae40 0x7fd5c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.163+0000 7fd5d97fa640 1 -- 172.21.15.97:0/2092384910 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5c8088b20 con 0x7fd5dc143ae0 2023-11-24T08:08:26.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.163+0000 7fd5e0a88640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd5c006ae40 0x7fd5c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.164+0000 7fd5e0a88640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd5c006ae40 0x7fd5c006d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0038000 tx=0x7fd5d0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:26.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.167+0000 7fd5d97fa640 1 -- 172.21.15.97:0/2092384910 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5dc13c4d0 con 0x7fd5dc143ae0 2023-11-24T08:08:26.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.363+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5dc13c4a0 con 0x7fd5dc143ae0 2023-11-24T08:08:26.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.366+0000 7fd5d97fa640 1 -- 172.21.15.97:0/2092384910 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fd5c8017070 con 0x7fd5dc143ae0 2023-11-24T08:08:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:26.369 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:04.217727+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:08:00.468087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:08:01.668047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:26.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd5c006ae40 msgr2=0x7fd5c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd5c006ae40 0x7fd5c006d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0038000 tx=0x7fd5d0032000 comp rx=0 tx=0).stop 2023-11-24T08:08:26.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5dc143ae0 msgr2=0x7fd5dc141c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5dc143ae0 0x7fd5dc141c50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c4e0 tx=0x7fd5c800c9a0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 shutdown_connections 2023-11-24T08:08:26.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd5c006ae40 0x7fd5c006d300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5dc15e3b0 0x7fd5dc13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5dc143ae0 0x7fd5dc141c50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 --2- 172.21.15.97:0/2092384910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5dc0cf7d0 0x7fd5dc1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 >> 172.21.15.97:0/2092384910 conn(0x7fd5dc06a800 msgr2=0x7fd5dc06c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:26.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 shutdown_connections 2023-11-24T08:08:26.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.369+0000 7fd5e2cec640 1 -- 172.21.15.97:0/2092384910 wait complete. 2023-11-24T08:08:26.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:08:26.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.597+0000 7f7df25c9640 1 Processor -- start 2023-11-24T08:08:26.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.597+0000 7f7df25c9640 1 -- start start 2023-11-24T08:08:26.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7df25c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec13df80 0x7f7dec15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7df25c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7dec0cf9a0 0x7f7dec0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7df25c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec06c470 con 0x7f7dec13e360 2023-11-24T08:08:26.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7df25c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec06c750 con 0x7f7dec0cf9a0 2023-11-24T08:08:26.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7df25c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec06ca30 con 0x7f7dec13df80 2023-11-24T08:08:26.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7deb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7dec13e360 0x7f7dec0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41330/0 (socket says 172.21.15.97:41330) 2023-11-24T08:08:26.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7deb7fe640 1 -- 172.21.15.97:0/2296546265 learned_addr learned my addr 172.21.15.97:0/2296546265 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:26.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.599+0000 7f7df0b66640 1 --2- 172.21.15.97:0/2296546265 >> v2:172.21.15.97:3300/0 conn(0x7f7dec0cf9a0 0x7f7dec0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.600+0000 7f7debfff640 1 --2- 172.21.15.97:0/2296546265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec13df80 0x7f7dec15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.600+0000 7f7deaffd640 1 -- 172.21.15.97:0/2296546265 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852883235 0 0) 0x7f7dec06c470 con 0x7f7dec13e360 2023-11-24T08:08:26.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.600+0000 7f7deaffd640 1 -- 172.21.15.97:0/2296546265 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd8003520 con 0x7f7dec13e360 2023-11-24T08:08:26.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.600+0000 7f7df0b66640 1 -- 172.21.15.97:0/2296546265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec13df80 msgr2=0x7f7dec15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:26.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.600+0000 7f7df0b66640 1 --2- 172.21.15.97:0/2296546265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec13df80 0x7f7dec15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.600+0000 7f7df0b66640 1 -- 172.21.15.97:0/2296546265 >> v1:172.21.15.97:6789/0 conn(0x7f7dec13e360 legacy=0x7f7dec0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.600+0000 7f7df0b66640 1 -- 172.21.15.97:0/2296546265 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec06cd10 con 0x7f7dec0cf9a0 2023-11-24T08:08:26.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.601+0000 7f7df0b66640 1 --2- 172.21.15.97:0/2296546265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec0cf9a0 0x7f7dec0cd840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7de40097a0 tx=0x7f7de402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754f8bd61d8eae6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:26.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7deaffd640 1 -- 172.21.15.97:0/2296546265 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4031830 con 0x7f7dec0cf9a0 2023-11-24T08:08:26.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7deaffd640 1 -- 172.21.15.97:0/2296546265 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4031990 con 0x7f7dec0cf9a0 2023-11-24T08:08:26.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7deaffd640 1 -- 172.21.15.97:0/2296546265 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4031d20 con 0x7f7dec0cf9a0 2023-11-24T08:08:26.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 -- 172.21.15.97:0/2296546265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec0cf9a0 msgr2=0x7f7dec0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 --2- 172.21.15.97:0/2296546265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec0cf9a0 0x7f7dec0cd840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7de40097a0 tx=0x7f7de402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 -- 172.21.15.97:0/2296546265 shutdown_connections 2023-11-24T08:08:26.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 --2- 172.21.15.97:0/2296546265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec0cf9a0 0x7f7dec0cd840 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 --2- 172.21.15.97:0/2296546265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec13df80 0x7f7dec15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 -- 172.21.15.97:0/2296546265 >> 172.21.15.97:0/2296546265 conn(0x7f7dec06a800 msgr2=0x7f7dec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:26.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 -- 172.21.15.97:0/2296546265 shutdown_connections 2023-11-24T08:08:26.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.602+0000 7f7df25c9640 1 -- 172.21.15.97:0/2296546265 wait complete. 2023-11-24T08:08:26.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.604+0000 7f7df25c9640 1 Processor -- start 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.604+0000 7f7df25c9640 1 -- start start 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.605+0000 7f7df25c9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec0cf9a0 0x7f7dec13aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.605+0000 7f7df25c9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dec13df80 0x7f7dec0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.605+0000 7f7df25c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec13e360 0x7f7dec0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.605+0000 7f7df25c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0b3380 con 0x7f7dec13e360 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.605+0000 7f7df25c9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec13b020 con 0x7f7dec13df80 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.605+0000 7f7df25c9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0702c0 con 0x7f7dec0cf9a0 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec13e360 0x7f7dec0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec13e360 0x7f7dec0b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55162/0 (socket says 172.21.15.97:55162) 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 -- 172.21.15.97:0/1981377190 learned_addr learned my addr 172.21.15.97:0/1981377190 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:26.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 -- 172.21.15.97:0/1981377190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec0cf9a0 msgr2=0x7f7dec13aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec0cf9a0 0x7f7dec13aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 -- 172.21.15.97:0/1981377190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dec13df80 msgr2=0x7f7dec0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dec13df80 0x7f7dec0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 -- 172.21.15.97:0/1981377190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4009400 con 0x7f7dec13e360 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.606+0000 7f7df0b66640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec13e360 0x7f7dec0b3c70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7de40097a0 tx=0x7f7de40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.607+0000 7f7de8ff9640 1 -- 172.21.15.97:0/1981377190 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de403a830 con 0x7f7dec13e360 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.607+0000 7f7de8ff9640 1 -- 172.21.15.97:0/1981377190 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de403a9b0 con 0x7f7dec13e360 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.607+0000 7f7de8ff9640 1 -- 172.21.15.97:0/1981377190 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de403ad60 con 0x7f7dec13e360 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.607+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec0705a0 con 0x7f7dec13e360 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.607+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec070b60 con 0x7f7dec13e360 2023-11-24T08:08:26.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.608+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec0675d0 con 0x7f7dec13e360 2023-11-24T08:08:26.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.609+0000 7f7de8ff9640 1 -- 172.21.15.97:0/1981377190 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7de404d450 con 0x7f7dec13e360 2023-11-24T08:08:26.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.609+0000 7f7de8ff9640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dcc06ae40 0x7f7dcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:26.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.610+0000 7f7de8ff9640 1 -- 172.21.15.97:0/1981377190 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7de40ab5d0 con 0x7f7dec13e360 2023-11-24T08:08:26.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.610+0000 7f7debfff640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dcc06ae40 0x7f7dcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:26.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.610+0000 7f7debfff640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dcc06ae40 0x7f7dcc06d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00e190 tx=0x7f7ddc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:26.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.614+0000 7f7de8ff9640 1 -- 172.21.15.97:0/1981377190 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7de40765e0 con 0x7f7dec13e360 2023-11-24T08:08:26.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.842+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7dec0b42a0 con 0x7f7dec13e360 2023-11-24T08:08:26.846 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-11-24T08:08:26.844+0000 7fe28353b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:08:26.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.848+0000 7f7de8ff9640 1 -- 172.21.15.97:0/1981377190 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7de4079c00 con 0x7f7dec13e360 2023-11-24T08:08:26.851 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:08:26.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dcc06ae40 msgr2=0x7f7dcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dcc06ae40 0x7f7dcc06d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00e190 tx=0x7f7ddc00b040 comp rx=0 tx=0).stop 2023-11-24T08:08:26.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec13e360 msgr2=0x7f7dec0b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:26.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec13e360 0x7f7dec0b3c70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7de40097a0 tx=0x7f7de40046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 shutdown_connections 2023-11-24T08:08:26.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f7dcc06ae40 0x7f7dcc06d300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dec13e360 0x7f7dec0b3c70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dec13df80 0x7f7dec0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 --2- 172.21.15.97:0/1981377190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dec0cf9a0 0x7f7dec13aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:26.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.851+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 >> 172.21.15.97:0/1981377190 conn(0x7f7dec06a800 msgr2=0x7f7dec0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:26.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.853+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 shutdown_connections 2023-11-24T08:08:26.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:26.853+0000 7f7df25c9640 1 -- 172.21.15.97:0/1981377190 wait complete. 2023-11-24T08:08:26.862 INFO:tasks.ceph.mds.c.smithi097.stderr: -1108> 2023-11-24T08:08:06.147+0000 7f1958984640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:08:26.874 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:08:26.919 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-11-24T08:08:27.054 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:27.062 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:27.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.062+0000 7f12f73be640 1 Processor -- start 2023-11-24T08:08:27.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.062+0000 7f12f73be640 1 -- start start 2023-11-24T08:08:27.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f73be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f015a110 0x7f12f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:27.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f73be640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12f0066300 0x7f12f006b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f73be640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f00b3880 con 0x7f12f006b930 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f73be640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f006bdc0 con 0x7f12f0066300 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f73be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00b46e0 con 0x7f12f015a110 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f4959640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12f0066300 0x7f12f006b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f595b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f12f006b930 0x7f12f015dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41340/0 (socket says 172.21.15.97:41340) 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f595b640 1 -- 172.21.15.97:0/3729115301 learned_addr learned my addr 172.21.15.97:0/3729115301 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f4959640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f12f0066300 0x7f12f006b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55180/0 (socket says 172.21.15.97:55180) 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.064+0000 7f12f515a640 1 --2- 172.21.15.97:0/3729115301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f015a110 0x7f12f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.065+0000 7f12f4959640 1 -- 172.21.15.97:0/3729115301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f015a110 msgr2=0x7f12f006d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.065+0000 7f12f4959640 1 --2- 172.21.15.97:0/3729115301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f015a110 0x7f12f006d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.065+0000 7f12f4959640 1 -- 172.21.15.97:0/3729115301 >> v1:172.21.15.97:6789/0 conn(0x7f12f006b930 legacy=0x7f12f015dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:27.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.065+0000 7f12f4959640 1 -- 172.21.15.97:0/3729115301 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f006d900 con 0x7f12f0066300 2023-11-24T08:08:27.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.065+0000 7f12e7fff640 1 -- 172.21.15.97:0/3729115301 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519139579 0 0) 0x7f12f00b3880 con 0x7f12f006b930 2023-11-24T08:08:27.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.066+0000 7f12f4959640 1 --2- 172.21.15.97:0/3729115301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f006b3f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12e000ba40 tx=0x7f12e002e080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2365e1c5ddfbfb32 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:27.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.066+0000 7f12e7fff640 1 -- 172.21.15.97:0/3729115301 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e002ee30 con 0x7f12f0066300 2023-11-24T08:08:27.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.066+0000 7f12e7fff640 1 -- 172.21.15.97:0/3729115301 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0036440 con 0x7f12f0066300 2023-11-24T08:08:27.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.066+0000 7f12e7fff640 1 -- 172.21.15.97:0/3729115301 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00367d0 con 0x7f12f0066300 2023-11-24T08:08:27.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 -- 172.21.15.97:0/3729115301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 msgr2=0x7f12f006b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:27.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 --2- 172.21.15.97:0/3729115301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f006b3f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12e000ba40 tx=0x7f12e002e080 comp rx=0 tx=0).stop 2023-11-24T08:08:27.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 -- 172.21.15.97:0/3729115301 shutdown_connections 2023-11-24T08:08:27.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 --2- 172.21.15.97:0/3729115301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f006b3f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 --2- 172.21.15.97:0/3729115301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f015a110 0x7f12f006d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 -- 172.21.15.97:0/3729115301 >> 172.21.15.97:0/3729115301 conn(0x7f12f0070b10 msgr2=0x7f12f0070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:27.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 -- 172.21.15.97:0/3729115301 shutdown_connections 2023-11-24T08:08:27.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.067+0000 7f12f73be640 1 -- 172.21.15.97:0/3729115301 wait complete. 2023-11-24T08:08:27.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.069+0000 7f12f73be640 1 Processor -- start 2023-11-24T08:08:27.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.069+0000 7f12f73be640 1 -- start start 2023-11-24T08:08:27.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f73be640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f00ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f73be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f006b930 0x7f12f006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f73be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f015a110 0x7f12f014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f73be640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00ce460 con 0x7f12f0066300 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f73be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00cdea0 con 0x7f12f015a110 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f73be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00ce180 con 0x7f12f006b930 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f515a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f00ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f515a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f00ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55184/0 (socket says 172.21.15.97:55184) 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.070+0000 7f12f515a640 1 -- 172.21.15.97:0/531968958 learned_addr learned my addr 172.21.15.97:0/531968958 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f4959640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f006b930 0x7f12f006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f595b640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f015a110 0x7f12f014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f515a640 1 -- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f006b930 msgr2=0x7f12f006ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:27.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f515a640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f006b930 0x7f12f006ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f515a640 1 -- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f015a110 msgr2=0x7f12f014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f515a640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f015a110 0x7f12f014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f515a640 1 -- 172.21.15.97:0/531968958 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e000b6a0 con 0x7f12f0066300 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f4959640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f006b930 0x7f12f006ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f595b640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f015a110 0x7f12f014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f515a640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f00ae0f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00d5d0 tx=0x7f12ec00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12e5ffb640 1 -- 172.21.15.97:0/531968958 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0125f0 con 0x7f12f0066300 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12e5ffb640 1 -- 172.21.15.97:0/531968958 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec012770 con 0x7f12f0066300 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12e5ffb640 1 -- 172.21.15.97:0/531968958 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec012b20 con 0x7f12f0066300 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0157b60 con 0x7f12f0066300 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.071+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f00ae630 con 0x7f12f0066300 2023-11-24T08:08:27.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.073+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0158080 con 0x7f12f0066300 2023-11-24T08:08:27.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.073+0000 7f12e5ffb640 1 -- 172.21.15.97:0/531968958 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12ec012c80 con 0x7f12f0066300 2023-11-24T08:08:27.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.074+0000 7f12e5ffb640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f12d406ae40 0x7f12d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:27.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.074+0000 7f12e5ffb640 1 -- 172.21.15.97:0/531968958 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f12ec089c00 con 0x7f12f0066300 2023-11-24T08:08:27.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.075+0000 7f12f4959640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f12d406ae40 0x7f12d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:27.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.076+0000 7f12f4959640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f12d406ae40 0x7f12d406d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f12e0038000 tx=0x7f12e0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:27.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.079+0000 7f12e5ffb640 1 -- 172.21.15.97:0/531968958 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12f0158080 con 0x7f12f0066300 2023-11-24T08:08:27.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.310+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f12f00ae820 con 0x7f12f0066300 2023-11-24T08:08:27.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.852+0000 7f12e5ffb640 1 -- 172.21.15.97:0/531968958 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12ec054c40 con 0x7f12f0066300 2023-11-24T08:08:27.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f12d406ae40 msgr2=0x7f12d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:27.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f12d406ae40 0x7f12d406d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f12e0038000 tx=0x7f12e0032000 comp rx=0 tx=0).stop 2023-11-24T08:08:27.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 msgr2=0x7f12f00ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f00ae0f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00d5d0 tx=0x7f12ec00da90 comp rx=0 tx=0).stop 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 shutdown_connections 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f12d406ae40 0x7f12d406d300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f015a110 0x7f12f014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f006b930 0x7f12f006ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 --2- 172.21.15.97:0/531968958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12f0066300 0x7f12f00ae0f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.855+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 >> 172.21.15.97:0/531968958 conn(0x7f12f0070b10 msgr2=0x7f12f0155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.856+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 shutdown_connections 2023-11-24T08:08:27.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:27.856+0000 7f12f73be640 1 -- 172.21.15.97:0/531968958 wait complete. 2023-11-24T08:08:27.882 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:08:28.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.101+0000 7fc8336cf640 1 Processor -- start 2023-11-24T08:08:28.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.102+0000 7fc8336cf640 1 -- start start 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.103+0000 7fc8336cf640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc82c143ae0 0x7fc82c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.103+0000 7fc8336cf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.103+0000 7fc8336cf640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c0cfc30 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.103+0000 7fc8336cf640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c0b1ee0 con 0x7fc82c143ae0 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.103+0000 7fc8336cf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0b2780 con 0x7fc82c15e3b0 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.104+0000 7fc831c6c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.104+0000 7fc83146b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc82c143ae0 0x7fc82c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.104+0000 7fc83146b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc82c143ae0 0x7fc82c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.97:35270/0 (socket says 172.21.15.97:35270) 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.104+0000 7fc83146b640 1 -- 172.21.15.97:0/850462585 learned_addr learned my addr 172.21.15.97:0/850462585 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.104+0000 7fc83146b640 1 -- 172.21.15.97:0/850462585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 msgr2=0x7fc82c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.104+0000 7fc83146b640 1 --2- 172.21.15.97:0/850462585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.105+0000 7fc83146b640 1 -- 172.21.15.97:0/850462585 >> v1:172.21.15.183:6789/0 conn(0x7fc82c0cf7d0 legacy=0x7fc82c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.105+0000 7fc83146b640 1 -- 172.21.15.97:0/850462585 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c15e990 con 0x7fc82c143ae0 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.106+0000 7fc83146b640 1 --2- 172.21.15.97:0/850462585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 0x7fc82c0cf290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc82802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=537941b0adabaabd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.106+0000 7fc823fff640 1 -- 172.21.15.97:0/850462585 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828030840 con 0x7fc82c143ae0 2023-11-24T08:08:28.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.106+0000 7fc823fff640 1 -- 172.21.15.97:0/850462585 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280309a0 con 0x7fc82c143ae0 2023-11-24T08:08:28.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.106+0000 7fc823fff640 1 -- 172.21.15.97:0/850462585 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828030d30 con 0x7fc82c143ae0 2023-11-24T08:08:28.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.106+0000 7fc8336cf640 1 -- 172.21.15.97:0/850462585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 msgr2=0x7fc82c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.106+0000 7fc8336cf640 1 --2- 172.21.15.97:0/850462585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 0x7fc82c0cf290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc82802b980 comp rx=0 tx=0).stop 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.107+0000 7fc8336cf640 1 -- 172.21.15.97:0/850462585 shutdown_connections 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.107+0000 7fc8336cf640 1 --2- 172.21.15.97:0/850462585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.107+0000 7fc8336cf640 1 --2- 172.21.15.97:0/850462585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 0x7fc82c0cf290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.107+0000 7fc8336cf640 1 -- 172.21.15.97:0/850462585 >> 172.21.15.97:0/850462585 conn(0x7fc82c06a800 msgr2=0x7fc82c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.107+0000 7fc8336cf640 1 -- 172.21.15.97:0/850462585 shutdown_connections 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.107+0000 7fc8336cf640 1 -- 172.21.15.97:0/850462585 wait complete. 2023-11-24T08:08:28.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.108+0000 7fc8336cf640 1 Processor -- start 2023-11-24T08:08:28.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.109+0000 7fc8336cf640 1 -- start start 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc8336cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82c0cf7d0 0x7fc82c13fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc8336cf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 0x7fc82c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc8336cf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc8336cf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c140520 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc8336cf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c140800 con 0x7fc82c143ae0 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc8336cf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c140ae0 con 0x7fc82c15e3b0 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82c0cf7d0 0x7fc82c13fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82c0cf7d0 0x7fc82c13fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55194/0 (socket says 172.21.15.97:55194) 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 -- 172.21.15.97:0/4241862873 learned_addr learned my addr 172.21.15.97:0/4241862873 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc830c6a640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 0x7fc82c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc831c6c640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 -- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 msgr2=0x7fc82c159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 -- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 msgr2=0x7fc82c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 0x7fc82c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.110+0000 7fc83146b640 1 -- 172.21.15.97:0/4241862873 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280094d0 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.111+0000 7fc83146b640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82c0cf7d0 0x7fc82c13fe90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc828000c00 tx=0x7fc828004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:28.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.111+0000 7fc821ffb640 1 -- 172.21.15.97:0/4241862873 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828039c90 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.111+0000 7fc821ffb640 1 -- 172.21.15.97:0/4241862873 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828039df0 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.111+0000 7fc821ffb640 1 -- 172.21.15.97:0/4241862873 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828043640 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.111+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c140dc0 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.111+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c0b03c0 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.112+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c0675d0 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.113+0000 7fc821ffb640 1 -- 172.21.15.97:0/4241862873 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8280437a0 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.114+0000 7fc821ffb640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc81006ae40 0x7fc81006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:28.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.115+0000 7fc821ffb640 1 -- 172.21.15.97:0/4241862873 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc82803e070 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.115+0000 7fc830c6a640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc81006ae40 0x7fc81006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:28.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.115+0000 7fc830c6a640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc81006ae40 0x7fc81006d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0b0690 tx=0x7fc81c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:28.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.119+0000 7fc821ffb640 1 -- 172.21.15.97:0/4241862873 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8280777e0 con 0x7fc82c0cf7d0 2023-11-24T08:08:28.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:28.314+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc82c15c360 con 0x7fc82c0cf7d0 2023-11-24T08:08:29.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.126+0000 7fc821ffb640 1 -- 172.21.15.97:0/4241862873 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc82807ae00 con 0x7fc82c0cf7d0 2023-11-24T08:08:29.129 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc81006ae40 msgr2=0x7fc81006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc81006ae40 0x7fc81006d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0b0690 tx=0x7fc81c009040 comp rx=0 tx=0).stop 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82c0cf7d0 msgr2=0x7fc82c13fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82c0cf7d0 0x7fc82c13fe90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc828000c00 tx=0x7fc828004730 comp rx=0 tx=0).stop 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 shutdown_connections 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc81006ae40 0x7fc81006d300 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc82c15e3b0 0x7fc82c159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc82c143ae0 0x7fc82c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 --2- 172.21.15.97:0/4241862873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc82c0cf7d0 0x7fc82c13fe90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.130+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 >> 172.21.15.97:0/4241862873 conn(0x7fc82c06a800 msgr2=0x7fc82c15bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:29.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.131+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 shutdown_connections 2023-11-24T08:08:29.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.132+0000 7fc8336cf640 1 -- 172.21.15.97:0/4241862873 wait complete. 2023-11-24T08:08:29.158 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:08:29.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.374+0000 7fae0aed1640 1 Processor -- start 2023-11-24T08:08:29.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.374+0000 7fae0aed1640 1 -- start start 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.375+0000 7fae0aed1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae0415b470 0x7fae040aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.375+0000 7fae0aed1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae04071b90 con 0x7fae04071290 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.375+0000 7fae0aed1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae040af1e0 con 0x7fae04155540 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.375+0000 7fae0aed1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae04155920 con 0x7fae0415b470 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.376+0000 7fae0a6d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae0415b470 0x7fae040aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.376+0000 7fae0a6d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fae0415b470 0x7fae040aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55204/0 (socket says 172.21.15.97:55204) 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.376+0000 7fae0a6d0640 1 -- 172.21.15.97:0/634959493 learned_addr learned my addr 172.21.15.97:0/634959493 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.376+0000 7fae0a6d0640 1 -- 172.21.15.97:0/634959493 >> v1:172.21.15.183:6789/0 conn(0x7fae04155540 legacy=0x7fae04070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.376+0000 7fae0a6d0640 1 -- 172.21.15.97:0/634959493 >> v1:172.21.15.97:6789/0 conn(0x7fae04071290 legacy=0x7fae040b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.376+0000 7fae08ecd640 1 -- 172.21.15.97:0/634959493 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605387541 0 0) 0x7fae04071b90 con 0x7fae04071290 2023-11-24T08:08:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.376+0000 7fae0a6d0640 1 -- 172.21.15.97:0/634959493 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0415b9e0 con 0x7fae0415b470 2023-11-24T08:08:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.377+0000 7fae0a6d0640 1 --2- 172.21.15.97:0/634959493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae0415b470 0x7fae040aeca0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009e50 tx=0x7fadfc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e3a7b8f2a2d0a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae08ecd640 1 -- 172.21.15.97:0/634959493 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc02ca80 con 0x7fae0415b470 2023-11-24T08:08:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae08ecd640 1 -- 172.21.15.97:0/634959493 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc02cbe0 con 0x7fae0415b470 2023-11-24T08:08:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae08ecd640 1 -- 172.21.15.97:0/634959493 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0343f0 con 0x7fae0415b470 2023-11-24T08:08:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae0aed1640 1 -- 172.21.15.97:0/634959493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae0415b470 msgr2=0x7fae040aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae0aed1640 1 --2- 172.21.15.97:0/634959493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae0415b470 0x7fae040aeca0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009e50 tx=0x7fadfc02bee0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae0aed1640 1 -- 172.21.15.97:0/634959493 shutdown_connections 2023-11-24T08:08:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae0aed1640 1 --2- 172.21.15.97:0/634959493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae0415b470 0x7fae040aeca0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae0aed1640 1 -- 172.21.15.97:0/634959493 >> 172.21.15.97:0/634959493 conn(0x7fae040cc1d0 msgr2=0x7fae040cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:29.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae0aed1640 1 -- 172.21.15.97:0/634959493 shutdown_connections 2023-11-24T08:08:29.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.378+0000 7fae0aed1640 1 -- 172.21.15.97:0/634959493 wait complete. 2023-11-24T08:08:29.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.380+0000 7fae0aed1640 1 Processor -- start 2023-11-24T08:08:29.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.380+0000 7fae0aed1640 1 -- start start 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae0aed1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae04071290 0x7fae041435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae0aed1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae04155540 0x7fae0406c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae0aed1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0415b470 0x7fae04154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae0aed1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04143b20 con 0x7fae04155540 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae0aed1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04146d50 con 0x7fae0415b470 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae0aed1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae041534c0 con 0x7fae04071290 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae096ce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae04155540 0x7fae0406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae096ce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae04155540 0x7fae0406c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55214/0 (socket says 172.21.15.97:55214) 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.381+0000 7fae096ce640 1 -- 172.21.15.97:0/2050804184 learned_addr learned my addr 172.21.15.97:0/2050804184 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae0a6d0640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0415b470 0x7fae04154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae09ecf640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae04071290 0x7fae041435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae096ce640 1 -- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae04071290 msgr2=0x7fae041435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae096ce640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae04071290 0x7fae041435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae096ce640 1 -- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0415b470 msgr2=0x7fae04154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae096ce640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0415b470 0x7fae04154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae096ce640 1 -- 172.21.15.97:0/2050804184 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc009b30 con 0x7fae04155540 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae0a6d0640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0415b470 0x7fae04154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae096ce640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae04155540 0x7fae0406c900 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c550 tx=0x7fadf400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fadfa7fc640 1 -- 172.21.15.97:0/2050804184 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4005480 con 0x7fae04155540 2023-11-24T08:08:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fadfa7fc640 1 -- 172.21.15.97:0/2050804184 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf40035f0 con 0x7fae04155540 2023-11-24T08:08:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae041537a0 con 0x7fae04155540 2023-11-24T08:08:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fadfa7fc640 1 -- 172.21.15.97:0/2050804184 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf40039a0 con 0x7fae04155540 2023-11-24T08:08:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.382+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae04153d60 con 0x7fae04155540 2023-11-24T08:08:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.383+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae04067b60 con 0x7fae04155540 2023-11-24T08:08:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.385+0000 7fadfa7fc640 1 -- 172.21.15.97:0/2050804184 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fadf4003b00 con 0x7fae04155540 2023-11-24T08:08:29.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.386+0000 7fadfa7fc640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fade806ae40 0x7fade806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:29.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.386+0000 7fadfa7fc640 1 -- 172.21.15.97:0/2050804184 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fadf40889e0 con 0x7fae04155540 2023-11-24T08:08:29.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.386+0000 7fae09ecf640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fade806ae40 0x7fade806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:29.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.387+0000 7fae09ecf640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fade806ae40 0x7fade806d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae00003d90 tx=0x7fae00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:29.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.390+0000 7fadfa7fc640 1 -- 172.21.15.97:0/2050804184 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fadf4053c80 con 0x7fae04155540 2023-11-24T08:08:29.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:29.578+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae040cdce0 con 0x7fae04155540 2023-11-24T08:08:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.140+0000 7fadfa7fc640 1 -- 172.21.15.97:0/2050804184 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7fadf4017070 con 0x7fae04155540 2023-11-24T08:08:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' removed 2023-11-24T08:08:30.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.146+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fade806ae40 msgr2=0x7fade806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.146+0000 7fae0aed1640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fade806ae40 0x7fade806d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae00003d90 tx=0x7fae00009040 comp rx=0 tx=0).stop 2023-11-24T08:08:30.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.146+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae04155540 msgr2=0x7fae0406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.146+0000 7fae0aed1640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae04155540 0x7fae0406c900 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c550 tx=0x7fadf400ca10 comp rx=0 tx=0).stop 2023-11-24T08:08:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.146+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 shutdown_connections 2023-11-24T08:08:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.146+0000 7fae0aed1640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fade806ae40 0x7fade806d300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.146+0000 7fae0aed1640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0415b470 0x7fae04154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.147+0000 7fae0aed1640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fae04155540 0x7fae0406c900 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.147+0000 7fae0aed1640 1 --2- 172.21.15.97:0/2050804184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae04071290 0x7fae041435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.147+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 >> 172.21.15.97:0/2050804184 conn(0x7fae040cc1d0 msgr2=0x7fae040ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.147+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 shutdown_connections 2023-11-24T08:08:30.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.147+0000 7fae0aed1640 1 -- 172.21.15.97:0/2050804184 wait complete. 2023-11-24T08:08:30.173 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:08:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.382+0000 7f8baddc5640 1 Processor -- start 2023-11-24T08:08:30.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.382+0000 7f8baddc5640 1 -- start start 2023-11-24T08:08:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.384+0000 7f8baddc5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8ba8143ae0 0x7f8ba80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.384+0000 7f8baddc5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8ba80cf7d0 0x7f8ba815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.384+0000 7f8baddc5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba815e1e0 0x7f8ba815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.384+0000 7f8baddc5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba80cfc30 con 0x7f8ba8143ae0 2023-11-24T08:08:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.384+0000 7f8baddc5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba80b1ee0 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.384+0000 7f8baddc5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80b2780 con 0x7f8ba815e1e0 2023-11-24T08:08:30.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8ba8143ae0 0x7f8ba80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8ba8143ae0 0x7f8ba80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55220/0 (socket says 172.21.15.97:55220) 2023-11-24T08:08:30.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 -- 172.21.15.97:0/938641793 learned_addr learned my addr 172.21.15.97:0/938641793 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:30.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba7fff640 1 --2- 172.21.15.97:0/938641793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba815e1e0 0x7f8ba815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8b9ffff640 1 --2- 172.21.15.97:0/938641793 >> v2:172.21.15.183:3300/0 conn(0x7f8ba80cf7d0 0x7f8ba815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 -- 172.21.15.97:0/938641793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba815e1e0 msgr2=0x7f8ba815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:30.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 --2- 172.21.15.97:0/938641793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba815e1e0 0x7f8ba815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 -- 172.21.15.97:0/938641793 >> v2:172.21.15.183:3300/0 conn(0x7f8ba80cf7d0 msgr2=0x7f8ba815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:30.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 --2- 172.21.15.97:0/938641793 >> v2:172.21.15.183:3300/0 conn(0x7f8ba80cf7d0 0x7f8ba815dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.385+0000 7f8ba77fe640 1 -- 172.21.15.97:0/938641793 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba815e990 con 0x7f8ba8143ae0 2023-11-24T08:08:30.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.386+0000 7f8ba77fe640 1 --2- 172.21.15.97:0/938641793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba8143ae0 0x7f8ba80cf290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80cb830 tx=0x7f8b9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c64c5742634345 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:30.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.387+0000 7f8ba6ffd640 1 -- 172.21.15.97:0/938641793 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98031870 con 0x7f8ba8143ae0 2023-11-24T08:08:30.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.387+0000 7f8ba6ffd640 1 -- 172.21.15.97:0/938641793 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b980319d0 con 0x7f8ba8143ae0 2023-11-24T08:08:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.387+0000 7f8ba6ffd640 1 -- 172.21.15.97:0/938641793 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98031d60 con 0x7f8ba8143ae0 2023-11-24T08:08:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.387+0000 7f8baddc5640 1 -- 172.21.15.97:0/938641793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba8143ae0 msgr2=0x7f8ba80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.387+0000 7f8baddc5640 1 --2- 172.21.15.97:0/938641793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba8143ae0 0x7f8ba80cf290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80cb830 tx=0x7f8b9802b910 comp rx=0 tx=0).stop 2023-11-24T08:08:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.388+0000 7f8baddc5640 1 -- 172.21.15.97:0/938641793 shutdown_connections 2023-11-24T08:08:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.388+0000 7f8baddc5640 1 --2- 172.21.15.97:0/938641793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba815e1e0 0x7f8ba815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.388+0000 7f8baddc5640 1 --2- 172.21.15.97:0/938641793 >> v2:172.21.15.183:3300/0 conn(0x7f8ba80cf7d0 0x7f8ba815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.388+0000 7f8baddc5640 1 --2- 172.21.15.97:0/938641793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba8143ae0 0x7f8ba80cf290 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.388+0000 7f8baddc5640 1 -- 172.21.15.97:0/938641793 >> 172.21.15.97:0/938641793 conn(0x7f8ba806a800 msgr2=0x7f8ba806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:30.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.388+0000 7f8baddc5640 1 -- 172.21.15.97:0/938641793 shutdown_connections 2023-11-24T08:08:30.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.388+0000 7f8baddc5640 1 -- 172.21.15.97:0/938641793 wait complete. 2023-11-24T08:08:30.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.390+0000 7f8baddc5640 1 Processor -- start 2023-11-24T08:08:30.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.390+0000 7f8baddc5640 1 -- start start 2023-11-24T08:08:30.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8baddc5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba80cf7d0 0x7f8ba8136180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8baddc5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba8143ae0 0x7f8ba80c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8baddc5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ba815e1e0 0x7f8ba80c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8baddc5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80ad5c0 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8baddc5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80ad8a0 con 0x7f8ba815e1e0 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8baddc5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80adb80 con 0x7f8ba8143ae0 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba80cf7d0 0x7f8ba8136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba80cf7d0 0x7f8ba8136180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55222/0 (socket says 172.21.15.97:55222) 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 -- 172.21.15.97:0/1915247791 learned_addr learned my addr 172.21.15.97:0/1915247791 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 -- 172.21.15.97:0/1915247791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba8143ae0 msgr2=0x7f8ba80c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba8143ae0 0x7f8ba80c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 -- 172.21.15.97:0/1915247791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ba815e1e0 msgr2=0x7f8ba80c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ba815e1e0 0x7f8ba80c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.391+0000 7f8ba77fe640 1 -- 172.21.15.97:0/1915247791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980094d0 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.392+0000 7f8ba77fe640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba80cf7d0 0x7f8ba8136180 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8b9802b950 tx=0x7f8b980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:30.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.392+0000 7f8ba4ff9640 1 -- 172.21.15.97:0/1915247791 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9803abe0 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.392+0000 7f8ba4ff9640 1 -- 172.21.15.97:0/1915247791 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9803ad40 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.392+0000 7f8ba4ff9640 1 -- 172.21.15.97:0/1915247791 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98044630 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.392+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba80ade60 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.392+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba81366c0 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.393+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba80ae380 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.394+0000 7f8ba4ff9640 1 -- 172.21.15.97:0/1915247791 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b9804d450 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.395+0000 7f8ba4ff9640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b8806ae40 0x7f8b8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.395+0000 7f8ba4ff9640 1 -- 172.21.15.97:0/1915247791 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b9802d040 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.396+0000 7f8b9ffff640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b8806ae40 0x7f8b8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.396+0000 7f8b9ffff640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b8806ae40 0x7f8b8806d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80cedd0 tx=0x7f8b90009500 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:30.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.400+0000 7f8ba4ff9640 1 -- 172.21.15.97:0/1915247791 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ba80ae380 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.604+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8ba80ae380 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.610+0000 7f8ba4ff9640 1 -- 172.21.15.97:0/1915247791 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ba80ae380 con 0x7f8ba80cf7d0 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b8806ae40 msgr2=0x7f8b8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b8806ae40 0x7f8b8806d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80cedd0 tx=0x7f8b90009500 comp rx=0 tx=0).stop 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba80cf7d0 msgr2=0x7f8ba8136180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba80cf7d0 0x7f8ba8136180 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8b9802b950 tx=0x7f8b980046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 shutdown_connections 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f8b8806ae40 0x7f8b8806d300 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ba815e1e0 0x7f8ba80c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ba8143ae0 0x7f8ba80c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 --2- 172.21.15.97:0/1915247791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ba80cf7d0 0x7f8ba8136180 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 >> 172.21.15.97:0/1915247791 conn(0x7f8ba806a800 msgr2=0x7f8ba815b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 shutdown_connections 2023-11-24T08:08:30.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.613+0000 7f8baddc5640 1 -- 172.21.15.97:0/1915247791 wait complete. 2023-11-24T08:08:30.634 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-11-24T08:08:30.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.821+0000 7f3a73c7c640 1 Processor -- start 2023-11-24T08:08:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.821+0000 7f3a73c7c640 1 -- start start 2023-11-24T08:08:30.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.822+0000 7f3a73c7c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3a6c13df80 0x7f3a6c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.822+0000 7f3a73c7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.822+0000 7f3a73c7c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c06c470 con 0x7f3a6c13e360 2023-11-24T08:08:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.822+0000 7f3a73c7c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c06c750 con 0x7f3a6c13df80 2023-11-24T08:08:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a73c7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c06ca30 con 0x7f3a6c0cf9a0 2023-11-24T08:08:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a71a18640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3a6c13df80 0x7f3a6c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a71217640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3a6c13e360 0x7f3a6c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41350/0 (socket says 172.21.15.97:41350) 2023-11-24T08:08:30.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a71217640 1 -- 172.21.15.97:0/2471848055 learned_addr learned my addr 172.21.15.97:0/2471848055 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:30.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a72219640 1 --2- 172.21.15.97:0/2471848055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a71a18640 1 -- 172.21.15.97:0/2471848055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 msgr2=0x7f3a6c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:30.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a71a18640 1 --2- 172.21.15.97:0/2471848055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c0cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a71a18640 1 -- 172.21.15.97:0/2471848055 >> v1:172.21.15.97:6789/0 conn(0x7f3a6c13e360 legacy=0x7f3a6c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a71a18640 1 -- 172.21.15.97:0/2471848055 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c06cd10 con 0x7f3a6c13df80 2023-11-24T08:08:30.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.823+0000 7f3a70a16640 1 -- 172.21.15.97:0/2471848055 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120880446 0 0) 0x7f3a6c06c470 con 0x7f3a6c13e360 2023-11-24T08:08:30.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.824+0000 7f3a71a18640 1 --2- 172.21.15.97:0/2471848055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c15bee0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3a680097a0 tx=0x7f3a6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbfdf7eded6f3a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:30.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.825+0000 7f3a70a16640 1 -- 172.21.15.97:0/2471848055 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68031830 con 0x7f3a6c13df80 2023-11-24T08:08:30.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.825+0000 7f3a70a16640 1 -- 172.21.15.97:0/2471848055 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68031990 con 0x7f3a6c13df80 2023-11-24T08:08:30.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.825+0000 7f3a70a16640 1 -- 172.21.15.97:0/2471848055 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68031d20 con 0x7f3a6c13df80 2023-11-24T08:08:30.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.825+0000 7f3a73c7c640 1 -- 172.21.15.97:0/2471848055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 msgr2=0x7f3a6c15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.825+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/2471848055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c15bee0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3a680097a0 tx=0x7f3a6802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.825+0000 7f3a73c7c640 1 -- 172.21.15.97:0/2471848055 shutdown_connections 2023-11-24T08:08:30.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.825+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/2471848055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.826+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/2471848055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c15bee0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.826+0000 7f3a73c7c640 1 -- 172.21.15.97:0/2471848055 >> 172.21.15.97:0/2471848055 conn(0x7f3a6c06a800 msgr2=0x7f3a6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:30.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.826+0000 7f3a73c7c640 1 -- 172.21.15.97:0/2471848055 shutdown_connections 2023-11-24T08:08:30.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.826+0000 7f3a73c7c640 1 -- 172.21.15.97:0/2471848055 wait complete. 2023-11-24T08:08:30.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.828+0000 7f3a73c7c640 1 Processor -- start 2023-11-24T08:08:30.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.828+0000 7f3a73c7c640 1 -- start start 2023-11-24T08:08:30.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a73c7c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a73c7c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a73c7c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a6c13e360 0x7f3a6c0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a73c7c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0a94b0 con 0x7f3a6c13df80 2023-11-24T08:08:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a73c7c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0acc80 con 0x7f3a6c13e360 2023-11-24T08:08:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a73c7c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c13ca70 con 0x7f3a6c0cf9a0 2023-11-24T08:08:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a71217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a71217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55242/0 (socket says 172.21.15.97:55242) 2023-11-24T08:08:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.829+0000 7f3a71217640 1 -- 172.21.15.97:0/3220064217 learned_addr learned my addr 172.21.15.97:0/3220064217 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71a18640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a72219640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a6c13e360 0x7f3a6c0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71217640 1 -- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 msgr2=0x7f3a6c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71217640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71217640 1 -- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a6c13e360 msgr2=0x7f3a6c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71217640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a6c13e360 0x7f3a6c0b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71217640 1 -- 172.21.15.97:0/3220064217 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009400 con 0x7f3a6c13df80 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71a18640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a71217640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c0b2cf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c4b0 tx=0x7f3a5c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a627fc640 1 -- 172.21.15.97:0/3220064217 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0074e0 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a627fc640 1 -- 172.21.15.97:0/3220064217 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c007660 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a627fc640 1 -- 172.21.15.97:0/3220064217 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c004a20 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.830+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c13ccc0 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.831+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c13d280 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.832+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c0675d0 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.833+0000 7f3a627fc640 1 -- 172.21.15.97:0/3220064217 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a5c004b80 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.833+0000 7f3a627fc640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3a5006ae40 0x7f3a5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.833+0000 7f3a627fc640 1 -- 172.21.15.97:0/3220064217 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3a5c0885b0 con 0x7f3a6c13df80 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.834+0000 7f3a71a18640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3a5006ae40 0x7f3a5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.834+0000 7f3a71a18640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3a5006ae40 0x7f3a5006d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a68036000 tx=0x7f3a68008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:30.839+0000 7f3a627fc640 1 -- 172.21.15.97:0/3220064217 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a5c053980 con 0x7f3a6c13df80 2023-11-24T08:08:31.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.095+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f3a6c06df00 con 0x7f3a6c13df80 2023-11-24T08:08:31.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.142+0000 7f3a627fc640 1 -- 172.21.15.97:0/3220064217 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v117) v1 ==== 167+0+0 (secure 0 0 0) 0x7f3a5c0180e0 con 0x7f3a6c13df80 2023-11-24T08:08:31.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.146+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3a5006ae40 msgr2=0x7f3a5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.146+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3a5006ae40 0x7f3a5006d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a68036000 tx=0x7f3a68008030 comp rx=0 tx=0).stop 2023-11-24T08:08:31.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 msgr2=0x7f3a6c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c0b2cf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c4b0 tx=0x7f3a5c00c970 comp rx=0 tx=0).stop 2023-11-24T08:08:31.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 shutdown_connections 2023-11-24T08:08:31.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f3a5006ae40 0x7f3a5006d300 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a6c13e360 0x7f3a6c0b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a6c13df80 0x7f3a6c0b2cf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 --2- 172.21.15.97:0/3220064217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a6c0cf9a0 0x7f3a6c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 >> 172.21.15.97:0/3220064217 conn(0x7f3a6c06a800 msgr2=0x7f3a6c0cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:31.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 shutdown_connections 2023-11-24T08:08:31.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.147+0000 7f3a73c7c640 1 -- 172.21.15.97:0/3220064217 wait complete. 2023-11-24T08:08:31.169 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ERROR 2023-11-24T08:08:31.169 INFO:tasks.cephfs_test_runner: 2023-11-24T08:08:31.169 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner:ERROR: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 8014, in test_volumes_module_finisher_thread 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner: subvol1, subvol2, subvol3 = self._generate_random_subvolume_name(3) 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner:AttributeError: 'TestPerModuleFinsherThread' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner: 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner:Ran 1 test in 67.289s 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner: 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T08:08:31.170 INFO:tasks.cephfs_test_runner: 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner:ERROR: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 8014, in test_volumes_module_finisher_thread 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner: subvol1, subvol2, subvol3 = self._generate_random_subvolume_name(3) 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner:AttributeError: 'TestPerModuleFinsherThread' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:08:31.171 INFO:tasks.cephfs_test_runner: 2023-11-24T08:08:31.171 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T08:08:31.239 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=651f5ce5f9284a4d96d2b513c0e76e25 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T08:08:31.241 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T08:08:31.250 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-11-24T08:08:31.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:31.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.486+0000 7f70ae6b4640 1 Processor -- start 2023-11-24T08:08:31.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.486+0000 7f70ae6b4640 1 -- start start 2023-11-24T08:08:31.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.487+0000 7f70ae6b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 0x7f70a8146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70ae6b4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f70a8071f00 0x7f70a8166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70ae6b4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a80b2e10 con 0x7f70a806c7c0 2023-11-24T08:08:31.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70ae6b4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a806cc20 con 0x7f70a8071f00 2023-11-24T08:08:31.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70ae6b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a806cec0 con 0x7f70a8071410 2023-11-24T08:08:31.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70aceb1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f70a806c7c0 0x7f70a80717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41354/0 (socket says 172.21.15.97:41354) 2023-11-24T08:08:31.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70aceb1640 1 -- 172.21.15.97:0/4025862027 learned_addr learned my addr 172.21.15.97:0/4025862027 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:31.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211445494 0 0) 0x7f70a80b2e10 con 0x7f70a806c7c0 2023-11-24T08:08:31.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 0x7f70a8146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7094003520 con 0x7f70a806c7c0 2023-11-24T08:08:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.488+0000 7f70adeb3640 1 --2- 172.21.15.97:0/4025862027 >> v2:172.21.15.183:3300/0 conn(0x7f70a8071f00 0x7f70a8166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2078070880 0 0) 0x7f7094003520 con 0x7f70a806c7c0 2023-11-24T08:08:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 msgr2=0x7f70a8146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 0x7f70a8146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 >> v2:172.21.15.183:3300/0 conn(0x7f70a8071f00 msgr2=0x7f70a8166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:31.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 --2- 172.21.15.97:0/4025862027 >> v2:172.21.15.183:3300/0 conn(0x7f70a8071f00 0x7f70a8166cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a806d1a0 con 0x7f70a806c7c0 2023-11-24T08:08:31.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f7098001670 con 0x7f70a806c7c0 2023-11-24T08:08:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 >> v1:172.21.15.97:6789/0 conn(0x7f70a806c7c0 legacy=0x7f70a80717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7094003970 0x7f7094003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 0x7f70940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094004d00 0x7f7094005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a806cc20 con 0x7f7094003970 2023-11-24T08:08:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a806cec0 con 0x7f7094004d00 2023-11-24T08:08:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709400bab0 con 0x7f70a8071410 2023-11-24T08:08:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7094003970 0x7f7094003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f70ad6b2640 1 -- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 msgr2=0x7f70940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f70aceb1640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 0x7f70940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a8071410 0x7f70940047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f70ad6b2640 1 -- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094004d00 msgr2=0x7f7094005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094004d00 0x7f7094005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.489+0000 7f70ad6b2640 1 -- 172.21.15.97:0/4025862027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7094003520 con 0x7f7094003970 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.490+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7094003970 0x7f7094003d90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ba30 tx=0x7f70940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371125e5b15ae5a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4032630 con 0x7f7094003970 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4032790 con 0x7f7094003970 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f709ffff640 1 -- 172.21.15.97:0/4025862027 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4032b20 con 0x7f7094003970 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4025862027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7094003970 msgr2=0x7f7094003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f70ae6b4640 1 --2- 172.21.15.97:0/4025862027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7094003970 0x7f7094003d90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ba30 tx=0x7f70940057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f70adeb3640 1 -- 172.21.15.97:0/4025862027 reap_dead start 2023-11-24T08:08:31.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4025862027 shutdown_connections 2023-11-24T08:08:31.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4025862027 >> 172.21.15.97:0/4025862027 conn(0x7f70a806a800 msgr2=0x7f70a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:31.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4025862027 shutdown_connections 2023-11-24T08:08:31.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.491+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4025862027 wait complete. 2023-11-24T08:08:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.493+0000 7f70ae6b4640 1 Processor -- start 2023-11-24T08:08:31.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.493+0000 7f70ae6b4640 1 -- start start 2023-11-24T08:08:31.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70ae6b4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7094003970 0x7f70a81e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70ae6b4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a815cb80 0x7f70a8144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70ae6b4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a813fe40 0x7f70a813c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70ae6b4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81e39f0 con 0x7f70a815cb80 2023-11-24T08:08:31.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70ae6b4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81e2450 con 0x7f70a813fe40 2023-11-24T08:08:31.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70ae6b4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81e26f0 con 0x7f7094003970 2023-11-24T08:08:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70aceb1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a815cb80 0x7f70a8144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70aceb1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a815cb80 0x7f70a8144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55264/0 (socket says 172.21.15.97:55264) 2023-11-24T08:08:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.494+0000 7f70aceb1640 1 -- 172.21.15.97:0/4153531807 learned_addr learned my addr 172.21.15.97:0/4153531807 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7094003970 0x7f70a81e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70aceb1640 1 -- 172.21.15.97:0/4153531807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7094003970 msgr2=0x7f70a81e34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70aceb1640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7094003970 0x7f70a81e34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70aceb1640 1 -- 172.21.15.97:0/4153531807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a813fe40 msgr2=0x7f70a813c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70aceb1640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a813fe40 0x7f70a813c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70aceb1640 1 -- 172.21.15.97:0/4153531807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a81e29d0 con 0x7f70a815cb80 2023-11-24T08:08:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70aceb1640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a815cb80 0x7f70a8144f20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f709800d7e0 tx=0x7f709800dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f709dffb640 1 -- 172.21.15.97:0/4153531807 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980074e0 con 0x7f70a815cb80 2023-11-24T08:08:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f709dffb640 1 -- 172.21.15.97:0/4153531807 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7098007640 con 0x7f70a815cb80 2023-11-24T08:08:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a81e2cb0 con 0x7f70a815cb80 2023-11-24T08:08:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.495+0000 7f709dffb640 1 -- 172.21.15.97:0/4153531807 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980049e0 con 0x7f70a815cb80 2023-11-24T08:08:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.496+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a8145460 con 0x7f70a815cb80 2023-11-24T08:08:31.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.497+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a81e31d0 con 0x7f70a815cb80 2023-11-24T08:08:31.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.498+0000 7f709dffb640 1 -- 172.21.15.97:0/4153531807 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7098004b40 con 0x7f70a815cb80 2023-11-24T08:08:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.498+0000 7f709dffb640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f708c06ae70 0x7f708c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.498+0000 7f709dffb640 1 -- 172.21.15.97:0/4153531807 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7098088c50 con 0x7f70a815cb80 2023-11-24T08:08:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.499+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f708c06ae70 0x7f708c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.499+0000 7f70ad6b2640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f708c06ae70 0x7f708c06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ba00 tx=0x7f70a403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.502+0000 7f709dffb640 1 -- 172.21.15.97:0/4153531807 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70a81e31d0 con 0x7f70a815cb80 2023-11-24T08:08:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.678+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a81e31d0 con 0x7f70a815cb80 2023-11-24T08:08:31.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.679+0000 7f709dffb640 1 -- 172.21.15.97:0/4153531807 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+12986 (secure 0 0 0) 0x7f70a81e31d0 con 0x7f70a815cb80 2023-11-24T08:08:31.683 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:31.684 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":38,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:30.128509+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/4116734497":"2023-11-25T08:08:26.845147+0000","172.21.15.97:6834/4116734497":"2023-11-25T08:08:26.845147+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:31.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f708c06ae70 msgr2=0x7f708c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f708c06ae70 0x7f708c06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ba00 tx=0x7f70a403d040 comp rx=0 tx=0).stop 2023-11-24T08:08:31.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a815cb80 msgr2=0x7f70a8144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a815cb80 0x7f70a8144f20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f709800d7e0 tx=0x7f709800dca0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 shutdown_connections 2023-11-24T08:08:31.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f708c06ae70 0x7f708c06d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a813fe40 0x7f70a813c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70a815cb80 0x7f70a8144f20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 --2- 172.21.15.97:0/4153531807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7094003970 0x7f70a81e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 >> 172.21.15.97:0/4153531807 conn(0x7f70a806a800 msgr2=0x7f70a80b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:31.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 shutdown_connections 2023-11-24T08:08:31.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.682+0000 7f70ae6b4640 1 -- 172.21.15.97:0/4153531807 wait complete. 2023-11-24T08:08:31.704 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:06:35.332785+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:08:31.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:08:31.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.914+0000 7fa6707a9640 1 Processor -- start 2023-11-24T08:08:31.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.914+0000 7fa6707a9640 1 -- start start 2023-11-24T08:08:31.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.915+0000 7fa6707a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 0x7fa668166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.915+0000 7fa6707a9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66815c5f0 con 0x7fa66813df80 2023-11-24T08:08:31.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.915+0000 7fa6707a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66806c470 con 0x7fa66813e360 2023-11-24T08:08:31.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.915+0000 7fa6707a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66806c750 con 0x7fa6680cf9a0 2023-11-24T08:08:31.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.916+0000 7fa66e545640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa66813df80 0x7fa66815bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41362/0 (socket says 172.21.15.97:41362) 2023-11-24T08:08:31.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.916+0000 7fa66e545640 1 -- 172.21.15.97:0/2263315187 learned_addr learned my addr 172.21.15.97:0/2263315187 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:31.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.916+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040093969 0 0) 0x7fa66815c5f0 con 0x7fa66813df80 2023-11-24T08:08:31.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.916+0000 7fa66ed46640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 0x7fa668166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.916+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa654003520 con 0x7fa66813df80 2023-11-24T08:08:31.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82239683 0 0) 0x7fa654003520 con 0x7fa66813df80 2023-11-24T08:08:31.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 msgr2=0x7fa668166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:31.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 0x7fa668166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 >> v1:172.21.15.183:6789/0 conn(0x7fa66813e360 legacy=0x7fa6680cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66806ca30 con 0x7fa66813df80 2023-11-24T08:08:31.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fa664001670 con 0x7fa66813df80 2023-11-24T08:08:31.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66ed46640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 0x7fa668166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:08:31.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 >> v1:172.21.15.97:6789/0 conn(0x7fa66813df80 legacy=0x7fa66815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa654003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 0x7fa6540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa654004d00 0x7fa654005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66806c750 con 0x7fa6540039a0 2023-11-24T08:08:31.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65400bb10 con 0x7fa654004d00 2023-11-24T08:08:31.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65400bcd0 con 0x7fa6680cf9a0 2023-11-24T08:08:31.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66e545640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa654003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66e545640 1 -- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 msgr2=0x7fa6540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:31.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66e545640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6680cf9a0 0x7fa6540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66e545640 1 -- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa654004d00 msgr2=0x7fa654005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66e545640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa654004d00 0x7fa654005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.917+0000 7fa66e545640 1 -- 172.21.15.97:0/2263315187 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654003520 con 0x7fa6540039a0 2023-11-24T08:08:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.918+0000 7fa66e545640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa654003dc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa664001eb0 tx=0x7fa6540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9011a9162ea381ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664005ad0 con 0x7fa6540039a0 2023-11-24T08:08:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664005c30 con 0x7fa6540039a0 2023-11-24T08:08:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa66d543640 1 -- 172.21.15.97:0/2263315187 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66402c7c0 con 0x7fa6540039a0 2023-11-24T08:08:31.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa6707a9640 1 -- 172.21.15.97:0/2263315187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 msgr2=0x7fa654003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa6707a9640 1 --2- 172.21.15.97:0/2263315187 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa654003dc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa664001eb0 tx=0x7fa6540057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa66ed46640 1 -- 172.21.15.97:0/2263315187 reap_dead start 2023-11-24T08:08:31.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa6707a9640 1 -- 172.21.15.97:0/2263315187 shutdown_connections 2023-11-24T08:08:31.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.919+0000 7fa6707a9640 1 -- 172.21.15.97:0/2263315187 >> 172.21.15.97:0/2263315187 conn(0x7fa66806a800 msgr2=0x7fa66806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:31.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.920+0000 7fa6707a9640 1 -- 172.21.15.97:0/2263315187 shutdown_connections 2023-11-24T08:08:31.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.920+0000 7fa6707a9640 1 -- 172.21.15.97:0/2263315187 wait complete. 2023-11-24T08:08:31.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.921+0000 7fa6707a9640 1 Processor -- start 2023-11-24T08:08:31.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.921+0000 7fa6707a9640 1 -- start start 2023-11-24T08:08:31.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.922+0000 7fa6707a9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa6680b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.922+0000 7fa6707a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6681f2e30 0x7fa66814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.922+0000 7fa6707a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa66814b190 0x7fa6680afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.922+0000 7fa6707a9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6680b4270 con 0x7fa6540039a0 2023-11-24T08:08:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.922+0000 7fa6707a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6680b2c90 con 0x7fa6681f2e30 2023-11-24T08:08:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.922+0000 7fa6707a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6680b2f70 con 0x7fa66814b190 2023-11-24T08:08:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa6680b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa6680b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55284/0 (socket says 172.21.15.97:55284) 2023-11-24T08:08:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 -- 172.21.15.97:0/1172512464 learned_addr learned my addr 172.21.15.97:0/1172512464 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 -- 172.21.15.97:0/1172512464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa66814b190 msgr2=0x7fa6680afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa66814b190 0x7fa6680afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 -- 172.21.15.97:0/1172512464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6681f2e30 msgr2=0x7fa66814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6681f2e30 0x7fa66814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 -- 172.21.15.97:0/1172512464 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6680b3250 con 0x7fa6540039a0 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.923+0000 7fa66e545640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa6680b3d30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c1d0 tx=0x7fa664001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.924+0000 7fa65effd640 1 -- 172.21.15.97:0/1172512464 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66403c040 con 0x7fa6540039a0 2023-11-24T08:08:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.924+0000 7fa65effd640 1 -- 172.21.15.97:0/1172512464 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66402dc60 con 0x7fa6540039a0 2023-11-24T08:08:31.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.924+0000 7fa65effd640 1 -- 172.21.15.97:0/1172512464 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664007070 con 0x7fa6540039a0 2023-11-24T08:08:31.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.924+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6680b3530 con 0x7fa6540039a0 2023-11-24T08:08:31.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.924+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6681f32b0 con 0x7fa6540039a0 2023-11-24T08:08:31.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.925+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6680675d0 con 0x7fa6540039a0 2023-11-24T08:08:31.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.926+0000 7fa65effd640 1 -- 172.21.15.97:0/1172512464 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa664032070 con 0x7fa6540039a0 2023-11-24T08:08:31.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.927+0000 7fa65effd640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa64c06ae40 0x7fa64c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:31.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.927+0000 7fa65effd640 1 -- 172.21.15.97:0/1172512464 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6640aad70 con 0x7fa6540039a0 2023-11-24T08:08:31.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.928+0000 7fa66dd44640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa64c06ae40 0x7fa64c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:31.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.928+0000 7fa66dd44640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa64c06ae40 0x7fa64c06d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa6680b2540 tx=0x7fa658007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:31.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:31.932+0000 7fa65effd640 1 -- 172.21.15.97:0/1172512464 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6640761b0 con 0x7fa6540039a0 2023-11-24T08:08:32.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.122+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa66806df00 con 0x7fa6540039a0 2023-11-24T08:08:32.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.123+0000 7fa65effd640 1 -- 172.21.15.97:0/1172512464 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6640797d0 con 0x7fa6540039a0 2023-11-24T08:08:32.126 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-11-24T08:08:32.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa64c06ae40 msgr2=0x7fa64c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:32.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa64c06ae40 0x7fa64c06d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa6680b2540 tx=0x7fa658007990 comp rx=0 tx=0).stop 2023-11-24T08:08:32.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 msgr2=0x7fa6680b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:32.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa6680b3d30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c1d0 tx=0x7fa664001930 comp rx=0 tx=0).stop 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 shutdown_connections 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa64c06ae40 0x7fa64c06d300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa66814b190 0x7fa6680afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6681f2e30 0x7fa66814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 --2- 172.21.15.97:0/1172512464 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6540039a0 0x7fa6680b3d30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 >> 172.21.15.97:0/1172512464 conn(0x7fa66806a800 msgr2=0x7fa66815d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 shutdown_connections 2023-11-24T08:08:32.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.126+0000 7fa6707a9640 1 -- 172.21.15.97:0/1172512464 wait complete. 2023-11-24T08:08:32.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-11-24T08:08:32.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.356+0000 7fa2d6101640 1 Processor -- start 2023-11-24T08:08:32.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.356+0000 7fa2d6101640 1 -- start start 2023-11-24T08:08:32.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2d6101640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa2d0143ae0 0x7fa2d00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:32.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2d6101640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa2d00cf7d0 0x7fa2d015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:32.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2d6101640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d00cfc30 con 0x7fa2d015e1e0 2023-11-24T08:08:32.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2d6101640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d00b1ee0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2d6101640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d00b2780 con 0x7fa2d0143ae0 2023-11-24T08:08:32.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2ceffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa2d00cf7d0 0x7fa2d015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:32.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2ceffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa2d00cf7d0 0x7fa2d015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55290/0 (socket says 172.21.15.97:55290) 2023-11-24T08:08:32.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2ceffd640 1 -- 172.21.15.97:0/1957555726 learned_addr learned my addr 172.21.15.97:0/1957555726 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:32.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2ceffd640 1 -- 172.21.15.97:0/1957555726 >> v2:172.21.15.183:3300/0 conn(0x7fa2d0143ae0 msgr2=0x7fa2d00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:32.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2ceffd640 1 --2- 172.21.15.97:0/1957555726 >> v2:172.21.15.183:3300/0 conn(0x7fa2d0143ae0 0x7fa2d00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.358+0000 7fa2ceffd640 1 -- 172.21.15.97:0/1957555726 >> v1:172.21.15.183:6789/0 conn(0x7fa2d015e1e0 legacy=0x7fa2d015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.359+0000 7fa2ceffd640 1 -- 172.21.15.97:0/1957555726 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d015e990 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.360+0000 7fa2ceffd640 1 --2- 172.21.15.97:0/1957555726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d015dca0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00cfea0 tx=0x7fa2c402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f454cff286f1005b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.360+0000 7fa2ce7fc640 1 -- 172.21.15.97:0/1957555726 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c402eea0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.360+0000 7fa2ce7fc640 1 -- 172.21.15.97:0/1957555726 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4036440 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.360+0000 7fa2ce7fc640 1 -- 172.21.15.97:0/1957555726 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40367d0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 -- 172.21.15.97:0/1957555726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 msgr2=0x7fa2d015dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:32.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 --2- 172.21.15.97:0/1957555726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d015dca0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00cfea0 tx=0x7fa2c402e0f0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 -- 172.21.15.97:0/1957555726 shutdown_connections 2023-11-24T08:08:32.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 --2- 172.21.15.97:0/1957555726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d015dca0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 --2- 172.21.15.97:0/1957555726 >> v2:172.21.15.183:3300/0 conn(0x7fa2d0143ae0 0x7fa2d00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 -- 172.21.15.97:0/1957555726 >> 172.21.15.97:0/1957555726 conn(0x7fa2d006a800 msgr2=0x7fa2d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:32.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 -- 172.21.15.97:0/1957555726 shutdown_connections 2023-11-24T08:08:32.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.361+0000 7fa2d6101640 1 -- 172.21.15.97:0/1957555726 wait complete. 2023-11-24T08:08:32.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.363+0000 7fa2d6101640 1 Processor -- start 2023-11-24T08:08:32.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.363+0000 7fa2d6101640 1 -- start start 2023-11-24T08:08:32.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.364+0000 7fa2d6101640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d0141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:32.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.364+0000 7fa2d6101640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2d0143ae0 0x7fa2d00cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:32.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.364+0000 7fa2d6101640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2d015e1e0 0x7fa2d00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:32.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.364+0000 7fa2d6101640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00cd7b0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.364+0000 7fa2d6101640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00cda90 con 0x7fa2d0143ae0 2023-11-24T08:08:32.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.364+0000 7fa2d6101640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00cdd70 con 0x7fa2d015e1e0 2023-11-24T08:08:32.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d0141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:32.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d0141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55304/0 (socket says 172.21.15.97:55304) 2023-11-24T08:08:32.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 -- 172.21.15.97:0/3179323079 learned_addr learned my addr 172.21.15.97:0/3179323079 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:32.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2ceffd640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2d0143ae0 0x7fa2d00cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:32.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cffff640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2d015e1e0 0x7fa2d00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:32.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 -- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2d015e1e0 msgr2=0x7fa2d00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:32.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2d015e1e0 0x7fa2d00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 -- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2d0143ae0 msgr2=0x7fa2d00cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:32.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2d0143ae0 0x7fa2d00cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:32.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.365+0000 7fa2cf7fe640 1 -- 172.21.15.97:0/3179323079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c400b770 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.366+0000 7fa2cf7fe640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d0141920 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000b4a0 tx=0x7fa2c000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:32.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.366+0000 7fa2b7fff640 1 -- 172.21.15.97:0/3179323079 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0010610 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.366+0000 7fa2b7fff640 1 -- 172.21.15.97:0/3179323079 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c0010770 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.366+0000 7fa2b7fff640 1 -- 172.21.15.97:0/3179323079 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0010b20 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.366+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d00ce050 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.366+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d00cd4d0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.367+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d00b2bf0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.368+0000 7fa2b7fff640 1 -- 172.21.15.97:0/3179323079 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2c0010c80 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.369+0000 7fa2b7fff640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa2bc06ae40 0x7fa2bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:32.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.369+0000 7fa2b7fff640 1 -- 172.21.15.97:0/3179323079 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa2c0088f20 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.369+0000 7fa2ceffd640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa2bc06ae40 0x7fa2bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:32.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.370+0000 7fa2ceffd640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa2bc06ae40 0x7fa2bc06d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4038000 tx=0x7fa2c4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:32.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.373+0000 7fa2b7fff640 1 -- 172.21.15.97:0/3179323079 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2d00b2bf0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.609+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fa2d00b2bf0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.617+0000 7fa2b7fff640 1 -- 172.21.15.97:0/3179323079 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) v1 ==== 81+0+466146 (secure 0 0 0) 0x7fa2d00b2bf0 con 0x7fa2d00cf7d0 2023-11-24T08:08:32.626 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:32.627 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:32.627 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 5, 2023-11-24T08:08:32.627 INFO:teuthology.orchestra.run.smithi097.stdout: "active_gid": 4101, 2023-11-24T08:08:32.627 INFO:teuthology.orchestra.run.smithi097.stdout: "active_name": "y", 2023-11-24T08:08:32.627 INFO:teuthology.orchestra.run.smithi097.stdout: "active_addrs": { 2023-11-24T08:08:32.627 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2023-11-24T08:08:32.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.628 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2023-11-24T08:08:32.628 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6832", 2023-11-24T08:08:32.628 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2294833959 2023-11-24T08:08:32.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.628 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6833", 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2294833959 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: "active_addr": "172.21.15.97:6833/2294833959", 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: "active_change": "2023-11-24T08:06:27.248812+0000", 2023-11-24T08:08:32.629 INFO:teuthology.orchestra.run.smithi097.stdout: "active_mgr_features": 4540138322906710015, 2023-11-24T08:08:32.630 INFO:teuthology.orchestra.run.smithi097.stdout: "available": true, 2023-11-24T08:08:32.630 INFO:teuthology.orchestra.run.smithi097.stdout: "standbys": [ 2023-11-24T08:08:32.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.630 INFO:teuthology.orchestra.run.smithi097.stdout: "gid": 4114, 2023-11-24T08:08:32.630 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "x", 2023-11-24T08:08:32.631 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_features": 4540138322906710015, 2023-11-24T08:08:32.631 INFO:teuthology.orchestra.run.smithi097.stdout: "available_modules": [ 2023-11-24T08:08:32.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.631 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "alerts", 2023-11-24T08:08:32.631 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:32.631 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:32.631 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.632 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:32.632 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:32.632 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.632 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.632 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.632 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:32.632 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.633 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.633 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.633 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How frequently to reexamine health status", 2023-11-24T08:08:32.633 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.633 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.633 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.634 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.635 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.635 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.635 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.635 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.635 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.635 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.635 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.636 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.636 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.636 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.636 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.636 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.636 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.637 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.637 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.637 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.637 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.637 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.638 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.638 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.638 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.638 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.638 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.638 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.639 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.640 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.640 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.640 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.640 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.640 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.640 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.640 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.641 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.641 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.641 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.641 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.641 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.642 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.643 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.643 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.643 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.643 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.643 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.643 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.644 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.644 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.644 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_destination": { 2023-11-24T08:08:32.644 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_destination", 2023-11-24T08:08:32.644 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.644 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Email address to send alerts to", 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.645 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.646 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.646 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_from_name": { 2023-11-24T08:08:32.646 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_from_name", 2023-11-24T08:08:32.646 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.646 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.646 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "Ceph", 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Email From: name", 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.647 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_host": { 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_host", 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.648 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SMTP server", 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.649 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_password": { 2023-11-24T08:08:32.650 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_password", 2023-11-24T08:08:32.650 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.650 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.650 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.650 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.650 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.650 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.651 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.651 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Password to authenticate with", 2023-11-24T08:08:32.651 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.651 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.651 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.652 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_port": { 2023-11-24T08:08:32.652 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_port", 2023-11-24T08:08:32.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.652 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.652 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.652 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "465", 2023-11-24T08:08:32.652 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SMTP port", 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.653 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_sender": { 2023-11-24T08:08:32.654 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_sender", 2023-11-24T08:08:32.654 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.654 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.654 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.654 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.654 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.654 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.655 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.655 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SMTP envelope sender", 2023-11-24T08:08:32.655 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.655 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.655 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.655 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_ssl": { 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_ssl", 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.656 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.657 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-24T08:08:32.657 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.657 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.657 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.657 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_user": { 2023-11-24T08:08:32.657 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_user", 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.658 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "User to authenticate as", 2023-11-24T08:08:32.659 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.659 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.659 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "balancer", 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "active": { 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "active", 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.660 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.661 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.661 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.661 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.661 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.661 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.661 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "automatically balance PGs across cluster", 2023-11-24T08:08:32.662 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.662 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.662 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.662 INFO:teuthology.orchestra.run.smithi097.stdout: "begin_time": { 2023-11-24T08:08:32.662 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "begin_time", 2023-11-24T08:08:32.662 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0000", 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "beginning time of day to automatically balance", 2023-11-24T08:08:32.663 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: "begin_weekday": { 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "begin_weekday", 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.664 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.665 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:32.665 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "0", 2023-11-24T08:08:32.665 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "6", 2023-11-24T08:08:32.665 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.665 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-24T08:08:32.665 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T08:08:32.665 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_compat_max_iterations": { 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crush_compat_max_iterations", 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.666 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "25", 2023-11-24T08:08:32.667 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:32.667 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "250", 2023-11-24T08:08:32.667 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.667 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-24T08:08:32.667 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.667 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.667 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_compat_metrics": { 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crush_compat_metrics", 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "pgs,objects,bytes", 2023-11-24T08:08:32.668 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.669 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_compat_step": { 2023-11-24T08:08:32.670 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crush_compat_step", 2023-11-24T08:08:32.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:32.670 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.670 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.670 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0.5", 2023-11-24T08:08:32.670 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "0.001", 2023-11-24T08:08:32.670 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "0.999", 2023-11-24T08:08:32.671 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.671 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "aggressiveness of optimization", 2023-11-24T08:08:32.671 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-24T08:08:32.671 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.671 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "end_time": { 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "end_time", 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "2359", 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.672 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.673 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.673 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "ending time of day to automatically balance", 2023-11-24T08:08:32.673 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T08:08:32.673 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.673 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.673 INFO:teuthology.orchestra.run.smithi097.stdout: "end_weekday": { 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "end_weekday", 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "0", 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "6", 2023-11-24T08:08:32.674 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.675 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.676 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.676 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.676 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.676 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.676 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.676 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.676 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.677 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.678 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.679 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.679 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.679 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.679 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.679 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.679 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.679 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.681 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.681 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.681 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.681 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.681 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.681 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.682 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.682 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.682 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.682 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.683 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.683 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.683 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.683 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.683 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.683 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.683 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.684 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.685 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.686 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.686 INFO:teuthology.orchestra.run.smithi097.stdout: "min_score": { 2023-11-24T08:08:32.686 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "min_score", 2023-11-24T08:08:32.686 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:32.686 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.686 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.687 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: "mode": { 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mode", 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "upmap", 2023-11-24T08:08:32.688 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-compat", 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: "none", 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: "upmap" 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Balancer mode", 2023-11-24T08:08:32.689 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_ids": { 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pool_ids", 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.690 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.691 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.691 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.691 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.691 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.691 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-24T08:08:32.692 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.692 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.692 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.693 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:32.693 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:32.693 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.693 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.693 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.693 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:32.694 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.694 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.694 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.694 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-24T08:08:32.694 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.694 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.694 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: "upmap_max_deviation": { 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "upmap_max_deviation", 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:32.695 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:32.696 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.696 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.696 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-24T08:08:32.696 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-24T08:08:32.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.696 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "upmap_max_optimizations": { 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "upmap_max_optimizations", 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.697 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cephadm", 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: "agent_down_multiplier": { 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "agent_down_multiplier", 2023-11-24T08:08:32.699 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "3.0", 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-24T08:08:32.700 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: "agent_refresh_rate": { 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "agent_refresh_rate", 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.701 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "20", 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.702 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.703 INFO:teuthology.orchestra.run.smithi097.stdout: "agent_starting_port": { 2023-11-24T08:08:32.703 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "agent_starting_port", 2023-11-24T08:08:32.703 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.703 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.703 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.703 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "4721", 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.705 INFO:teuthology.orchestra.run.smithi097.stdout: "allow_ptrace": { 2023-11-24T08:08:32.705 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "allow_ptrace", 2023-11-24T08:08:32.705 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.705 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.705 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.705 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.705 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.706 INFO:teuthology.orchestra.run.smithi097.stdout: "autotune_interval": { 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "autotune_interval", 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.707 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.708 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-24T08:08:32.708 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.708 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.708 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.708 INFO:teuthology.orchestra.run.smithi097.stdout: "autotune_memory_target_ratio": { 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "autotune_memory_target_ratio", 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0.7", 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.709 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-24T08:08:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm_log_destination": { 2023-11-24T08:08:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cephadm_log_destination", 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.711 INFO:teuthology.orchestra.run.smithi097.stdout: "file", 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: "file,syslog", 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: "syslog" 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "cgroups_split": { 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cgroups_split", 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.713 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.714 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.714 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-24T08:08:32.714 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.714 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.714 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.714 INFO:teuthology.orchestra.run.smithi097.stdout: "config_checks_enabled": { 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "config_checks_enabled", 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.715 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: "config_dashboard": { 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "config_dashboard", 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.716 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.717 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.718 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.718 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_alertmanager": { 2023-11-24T08:08:32.718 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_alertmanager", 2023-11-24T08:08:32.718 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.718 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.718 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.719 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_base": { 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_base", 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-24T08:08:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.721 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.721 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.721 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Container image name, without the tag", 2023-11-24T08:08:32.721 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.721 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.721 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_elasticsearch": { 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_elasticsearch", 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.722 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "elasticsearch container image", 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_grafana": { 2023-11-24T08:08:32.723 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_grafana", 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.724 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_haproxy": { 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_haproxy", 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.725 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.726 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.726 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-24T08:08:32.726 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.726 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.726 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.726 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "HAproxy container image", 2023-11-24T08:08:32.726 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_jaeger_agent": { 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_jaeger_agent", 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.727 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.728 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-24T08:08:32.728 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.728 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.728 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.728 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Jaeger agent container image", 2023-11-24T08:08:32.728 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.728 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_jaeger_collector": { 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_jaeger_collector", 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.729 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Jaeger collector container image", 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.731 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_jaeger_query": { 2023-11-24T08:08:32.731 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_jaeger_query", 2023-11-24T08:08:32.731 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.731 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.731 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.731 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-24T08:08:32.731 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Jaeger query container image", 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.732 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_keepalived": { 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_keepalived", 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.733 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.734 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Keepalived container image", 2023-11-24T08:08:32.734 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.734 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.734 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.734 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_loki": { 2023-11-24T08:08:32.734 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_loki", 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.735 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Loki container image", 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_node_exporter": { 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_node_exporter", 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.736 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.737 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.737 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-24T08:08:32.737 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.737 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.737 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.737 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:32.737 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_nvmeof": { 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_nvmeof", 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.738 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Nvme-of container image", 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.739 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.740 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_prometheus": { 2023-11-24T08:08:32.740 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_prometheus", 2023-11-24T08:08:32.740 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.740 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.740 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.740 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.742 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_promtail": { 2023-11-24T08:08:32.742 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_promtail", 2023-11-24T08:08:32.742 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.742 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.742 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.742 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Promtail container image", 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.744 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_snmp_gateway": { 2023-11-24T08:08:32.744 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_snmp_gateway", 2023-11-24T08:08:32.744 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.744 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.744 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.744 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-24T08:08:32.744 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.745 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.745 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.745 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SNMP Gateway container image", 2023-11-24T08:08:32.745 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.745 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.745 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: "container_init": { 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_init", 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.746 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.747 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.747 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.747 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Run podman/docker with `--init`", 2023-11-24T08:08:32.747 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.747 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.747 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.748 INFO:teuthology.orchestra.run.smithi097.stdout: "daemon_cache_timeout": { 2023-11-24T08:08:32.748 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "daemon_cache_timeout", 2023-11-24T08:08:32.748 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.748 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.748 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.748 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:32.749 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.749 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.749 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.749 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-24T08:08:32.749 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.749 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.750 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.750 INFO:teuthology.orchestra.run.smithi097.stdout: "default_cephadm_command_timeout": { 2023-11-24T08:08:32.750 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "default_cephadm_command_timeout", 2023-11-24T08:08:32.750 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.750 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.750 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.751 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "900", 2023-11-24T08:08:32.751 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.751 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.751 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.751 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-24T08:08:32.751 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.751 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: "default_registry": { 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "default_registry", 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.752 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io", 2023-11-24T08:08:32.753 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.753 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.753 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.753 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-24T08:08:32.753 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.753 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.753 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: "device_cache_timeout": { 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "device_cache_timeout", 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "1800", 2023-11-24T08:08:32.754 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.755 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.755 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.755 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "seconds to cache device inventory", 2023-11-24T08:08:32.755 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.755 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.755 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.756 INFO:teuthology.orchestra.run.smithi097.stdout: "device_enhanced_scan": { 2023-11-24T08:08:32.756 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "device_enhanced_scan", 2023-11-24T08:08:32.756 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.756 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.756 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.756 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "facts_cache_timeout": { 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "facts_cache_timeout", 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.758 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "seconds to cache host facts data", 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: "host_check_interval": { 2023-11-24T08:08:32.759 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "host_check_interval", 2023-11-24T08:08:32.760 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.760 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.760 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.760 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:32.760 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.760 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.760 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.761 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to perform a host check", 2023-11-24T08:08:32.761 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.761 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.761 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.761 INFO:teuthology.orchestra.run.smithi097.stdout: "inventory_list_all": { 2023-11-24T08:08:32.761 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "inventory_list_all", 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.762 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.763 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.764 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.764 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.764 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.764 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.764 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.764 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.764 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.765 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.766 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.766 INFO:teuthology.orchestra.run.smithi097.stdout: "log_refresh_metadata": { 2023-11-24T08:08:32.766 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_refresh_metadata", 2023-11-24T08:08:32.766 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.766 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.766 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.767 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.769 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.769 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.769 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-24T08:08:32.769 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.769 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.769 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.770 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.771 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.771 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.771 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.771 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.771 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.771 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.771 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.772 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.772 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.772 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.772 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.772 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.772 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:32.773 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:32.773 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.773 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.773 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.773 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.773 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.773 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-24T08:08:32.774 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-24T08:08:32.775 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.775 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.775 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.775 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.775 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.775 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.775 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.776 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-24T08:08:32.776 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.776 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.776 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.776 INFO:teuthology.orchestra.run.smithi097.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-24T08:08:32.776 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "*", 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.777 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-24T08:08:32.778 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.778 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.778 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.778 INFO:teuthology.orchestra.run.smithi097.stdout: "max_count_per_host": { 2023-11-24T08:08:32.778 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_count_per_host", 2023-11-24T08:08:32.778 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.779 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.779 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.779 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:32.779 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.779 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.779 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.779 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "max number of daemons per service per host", 2023-11-24T08:08:32.780 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.780 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.780 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.780 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd_draining_count": { 2023-11-24T08:08:32.780 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_osd_draining_count", 2023-11-24T08:08:32.780 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-24T08:08:32.781 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.782 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.782 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.782 INFO:teuthology.orchestra.run.smithi097.stdout: "migration_current": { 2023-11-24T08:08:32.782 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "migration_current", 2023-11-24T08:08:32.782 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.782 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "internal - do not modify", 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.783 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.784 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.784 INFO:teuthology.orchestra.run.smithi097.stdout: "mode": { 2023-11-24T08:08:32.784 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mode", 2023-11-24T08:08:32.784 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.784 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.784 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.785 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "root", 2023-11-24T08:08:32.785 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.785 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.785 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.785 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm-package", 2023-11-24T08:08:32.785 INFO:teuthology.orchestra.run.smithi097.stdout: "root" 2023-11-24T08:08:32.785 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.786 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "mode for remote execution of cephadm", 2023-11-24T08:08:32.786 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.786 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.786 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.786 INFO:teuthology.orchestra.run.smithi097.stdout: "prometheus_alerts_path": { 2023-11-24T08:08:32.786 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "prometheus_alerts_path", 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.787 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-24T08:08:32.788 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.788 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.788 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.788 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_insecure": { 2023-11-24T08:08:32.788 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_insecure", 2023-11-24T08:08:32.788 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.789 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.789 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.789 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.789 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.789 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.789 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.789 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_password": { 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_password", 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.790 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-24T08:08:32.791 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_url": { 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_url", 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.792 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.793 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.794 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_username": { 2023-11-24T08:08:32.794 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_username", 2023-11-24T08:08:32.794 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.794 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.794 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.794 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "secure_monitoring_stack": { 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "secure_monitoring_stack", 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.796 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.797 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.797 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-24T08:08:32.797 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.797 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.797 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.797 INFO:teuthology.orchestra.run.smithi097.stdout: "service_discovery_port": { 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "service_discovery_port", 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8765", 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.798 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.799 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "cephadm service discovery port", 2023-11-24T08:08:32.799 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.799 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.799 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.799 INFO:teuthology.orchestra.run.smithi097.stdout: "ssh_config_file": { 2023-11-24T08:08:32.799 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssh_config_file", 2023-11-24T08:08:32.800 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.800 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.800 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.800 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.800 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.800 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.800 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: "use_agent": { 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "use_agent", 2023-11-24T08:08:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.802 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.802 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.802 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.802 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.802 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.802 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: "use_repo_digest": { 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "use_repo_digest", 2023-11-24T08:08:32.803 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.804 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.804 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.804 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.804 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.804 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.804 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_on_failed_host_check": { 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_on_failed_host_check", 2023-11-24T08:08:32.805 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise a health warning if the host check fails", 2023-11-24T08:08:32.806 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.807 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.807 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.807 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_on_stray_daemons": { 2023-11-24T08:08:32.807 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_on_stray_daemons", 2023-11-24T08:08:32.807 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.807 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.808 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.809 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.809 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_on_stray_hosts": { 2023-11-24T08:08:32.809 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_on_stray_hosts", 2023-11-24T08:08:32.809 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.809 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.809 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.810 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crash", 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:32.811 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.812 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.813 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.814 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.814 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.814 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.814 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.814 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.814 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.815 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.816 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.817 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.818 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.819 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:32.819 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:32.819 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.819 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.819 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.819 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.820 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.820 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.820 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.820 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.820 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.820 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.820 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: "retain_interval": { 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "retain_interval", 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "31536000", 2023-11-24T08:08:32.821 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.822 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.822 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.822 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-24T08:08:32.822 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.822 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.822 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_recent_interval": { 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_recent_interval", 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "1209600", 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.823 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.825 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "dashboard", 2023-11-24T08:08:32.825 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:32.825 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:32.825 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.825 INFO:teuthology.orchestra.run.smithi097.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-24T08:08:32.825 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-24T08:08:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: "ALERTMANAGER_API_HOST": { 2023-11-24T08:08:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-24T08:08:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-24T08:08:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: "AUDIT_API_ENABLED": { 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "AUDIT_API_ENABLED", 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: "ENABLE_BROWSABLE_API": { 2023-11-24T08:08:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-24T08:08:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-24T08:08:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-24T08:08:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.839 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.840 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.840 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.840 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.840 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.840 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-24T08:08:32.840 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.841 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.842 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.843 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.844 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.844 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-24T08:08:32.844 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-24T08:08:32.844 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.844 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.844 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.845 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.846 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-24T08:08:32.846 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-24T08:08:32.846 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.846 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.846 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.846 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.848 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-24T08:08:32.849 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-24T08:08:32.850 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.850 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.850 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.850 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.850 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.850 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.850 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_PASSWORD": { 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-24T08:08:32.851 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "admin", 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-24T08:08:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-24T08:08:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_URL": { 2023-11-24T08:08:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_URL", 2023-11-24T08:08:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_USERNAME": { 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "admin", 2023-11-24T08:08:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-24T08:08:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-24T08:08:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-24T08:08:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-24T08:08:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-24T08:08:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "PROMETHEUS_API_HOST": { 2023-11-24T08:08:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-24T08:08:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-24T08:08:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-24T08:08:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-24T08:08:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-24T08:08:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-24T08:08:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-24T08:08:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_ENABLED": { 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-24T08:08:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-24T08:08:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-24T08:08:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-24T08:08:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8", 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-24T08:08:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "45", 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_ACCESS_KEY": { 2023-11-24T08:08:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-24T08:08:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "admin", 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_SECRET_KEY": { 2023-11-24T08:08:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-24T08:08:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_SSL_VERIFY": { 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "UNSAFE_TLS_v1_2": { 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-24T08:08:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-24T08:08:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-24T08:08:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-24T08:08:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "cross_origin_url": { 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cross_origin_url", 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "crt_file": { 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crt_file", 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "debug": { 2023-11-24T08:08:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "debug", 2023-11-24T08:08:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Enable/disable debug options", 2023-11-24T08:08:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "jwt_token_ttl": { 2023-11-24T08:08:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "jwt_token_ttl", 2023-11-24T08:08:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "28800", 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "key_file": { 2023-11-24T08:08:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "key_file", 2023-11-24T08:08:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "motd": { 2023-11-24T08:08:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "motd", 2023-11-24T08:08:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "The message of the day", 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "redirect_resolve_ip_addr": { 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "redirect_resolve_ip_addr", 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "server_addr": { 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_addr", 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "::", 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "server_port": { 2023-11-24T08:08:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_port", 2023-11-24T08:08:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8080", 2023-11-24T08:08:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "ssl": { 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssl", 2023-11-24T08:08:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "ssl_server_port": { 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssl_server_port", 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8443", 2023-11-24T08:08:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_behaviour": { 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_behaviour", 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "redirect", 2023-11-24T08:08:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "redirect" 2023-11-24T08:08:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_error_status_code": { 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_error_status_code", 2023-11-24T08:08:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "500", 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "400", 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "599", 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "url_prefix": { 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "url_prefix", 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "devicehealth", 2023-11-24T08:08:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "enable_monitoring": { 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enable_monitoring", 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "monitor device health metrics", 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "mark_out_threshold": { 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mark_out_threshold", 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "2419200", 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-24T08:08:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": { 2023-11-24T08:08:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pool_name", 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "device_health_metrics", 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "retention_period": { 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "retention_period", 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "15552000", 2023-11-24T08:08:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how long to retain device health metrics", 2023-11-24T08:08:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "scrape_frequency": { 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "scrape_frequency", 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "86400", 2023-11-24T08:08:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-24T08:08:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "self_heal": { 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "self_heal", 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to wake up and check device health", 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_threshold": { 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_threshold", 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "7257600", 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "diskprediction_local", 2023-11-24T08:08:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.975 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.976 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:32.977 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.978 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "predict_interval": { 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "predict_interval", 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.979 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "86400", 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.980 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "predictor_model": { 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "predictor_model", 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.981 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "prophetstor", 2023-11-24T08:08:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.982 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:32.983 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "influx", 2023-11-24T08:08:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": false, 2023-11-24T08:08:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "influxdb python module not found", 2023-11-24T08:08:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:32.985 INFO:teuthology.orchestra.run.smithi097.stdout: "batch_size": { 2023-11-24T08:08:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "batch_size", 2023-11-24T08:08:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5000", 2023-11-24T08:08:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.986 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "database": { 2023-11-24T08:08:32.987 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "database", 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "ceph", 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.988 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-24T08:08:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": { 2023-11-24T08:08:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "hostname", 2023-11-24T08:08:32.989 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "InfluxDB server hostname", 2023-11-24T08:08:32.990 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.991 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "30", 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "5", 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.992 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.993 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:32.994 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.997 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:32.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:32.999 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.000 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.001 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.002 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.003 INFO:teuthology.orchestra.run.smithi097.stdout: "password": { 2023-11-24T08:08:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "password", 2023-11-24T08:08:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.004 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "password of InfluxDB server user", 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "port": { 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "port", 2023-11-24T08:08:33.005 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8086", 2023-11-24T08:08:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.006 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "InfluxDB server port", 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "ssl": { 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssl", 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.007 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "false", 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.008 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: "threads": { 2023-11-24T08:08:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "threads", 2023-11-24T08:08:33.009 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "32", 2023-11-24T08:08:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.010 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "username": { 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "username", 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.011 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "username of InfluxDB server user", 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.012 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "verify_ssl": { 2023-11-24T08:08:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "verify_ssl", 2023-11-24T08:08:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.013 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "true", 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.014 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "insights", 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.015 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.016 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.017 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.018 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.019 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.020 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.021 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.022 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.023 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.024 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "iostat", 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.025 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.026 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.027 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.028 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.029 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.030 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.031 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.032 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.033 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.034 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "localpool", 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: "failure_domain": { 2023-11-24T08:08:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "failure_domain", 2023-11-24T08:08:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "host", 2023-11-24T08:08:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.036 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "failure domain for any created local pool", 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.037 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.038 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.039 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.040 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.041 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.042 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.043 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.044 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.045 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": { 2023-11-24T08:08:33.046 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "min_size", 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.047 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "default min_size for any created local pool", 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "num_rep": { 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "num_rep", 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.048 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "3", 2023-11-24T08:08:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "default replica count for any created local pool", 2023-11-24T08:08:33.049 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": { 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pg_num", 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.050 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "128", 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "default pg_num for any created local pool", 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.051 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "prefix": { 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "prefix", 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.052 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "name prefix for any created local pool", 2023-11-24T08:08:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "subtree": { 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "subtree", 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "rack", 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.054 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mds_autoscaler", 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.056 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.057 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.058 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.059 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.060 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.061 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.062 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.063 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.064 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.065 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mirroring", 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.066 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.067 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.069 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.071 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.072 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.073 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.074 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "nfs", 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.076 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.077 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.078 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.079 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.080 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.081 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.082 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.083 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.084 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "orchestrator", 2023-11-24T08:08:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "fail_fs": { 2023-11-24T08:08:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "fail_fs", 2023-11-24T08:08:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-24T08:08:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "orchestrator": { 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "orchestrator", 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm", 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "rook", 2023-11-24T08:08:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: "test_orchestrator" 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Orchestrator backend", 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "osd_perf_query", 2023-11-24T08:08:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "osd_support", 2023-11-24T08:08:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.116 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.117 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.118 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pg_autoscaler", 2023-11-24T08:08:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.120 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.121 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.122 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.123 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.124 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.125 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.126 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.128 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:33.129 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.130 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "threshold": { 2023-11-24T08:08:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "threshold", 2023-11-24T08:08:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.131 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "3.0", 2023-11-24T08:08:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1.0", 2023-11-24T08:08:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "scaling threshold", 2023-11-24T08:08:33.132 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "progress", 2023-11-24T08:08:33.133 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "allow_pg_recovery_event": { 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "allow_pg_recovery_event", 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": { 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enabled", 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.136 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.137 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.138 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.139 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.140 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.141 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.142 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.143 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.145 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.146 INFO:teuthology.orchestra.run.smithi097.stdout: "max_completed_events": { 2023-11-24T08:08:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_completed_events", 2023-11-24T08:08:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "50", 2023-11-24T08:08:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.147 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "number of past completed events to remember", 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:33.148 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.149 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how long the module is going to sleep", 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "prometheus", 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "cache": { 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cache", 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.151 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.152 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "exclude_perf_counters": { 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "exclude_perf_counters", 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.153 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-24T08:08:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-24T08:08:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.154 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.155 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.156 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.157 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.158 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.159 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.160 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.161 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.162 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.163 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_stats_pools": { 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rbd_stats_pools", 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.164 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.165 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-24T08:08:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-24T08:08:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "300", 2023-11-24T08:08:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.166 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "scrape_interval": { 2023-11-24T08:08:33.167 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "scrape_interval", 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "15.0", 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "server_addr": { 2023-11-24T08:08:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_addr", 2023-11-24T08:08:33.169 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "::", 2023-11-24T08:08:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.170 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "server_port": { 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_port", 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.171 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "9283", 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.172 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "stale_cache_strategy": { 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "stale_cache_strategy", 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.173 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "log", 2023-11-24T08:08:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.174 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_behaviour": { 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_behaviour", 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "default", 2023-11-24T08:08:33.175 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "default", 2023-11-24T08:08:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "error" 2023-11-24T08:08:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.176 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_error_status_code": { 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_error_status_code", 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.177 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "500", 2023-11-24T08:08:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "400", 2023-11-24T08:08:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "599", 2023-11-24T08:08:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.178 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rbd_support", 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.179 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.180 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.181 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.182 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.183 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.184 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.185 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.186 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.187 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.188 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "max_concurrent_snap_create": { 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_concurrent_snap_create", 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.189 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "mirror_snapshot_schedule": { 2023-11-24T08:08:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mirror_snapshot_schedule", 2023-11-24T08:08:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.191 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.192 INFO:teuthology.orchestra.run.smithi097.stdout: "trash_purge_schedule": { 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "trash_purge_schedule", 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.193 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "restful", 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "enable_auth": { 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enable_auth", 2023-11-24T08:08:33.195 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.196 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "key_file": { 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "key_file", 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.197 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.198 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.199 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.200 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.202 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.203 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.204 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.205 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.206 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.207 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "server_addr": { 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_addr", 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.208 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.209 INFO:teuthology.orchestra.run.smithi097.stdout: "server_port": { 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_port", 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.210 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rgw", 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.212 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.213 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.214 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.215 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.216 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.217 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.218 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.219 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.220 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rook", 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "drive_group_interval": { 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "drive_group_interval", 2023-11-24T08:08:33.222 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "300.0", 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-11-24T08:08:33.223 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.224 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.225 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.226 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.227 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.228 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.229 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.230 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.231 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.232 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "storage_class": { 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "storage_class", 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.233 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "local", 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.234 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "selftest", 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.235 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.236 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.237 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.238 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.239 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.240 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.241 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.242 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.243 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.244 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "roption1": { 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "roption1", 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.245 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.246 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "roption2": { 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "roption2", 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.247 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "xyz", 2023-11-24T08:08:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.248 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption1": { 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption1", 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.249 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption2": { 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption2", 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.251 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption3": { 2023-11-24T08:08:33.252 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption3", 2023-11-24T08:08:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.253 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption4": { 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption4", 2023-11-24T08:08:33.254 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.255 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption5": { 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption5", 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.257 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption6": { 2023-11-24T08:08:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption6", 2023-11-24T08:08:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.258 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.259 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption7": { 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption7", 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.260 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "42", 2023-11-24T08:08:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.261 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "testkey": { 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "testkey", 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.262 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "testlkey": { 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "testlkey", 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.265 INFO:teuthology.orchestra.run.smithi097.stdout: "testnewline": { 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "testnewline", 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.266 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "snap_schedule", 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "allow_m_granularity": { 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "allow_m_granularity", 2023-11-24T08:08:33.268 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.269 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "allow minute scheduled snapshots", 2023-11-24T08:08:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "dump_on_update": { 2023-11-24T08:08:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "dump_on_update", 2023-11-24T08:08:33.270 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "dump database to debug log on update", 2023-11-24T08:08:33.271 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.272 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.273 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.274 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.275 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.276 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.277 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.278 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.279 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.280 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "stats", 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.282 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.283 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.284 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.285 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.286 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.287 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.288 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.289 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.290 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.291 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.293 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "status", 2023-11-24T08:08:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.294 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.299 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.300 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.301 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.302 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "telegraf", 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "address": { 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "address", 2023-11-24T08:08:33.304 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-24T08:08:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.305 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.306 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "15", 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.307 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.308 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.309 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.310 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.311 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.313 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.314 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.315 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.316 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "telemetry", 2023-11-24T08:08:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_basic": { 2023-11-24T08:08:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_basic", 2023-11-24T08:08:33.318 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.319 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_crash": { 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_crash", 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.320 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-24T08:08:33.321 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_device": { 2023-11-24T08:08:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_device", 2023-11-24T08:08:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.322 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-24T08:08:33.323 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_ident": { 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_ident", 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.324 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.325 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_perf": { 2023-11-24T08:08:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_perf", 2023-11-24T08:08:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.326 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "contact": { 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "contact", 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.328 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "description": { 2023-11-24T08:08:33.329 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "description", 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.330 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "device_url": { 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "device_url", 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.331 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.332 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": { 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enabled", 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.333 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.334 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "24", 2023-11-24T08:08:33.335 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "8", 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.336 INFO:teuthology.orchestra.run.smithi097.stdout: "last_opt_revision": { 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "last_opt_revision", 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "1", 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.337 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "leaderboard": { 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "leaderboard", 2023-11-24T08:08:33.338 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.339 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "leaderboard_description": { 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "leaderboard_description", 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.340 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.341 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.342 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.343 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.344 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.345 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.346 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.347 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.348 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.349 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.350 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "organization": { 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "organization", 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.351 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.352 INFO:teuthology.orchestra.run.smithi097.stdout: "proxy": { 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "proxy", 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.353 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "url": { 2023-11-24T08:08:33.354 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "url", 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.355 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.356 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "test_orchestrator", 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.357 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.358 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.360 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.361 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.362 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.363 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.364 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.365 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "volumes", 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.366 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.367 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.370 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.371 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.372 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.372 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.372 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.372 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.373 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.375 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.376 INFO:teuthology.orchestra.run.smithi097.stdout: "max_concurrent_clones": { 2023-11-24T08:08:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_concurrent_clones", 2023-11-24T08:08:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "4", 2023-11-24T08:08:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.377 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-24T08:08:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.378 INFO:teuthology.orchestra.run.smithi097.stdout: "periodic_async_work": { 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "periodic_async_work", 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.379 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Periodically check for async work", 2023-11-24T08:08:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.380 INFO:teuthology.orchestra.run.smithi097.stdout: "snapshot_clone_delay": { 2023-11-24T08:08:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "snapshot_clone_delay", 2023-11-24T08:08:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.381 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix", 2023-11-24T08:08:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "discovery_interval": { 2023-11-24T08:08:33.383 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "discovery_interval", 2023-11-24T08:08:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "100", 2023-11-24T08:08:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.384 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "identifier": { 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "identifier", 2023-11-24T08:08:33.385 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.386 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.387 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.388 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.389 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.390 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.391 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.392 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.393 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.394 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.394 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.394 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.394 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.394 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.394 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.395 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.395 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.395 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.395 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.395 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.395 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.395 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.396 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.398 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.398 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.398 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.398 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.398 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.398 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.398 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: "zabbix_host": { 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix_host", 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.399 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.400 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.400 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.400 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.400 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.400 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.400 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.400 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: "zabbix_port": { 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix_port", 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10051", 2023-11-24T08:08:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: "zabbix_sender": { 2023-11-24T08:08:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix_sender", 2023-11-24T08:08:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-24T08:08:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.404 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.404 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.404 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.404 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.404 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.404 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.404 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: "modules": [ 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: "iostat", 2023-11-24T08:08:33.405 INFO:teuthology.orchestra.run.smithi097.stdout: "nfs", 2023-11-24T08:08:33.406 INFO:teuthology.orchestra.run.smithi097.stdout: "restful" 2023-11-24T08:08:33.406 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.406 INFO:teuthology.orchestra.run.smithi097.stdout: "available_modules": [ 2023-11-24T08:08:33.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.406 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "alerts", 2023-11-24T08:08:33.406 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.406 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.407 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.407 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:33.407 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:33.407 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.407 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.407 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.407 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How frequently to reexamine health status", 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.409 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.409 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.409 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.409 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.409 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.409 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.409 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.410 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.410 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.410 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.410 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.410 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.410 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.410 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.411 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.412 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.412 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.412 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.412 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.412 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.412 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.412 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.413 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.413 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.413 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.413 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.413 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.413 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.414 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.414 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.414 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.414 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.414 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.414 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.414 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.415 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.416 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.416 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.416 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.416 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.416 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.416 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.417 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.418 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.418 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.418 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.418 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_destination": { 2023-11-24T08:08:33.418 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_destination", 2023-11-24T08:08:33.418 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Email address to send alerts to", 2023-11-24T08:08:33.419 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.420 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.420 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.420 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_from_name": { 2023-11-24T08:08:33.420 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_from_name", 2023-11-24T08:08:33.420 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.420 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "Ceph", 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Email From: name", 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.421 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.422 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.422 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_host": { 2023-11-24T08:08:33.422 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_host", 2023-11-24T08:08:33.422 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.422 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.422 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SMTP server", 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.423 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_password": { 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_password", 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.424 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.425 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.425 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.425 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Password to authenticate with", 2023-11-24T08:08:33.425 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.425 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.425 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_port": { 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_port", 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "465", 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.426 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.427 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.427 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SMTP port", 2023-11-24T08:08:33.427 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.427 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.427 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.427 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_sender": { 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_sender", 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.428 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.429 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SMTP envelope sender", 2023-11-24T08:08:33.429 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.429 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.429 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.429 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_ssl": { 2023-11-24T08:08:33.429 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_ssl", 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.430 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-24T08:08:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: "smtp_user": { 2023-11-24T08:08:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "smtp_user", 2023-11-24T08:08:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "User to authenticate as", 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "balancer", 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "active": { 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "active", 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "automatically balance PGs across cluster", 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "begin_time": { 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "begin_time", 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0000", 2023-11-24T08:08:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "beginning time of day to automatically balance", 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "begin_weekday": { 2023-11-24T08:08:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "begin_weekday", 2023-11-24T08:08:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "0", 2023-11-24T08:08:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "6", 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_compat_max_iterations": { 2023-11-24T08:08:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crush_compat_max_iterations", 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "25", 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "250", 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_compat_metrics": { 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crush_compat_metrics", 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "pgs,objects,bytes", 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-24T08:08:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_compat_step": { 2023-11-24T08:08:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crush_compat_step", 2023-11-24T08:08:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0.5", 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "0.001", 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "0.999", 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "aggressiveness of optimization", 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "end_time": { 2023-11-24T08:08:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "end_time", 2023-11-24T08:08:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "2359", 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "ending time of day to automatically balance", 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "end_weekday": { 2023-11-24T08:08:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "end_weekday", 2023-11-24T08:08:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "0", 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "6", 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "min_score": { 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "min_score", 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-24T08:08:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "mode": { 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mode", 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "upmap", 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-compat", 2023-11-24T08:08:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "none", 2023-11-24T08:08:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "upmap" 2023-11-24T08:08:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Balancer mode", 2023-11-24T08:08:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_ids": { 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pool_ids", 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-24T08:08:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-24T08:08:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "upmap_max_deviation": { 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "upmap_max_deviation", 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-24T08:08:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-24T08:08:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "upmap_max_optimizations": { 2023-11-24T08:08:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "upmap_max_optimizations", 2023-11-24T08:08:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cephadm", 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "agent_down_multiplier": { 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "agent_down_multiplier", 2023-11-24T08:08:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "3.0", 2023-11-24T08:08:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "agent_refresh_rate": { 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "agent_refresh_rate", 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "20", 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "agent_starting_port": { 2023-11-24T08:08:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "agent_starting_port", 2023-11-24T08:08:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "4721", 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "allow_ptrace": { 2023-11-24T08:08:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "allow_ptrace", 2023-11-24T08:08:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "autotune_interval": { 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "autotune_interval", 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-24T08:08:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "autotune_memory_target_ratio": { 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "autotune_memory_target_ratio", 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0.7", 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm_log_destination": { 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cephadm_log_destination", 2023-11-24T08:08:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "file", 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "file,syslog", 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "syslog" 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "cgroups_split": { 2023-11-24T08:08:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cgroups_split", 2023-11-24T08:08:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "config_checks_enabled": { 2023-11-24T08:08:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "config_checks_enabled", 2023-11-24T08:08:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "config_dashboard": { 2023-11-24T08:08:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "config_dashboard", 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-24T08:08:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_alertmanager": { 2023-11-24T08:08:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_alertmanager", 2023-11-24T08:08:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_base": { 2023-11-24T08:08:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_base", 2023-11-24T08:08:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Container image name, without the tag", 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_elasticsearch": { 2023-11-24T08:08:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_elasticsearch", 2023-11-24T08:08:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "elasticsearch container image", 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_grafana": { 2023-11-24T08:08:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_grafana", 2023-11-24T08:08:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-24T08:08:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_haproxy": { 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_haproxy", 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "HAproxy container image", 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_jaeger_agent": { 2023-11-24T08:08:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_jaeger_agent", 2023-11-24T08:08:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-24T08:08:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Jaeger agent container image", 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_jaeger_collector": { 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_jaeger_collector", 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Jaeger collector container image", 2023-11-24T08:08:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_jaeger_query": { 2023-11-24T08:08:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_jaeger_query", 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Jaeger query container image", 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_keepalived": { 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_keepalived", 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-24T08:08:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Keepalived container image", 2023-11-24T08:08:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_loki": { 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_loki", 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-24T08:08:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Loki container image", 2023-11-24T08:08:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_node_exporter": { 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_node_exporter", 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-24T08:08:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_nvmeof": { 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_nvmeof", 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-11-24T08:08:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Nvme-of container image", 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_prometheus": { 2023-11-24T08:08:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_prometheus", 2023-11-24T08:08:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-24T08:08:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Prometheus container image", 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_promtail": { 2023-11-24T08:08:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_promtail", 2023-11-24T08:08:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-24T08:08:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Promtail container image", 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image_snmp_gateway": { 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_image_snmp_gateway", 2023-11-24T08:08:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "SNMP Gateway container image", 2023-11-24T08:08:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "container_init": { 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "container_init", 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Run podman/docker with `--init`", 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "daemon_cache_timeout": { 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "daemon_cache_timeout", 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-24T08:08:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "default_cephadm_command_timeout": { 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "default_cephadm_command_timeout", 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "900", 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "default_registry": { 2023-11-24T08:08:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "default_registry", 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "docker.io", 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-24T08:08:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "device_cache_timeout": { 2023-11-24T08:08:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "device_cache_timeout", 2023-11-24T08:08:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "1800", 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "seconds to cache device inventory", 2023-11-24T08:08:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "device_enhanced_scan": { 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "device_enhanced_scan", 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-24T08:08:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "facts_cache_timeout": { 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "facts_cache_timeout", 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "seconds to cache host facts data", 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "host_check_interval": { 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "host_check_interval", 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to perform a host check", 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "inventory_list_all": { 2023-11-24T08:08:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "inventory_list_all", 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-24T08:08:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "log_refresh_metadata": { 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_refresh_metadata", 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "*", 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "max_count_per_host": { 2023-11-24T08:08:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_count_per_host", 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "max number of daemons per service per host", 2023-11-24T08:08:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd_draining_count": { 2023-11-24T08:08:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_osd_draining_count", 2023-11-24T08:08:33.550 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-24T08:08:33.551 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "migration_current": { 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "migration_current", 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "internal - do not modify", 2023-11-24T08:08:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "mode": { 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mode", 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "root", 2023-11-24T08:08:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm-package", 2023-11-24T08:08:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "root" 2023-11-24T08:08:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "mode for remote execution of cephadm", 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "prometheus_alerts_path": { 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "prometheus_alerts_path", 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-24T08:08:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-24T08:08:33.557 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_insecure": { 2023-11-24T08:08:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_insecure", 2023-11-24T08:08:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.558 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.559 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_password": { 2023-11-24T08:08:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_password", 2023-11-24T08:08:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.560 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-24T08:08:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.561 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_url": { 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_url", 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.562 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-24T08:08:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.563 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "registry_username": { 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "registry_username", 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.564 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-24T08:08:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "secure_monitoring_stack": { 2023-11-24T08:08:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "secure_monitoring_stack", 2023-11-24T08:08:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.566 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.567 INFO:teuthology.orchestra.run.smithi097.stdout: "service_discovery_port": { 2023-11-24T08:08:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "service_discovery_port", 2023-11-24T08:08:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8765", 2023-11-24T08:08:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "cephadm service discovery port", 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "ssh_config_file": { 2023-11-24T08:08:33.569 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssh_config_file", 2023-11-24T08:08:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.570 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-24T08:08:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "use_agent": { 2023-11-24T08:08:33.571 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "use_agent", 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.572 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-24T08:08:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "use_repo_digest": { 2023-11-24T08:08:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "use_repo_digest", 2023-11-24T08:08:33.573 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-24T08:08:33.574 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_on_failed_host_check": { 2023-11-24T08:08:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_on_failed_host_check", 2023-11-24T08:08:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.575 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise a health warning if the host check fails", 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.576 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_on_stray_daemons": { 2023-11-24T08:08:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_on_stray_daemons", 2023-11-24T08:08:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.577 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.578 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_on_stray_hosts": { 2023-11-24T08:08:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_on_stray_hosts", 2023-11-24T08:08:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.579 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.580 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crash", 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.581 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.582 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.583 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.584 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.585 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.586 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.587 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.588 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.590 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "retain_interval": { 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "retain_interval", 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.591 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "31536000", 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_recent_interval": { 2023-11-24T08:08:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_recent_interval", 2023-11-24T08:08:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "1209600", 2023-11-24T08:08:33.593 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "dashboard", 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-24T08:08:33.595 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-24T08:08:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.596 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "ALERTMANAGER_API_HOST": { 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-24T08:08:33.597 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.598 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-24T08:08:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-24T08:08:33.599 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.600 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "AUDIT_API_ENABLED": { 2023-11-24T08:08:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "AUDIT_API_ENABLED", 2023-11-24T08:08:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.601 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.602 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.603 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "ENABLE_BROWSABLE_API": { 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.605 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.607 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-24T08:08:33.608 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-24T08:08:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.609 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-24T08:08:33.610 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.611 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.612 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.613 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.614 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.615 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.616 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.617 INFO:teuthology.orchestra.run.smithi097.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.618 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-24T08:08:33.619 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.620 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_PASSWORD": { 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.621 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "admin", 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.622 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-24T08:08:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-24T08:08:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.623 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_URL": { 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_URL", 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.625 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_API_USERNAME": { 2023-11-24T08:08:33.626 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "admin", 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.627 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.628 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.629 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-24T08:08:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-24T08:08:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.630 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.631 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.632 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.634 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.635 INFO:teuthology.orchestra.run.smithi097.stdout: "PROMETHEUS_API_HOST": { 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.636 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-24T08:08:33.637 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.638 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.639 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.640 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.641 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.642 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.643 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-24T08:08:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-24T08:08:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.645 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.646 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-24T08:08:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-24T08:08:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.647 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-24T08:08:33.648 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.649 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-24T08:08:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-24T08:08:33.650 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.651 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_ENABLED": { 2023-11-24T08:08:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-24T08:08:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.652 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.653 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-24T08:08:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-24T08:08:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.654 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-24T08:08:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.655 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.656 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8", 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.658 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-24T08:08:33.659 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "45", 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.660 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_ACCESS_KEY": { 2023-11-24T08:08:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-24T08:08:33.661 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.662 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.663 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "admin", 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.664 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_SECRET_KEY": { 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.665 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.666 INFO:teuthology.orchestra.run.smithi097.stdout: "RGW_API_SSL_VERIFY": { 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.667 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "UNSAFE_TLS_v1_2": { 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-24T08:08:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.670 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.671 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.672 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-24T08:08:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-24T08:08:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.674 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.675 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "cross_origin_url": { 2023-11-24T08:08:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cross_origin_url", 2023-11-24T08:08:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.676 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.677 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "crt_file": { 2023-11-24T08:08:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "crt_file", 2023-11-24T08:08:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.678 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.679 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "debug": { 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "debug", 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.680 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Enable/disable debug options", 2023-11-24T08:08:33.681 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: "jwt_token_ttl": { 2023-11-24T08:08:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "jwt_token_ttl", 2023-11-24T08:08:33.682 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "28800", 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.683 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "key_file": { 2023-11-24T08:08:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "key_file", 2023-11-24T08:08:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.684 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.685 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.686 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.687 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.688 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.689 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.690 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.691 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.692 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.693 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.695 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.696 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "motd": { 2023-11-24T08:08:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "motd", 2023-11-24T08:08:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.697 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "The message of the day", 2023-11-24T08:08:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.698 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "redirect_resolve_ip_addr": { 2023-11-24T08:08:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "redirect_resolve_ip_addr", 2023-11-24T08:08:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.699 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.700 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "server_addr": { 2023-11-24T08:08:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_addr", 2023-11-24T08:08:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "::", 2023-11-24T08:08:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.702 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "server_port": { 2023-11-24T08:08:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_port", 2023-11-24T08:08:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.706 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8080", 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "ssl": { 2023-11-24T08:08:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssl", 2023-11-24T08:08:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.708 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.709 INFO:teuthology.orchestra.run.smithi097.stdout: "ssl_server_port": { 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssl_server_port", 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8443", 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.710 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_behaviour": { 2023-11-24T08:08:33.711 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_behaviour", 2023-11-24T08:08:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "redirect", 2023-11-24T08:08:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.712 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "redirect" 2023-11-24T08:08:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.713 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_error_status_code": { 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_error_status_code", 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "500", 2023-11-24T08:08:33.714 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "400", 2023-11-24T08:08:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "599", 2023-11-24T08:08:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "url_prefix": { 2023-11-24T08:08:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "url_prefix", 2023-11-24T08:08:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.716 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.717 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "devicehealth", 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.718 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "enable_monitoring": { 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enable_monitoring", 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.719 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "monitor device health metrics", 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.720 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.721 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.722 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.723 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.724 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.725 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.726 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.728 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "mark_out_threshold": { 2023-11-24T08:08:33.729 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mark_out_threshold", 2023-11-24T08:08:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "2419200", 2023-11-24T08:08:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.730 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": { 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pool_name", 2023-11-24T08:08:33.731 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "device_health_metrics", 2023-11-24T08:08:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.732 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "retention_period": { 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "retention_period", 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.733 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "15552000", 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how long to retain device health metrics", 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.734 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "scrape_frequency": { 2023-11-24T08:08:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "scrape_frequency", 2023-11-24T08:08:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.735 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "86400", 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.736 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "self_heal": { 2023-11-24T08:08:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "self_heal", 2023-11-24T08:08:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.737 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:33.739 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how frequently to wake up and check device health", 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.740 INFO:teuthology.orchestra.run.smithi097.stdout: "warn_threshold": { 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "warn_threshold", 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "7257600", 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.741 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-24T08:08:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "diskprediction_local", 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.744 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.746 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.747 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.748 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.749 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.750 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.751 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.752 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "predict_interval": { 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "predict_interval", 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "86400", 2023-11-24T08:08:33.753 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.754 INFO:teuthology.orchestra.run.smithi097.stdout: "predictor_model": { 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "predictor_model", 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "prophetstor", 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.755 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:33.756 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "600", 2023-11-24T08:08:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.757 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.758 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "influx", 2023-11-24T08:08:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": false, 2023-11-24T08:08:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "influxdb python module not found", 2023-11-24T08:08:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "batch_size": { 2023-11-24T08:08:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "batch_size", 2023-11-24T08:08:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.759 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5000", 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.760 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "database": { 2023-11-24T08:08:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "database", 2023-11-24T08:08:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.761 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "ceph", 2023-11-24T08:08:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-24T08:08:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.762 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": { 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "hostname", 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.763 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "InfluxDB server hostname", 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "30", 2023-11-24T08:08:33.765 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "5", 2023-11-24T08:08:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-24T08:08:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.767 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.768 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.769 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.770 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.773 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.774 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.775 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "password": { 2023-11-24T08:08:33.776 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "password", 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.777 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "password of InfluxDB server user", 2023-11-24T08:08:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: "port": { 2023-11-24T08:08:33.778 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "port", 2023-11-24T08:08:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "8086", 2023-11-24T08:08:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.779 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "InfluxDB server port", 2023-11-24T08:08:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.780 INFO:teuthology.orchestra.run.smithi097.stdout: "ssl": { 2023-11-24T08:08:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "ssl", 2023-11-24T08:08:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "false", 2023-11-24T08:08:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.781 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T08:08:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.782 INFO:teuthology.orchestra.run.smithi097.stdout: "threads": { 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "threads", 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "32", 2023-11-24T08:08:33.783 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-24T08:08:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "username": { 2023-11-24T08:08:33.784 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "username", 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.785 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "username of InfluxDB server user", 2023-11-24T08:08:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "verify_ssl": { 2023-11-24T08:08:33.786 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "verify_ssl", 2023-11-24T08:08:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "true", 2023-11-24T08:08:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.787 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T08:08:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "insights", 2023-11-24T08:08:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.789 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.790 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.791 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.792 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.793 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.794 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.795 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.796 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.797 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.798 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "iostat", 2023-11-24T08:08:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.800 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.801 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.802 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.803 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.804 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.805 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.806 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.807 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.808 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.809 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "localpool", 2023-11-24T08:08:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.810 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "failure_domain": { 2023-11-24T08:08:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "failure_domain", 2023-11-24T08:08:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.811 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "host", 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "failure domain for any created local pool", 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.813 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.814 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.815 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.816 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.818 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.819 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.820 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.821 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.822 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": { 2023-11-24T08:08:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "min_size", 2023-11-24T08:08:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.823 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "default min_size for any created local pool", 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "num_rep": { 2023-11-24T08:08:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "num_rep", 2023-11-24T08:08:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "3", 2023-11-24T08:08:33.825 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "default replica count for any created local pool", 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.826 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": { 2023-11-24T08:08:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pg_num", 2023-11-24T08:08:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "128", 2023-11-24T08:08:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.827 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "default pg_num for any created local pool", 2023-11-24T08:08:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.828 INFO:teuthology.orchestra.run.smithi097.stdout: "prefix": { 2023-11-24T08:08:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "prefix", 2023-11-24T08:08:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.829 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "name prefix for any created local pool", 2023-11-24T08:08:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.830 INFO:teuthology.orchestra.run.smithi097.stdout: "subtree": { 2023-11-24T08:08:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "subtree", 2023-11-24T08:08:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "rack", 2023-11-24T08:08:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.831 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-24T08:08:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-24T08:08:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.832 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mds_autoscaler", 2023-11-24T08:08:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.833 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.834 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.835 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.836 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.837 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.838 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.839 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.840 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.841 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.842 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mirroring", 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.844 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.845 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.846 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.847 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.848 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.849 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.850 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.851 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.852 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "nfs", 2023-11-24T08:08:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.854 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.855 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.856 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.857 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.858 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.859 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.860 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.861 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.862 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.863 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "orchestrator", 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.864 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "fail_fs": { 2023-11-24T08:08:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "fail_fs", 2023-11-24T08:08:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.865 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-24T08:08:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.866 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.867 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.870 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.871 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.872 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.873 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.874 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.875 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "orchestrator": { 2023-11-24T08:08:33.876 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "orchestrator", 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.877 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm", 2023-11-24T08:08:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "rook", 2023-11-24T08:08:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "test_orchestrator" 2023-11-24T08:08:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Orchestrator backend", 2023-11-24T08:08:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.878 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "osd_perf_query", 2023-11-24T08:08:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.879 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.880 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.881 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.882 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.883 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.884 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.885 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.886 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.887 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.888 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "osd_support", 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.889 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.890 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.890 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.890 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.890 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.890 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.890 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.890 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.891 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.892 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.893 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.894 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.895 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.896 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.897 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.898 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "pg_autoscaler", 2023-11-24T08:08:33.899 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.900 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.901 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.903 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.905 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.906 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.907 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.909 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.910 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.911 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.912 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: "threshold": { 2023-11-24T08:08:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "threshold", 2023-11-24T08:08:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.913 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "3.0", 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1.0", 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "scaling threshold", 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-24T08:08:33.914 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "progress", 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.915 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "allow_pg_recovery_event": { 2023-11-24T08:08:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "allow_pg_recovery_event", 2023-11-24T08:08:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.916 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.917 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": { 2023-11-24T08:08:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enabled", 2023-11-24T08:08:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.918 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.919 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.920 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.921 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.922 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.923 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.924 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.925 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.926 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.927 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.928 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.929 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.930 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "max_completed_events": { 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_completed_events", 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.931 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "50", 2023-11-24T08:08:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "number of past completed events to remember", 2023-11-24T08:08:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.932 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: "sleep_interval": { 2023-11-24T08:08:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "sleep_interval", 2023-11-24T08:08:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:33.933 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "5", 2023-11-24T08:08:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "how long the module is going to sleep", 2023-11-24T08:08:33.934 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "prometheus", 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "cache": { 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "cache", 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.936 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.937 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: "exclude_perf_counters": { 2023-11-24T08:08:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "exclude_perf_counters", 2023-11-24T08:08:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.938 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.939 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.939 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.939 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.939 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.939 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.939 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-24T08:08:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-24T08:08:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.940 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.941 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.941 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.941 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.941 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.941 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.941 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.941 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.942 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.942 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.942 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.942 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.942 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.942 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.943 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.944 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.944 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.944 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.944 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.944 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.944 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.944 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.945 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.945 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.945 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.945 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.945 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.946 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.946 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.946 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.946 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.946 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.946 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.946 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.947 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.947 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.947 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.947 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.947 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.947 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.947 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.948 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.948 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.948 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.948 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.948 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.949 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.949 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.949 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.949 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.949 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.949 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.949 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_stats_pools": { 2023-11-24T08:08:33.950 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rbd_stats_pools", 2023-11-24T08:08:33.951 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.951 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.951 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.951 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.951 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.951 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.951 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.952 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.952 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.952 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.952 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.952 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-24T08:08:33.953 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-24T08:08:33.953 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.953 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.953 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.953 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "300", 2023-11-24T08:08:33.953 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.953 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.954 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.954 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.954 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.954 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.954 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "scrape_interval": { 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "scrape_interval", 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "15.0", 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.955 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.956 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.956 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.956 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.956 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.956 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.956 INFO:teuthology.orchestra.run.smithi097.stdout: "server_addr": { 2023-11-24T08:08:33.957 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_addr", 2023-11-24T08:08:33.957 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.957 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.957 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.957 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "::", 2023-11-24T08:08:33.957 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-24T08:08:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.959 INFO:teuthology.orchestra.run.smithi097.stdout: "server_port": { 2023-11-24T08:08:33.959 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_port", 2023-11-24T08:08:33.959 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.959 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.959 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.959 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "9283", 2023-11-24T08:08:33.959 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.960 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.960 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.960 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-24T08:08:33.960 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.960 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.960 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.962 INFO:teuthology.orchestra.run.smithi097.stdout: "stale_cache_strategy": { 2023-11-24T08:08:33.962 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "stale_cache_strategy", 2023-11-24T08:08:33.962 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.963 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.963 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.963 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "log", 2023-11-24T08:08:33.963 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.963 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.963 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.963 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_behaviour": { 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_behaviour", 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.964 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "default", 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: "default", 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: "error" 2023-11-24T08:08:33.965 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.966 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.966 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.966 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.966 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.966 INFO:teuthology.orchestra.run.smithi097.stdout: "standby_error_status_code": { 2023-11-24T08:08:33.966 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "standby_error_status_code", 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "500", 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "400", 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "599", 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.967 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.968 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rbd_support", 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.969 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.970 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.970 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.970 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.970 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.970 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.970 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.971 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.972 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.972 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.972 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.972 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.972 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.972 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.974 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.974 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.974 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.974 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.974 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.974 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.974 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.975 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.975 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.975 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.975 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.975 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.975 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.976 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.976 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.976 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.976 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.976 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.976 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.976 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.977 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.978 INFO:teuthology.orchestra.run.smithi097.stdout: "max_concurrent_snap_create": { 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_concurrent_snap_create", 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10", 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.979 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: "mirror_snapshot_schedule": { 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mirror_snapshot_schedule", 2023-11-24T08:08:33.980 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.981 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.981 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.981 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.981 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.981 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.981 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.981 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.982 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.982 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.982 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.982 INFO:teuthology.orchestra.run.smithi097.stdout: "trash_purge_schedule": { 2023-11-24T08:08:33.982 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "trash_purge_schedule", 2023-11-24T08:08:33.982 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "restful", 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "enable_auth": { 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enable_auth", 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.985 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.986 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.986 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:33.986 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.986 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.986 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.986 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.986 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: "key_file": { 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "key_file", 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.987 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.988 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.989 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.990 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.991 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.992 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:33.993 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:33.994 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.995 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:33.996 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: "server_addr": { 2023-11-24T08:08:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_addr", 2023-11-24T08:08:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:33.998 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:33.999 INFO:teuthology.orchestra.run.smithi097.stdout: "server_port": { 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "server_port", 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.000 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rgw", 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.002 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.003 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.004 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.005 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.006 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.007 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.007 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.007 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.007 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.007 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.007 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.007 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.008 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.009 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.010 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rook", 2023-11-24T08:08:34.011 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "drive_group_interval": { 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "drive_group_interval", 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.012 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "300.0", 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.014 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.014 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.014 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.014 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.014 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.014 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.014 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.015 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.016 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.017 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.017 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.017 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.017 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.017 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.017 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.017 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.018 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.018 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.018 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.018 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.018 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.019 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.019 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.019 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.019 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.019 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.020 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.020 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.020 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.020 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.020 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.021 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.021 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.021 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.021 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.021 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.021 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "storage_class": { 2023-11-24T08:08:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "storage_class", 2023-11-24T08:08:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "local", 2023-11-24T08:08:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-11-24T08:08:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "selftest", 2023-11-24T08:08:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.036 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.036 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.036 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.036 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "roption1": { 2023-11-24T08:08:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "roption1", 2023-11-24T08:08:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "roption2": { 2023-11-24T08:08:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "roption2", 2023-11-24T08:08:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "xyz", 2023-11-24T08:08:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption1": { 2023-11-24T08:08:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption1", 2023-11-24T08:08:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption2": { 2023-11-24T08:08:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption2", 2023-11-24T08:08:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption3": { 2023-11-24T08:08:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption3", 2023-11-24T08:08:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "float", 2023-11-24T08:08:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption4": { 2023-11-24T08:08:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption4", 2023-11-24T08:08:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption5": { 2023-11-24T08:08:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption5", 2023-11-24T08:08:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption6": { 2023-11-24T08:08:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption6", 2023-11-24T08:08:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "rwoption7": { 2023-11-24T08:08:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rwoption7", 2023-11-24T08:08:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "1", 2023-11-24T08:08:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "42", 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "testkey": { 2023-11-24T08:08:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "testkey", 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "testlkey": { 2023-11-24T08:08:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "testlkey", 2023-11-24T08:08:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "testnewline": { 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "testnewline", 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "snap_schedule", 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "allow_m_granularity": { 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "allow_m_granularity", 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "allow minute scheduled snapshots", 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "dump_on_update": { 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "dump_on_update", 2023-11-24T08:08:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "dump database to debug log on update", 2023-11-24T08:08:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "stats", 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "status", 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "telegraf", 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "address": { 2023-11-24T08:08:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "address", 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "15", 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "telemetry", 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_basic": { 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_basic", 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-24T08:08:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_crash": { 2023-11-24T08:08:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_crash", 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_device": { 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_device", 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "True", 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_ident": { 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_ident", 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-24T08:08:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "channel_perf": { 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "channel_perf", 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-24T08:08:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "contact": { 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "contact", 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "description": { 2023-11-24T08:08:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "description", 2023-11-24T08:08:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "device_url": { 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "device_url", 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": { 2023-11-24T08:08:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "enabled", 2023-11-24T08:08:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "24", 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "8", 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "last_opt_revision": { 2023-11-24T08:08:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "last_opt_revision", 2023-11-24T08:08:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "1", 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "leaderboard": { 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "leaderboard", 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "leaderboard_description": { 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "leaderboard_description", 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.147 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.148 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.149 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.150 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.151 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.152 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.152 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.152 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.152 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.152 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.152 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.153 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.154 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.154 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.154 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.154 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.154 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.154 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "organization": { 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "organization", 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.156 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.157 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.157 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.157 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.157 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.157 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.157 INFO:teuthology.orchestra.run.smithi097.stdout: "proxy": { 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "proxy", 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.158 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: "url": { 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "url", 2023-11-24T08:08:34.159 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.160 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.160 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.160 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-24T08:08:34.160 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.160 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.160 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.162 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "test_orchestrator", 2023-11-24T08:08:34.162 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.162 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.162 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.162 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.162 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.162 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.163 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.164 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.165 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.167 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.168 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.169 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.170 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.171 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.171 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.171 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "volumes", 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.172 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.173 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.173 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.173 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.173 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.173 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.173 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.173 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.175 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.175 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.175 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.175 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.175 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.175 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.176 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.176 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.176 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.176 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.176 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.177 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.177 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.177 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.177 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.177 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.177 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.178 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.179 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.180 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.181 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.181 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.181 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.181 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.181 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.181 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "max_concurrent_clones": { 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "max_concurrent_clones", 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "4", 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.182 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: "periodic_async_work": { 2023-11-24T08:08:34.183 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "periodic_async_work", 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.184 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Periodically check for async work", 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: "snapshot_clone_delay": { 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "snapshot_clone_delay", 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:34.185 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.186 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.186 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "0", 2023-11-24T08:08:34.186 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.186 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.186 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.186 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-24T08:08:34.186 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix", 2023-11-24T08:08:34.187 INFO:teuthology.orchestra.run.smithi097.stdout: "can_run": true, 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "error_string": "", 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "module_options": { 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "discovery_interval": { 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "discovery_interval", 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "uint", 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.188 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "100", 2023-11-24T08:08:34.189 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.189 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.189 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.189 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.189 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.189 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.189 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: "identifier": { 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "identifier", 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.190 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.191 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.191 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.191 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.191 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.191 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.191 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.192 INFO:teuthology.orchestra.run.smithi097.stdout: "interval": { 2023-11-24T08:08:34.192 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "interval", 2023-11-24T08:08:34.192 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "secs", 2023-11-24T08:08:34.192 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.192 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.192 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "60", 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "log_level": { 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_level", 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.194 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.195 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.195 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.195 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.195 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.195 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.195 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.195 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster": { 2023-11-24T08:08:34.196 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster", 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.197 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_cluster_level": { 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_cluster_level", 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.198 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "info", 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [ 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "", 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "critical", 2023-11-24T08:08:34.199 INFO:teuthology.orchestra.run.smithi097.stdout: "debug", 2023-11-24T08:08:34.200 INFO:teuthology.orchestra.run.smithi097.stdout: "error", 2023-11-24T08:08:34.200 INFO:teuthology.orchestra.run.smithi097.stdout: "info", 2023-11-24T08:08:34.200 INFO:teuthology.orchestra.run.smithi097.stdout: "warning" 2023-11-24T08:08:34.200 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.200 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.200 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.200 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": { 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "log_to_file", 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "bool", 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2023-11-24T08:08:34.201 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "False", 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "zabbix_host": { 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix_host", 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "", 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.203 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: "zabbix_port": { 2023-11-24T08:08:34.204 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix_port", 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "int", 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "10051", 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.205 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "zabbix_sender": { 2023-11-24T08:08:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "zabbix_sender", 2023-11-24T08:08:34.206 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "str", 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "level": "advanced", 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 0, 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "min": "", 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "max": "", 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "enum_allowed": [], 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "desc": "", 2023-11-24T08:08:34.207 INFO:teuthology.orchestra.run.smithi097.stdout: "long_desc": "", 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "see_also": [] 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "services": {}, 2023-11-24T08:08:34.208 INFO:teuthology.orchestra.run.smithi097.stdout: "always_on_modules": { 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "octopus": [ 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "balancer", 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "crash", 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "devicehealth", 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "orchestrator", 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscaler", 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "progress", 2023-11-24T08:08:34.209 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_support", 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "status", 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "telemetry", 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "volumes" 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "pacific": [ 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "balancer", 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "crash", 2023-11-24T08:08:34.210 INFO:teuthology.orchestra.run.smithi097.stdout: "devicehealth", 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "orchestrator", 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscaler", 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "progress", 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_support", 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "status", 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "telemetry", 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: "volumes" 2023-11-24T08:08:34.211 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "quincy": [ 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "balancer", 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "crash", 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "devicehealth", 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "orchestrator", 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscaler", 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "progress", 2023-11-24T08:08:34.212 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_support", 2023-11-24T08:08:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "status", 2023-11-24T08:08:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "telemetry", 2023-11-24T08:08:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "volumes" 2023-11-24T08:08:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2023-11-24T08:08:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "reef": [ 2023-11-24T08:08:34.213 INFO:teuthology.orchestra.run.smithi097.stdout: "balancer", 2023-11-24T08:08:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "crash", 2023-11-24T08:08:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "devicehealth", 2023-11-24T08:08:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "orchestrator", 2023-11-24T08:08:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscaler", 2023-11-24T08:08:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "progress", 2023-11-24T08:08:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_support", 2023-11-24T08:08:34.214 INFO:teuthology.orchestra.run.smithi097.stdout: "status", 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "telemetry", 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "volumes" 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "last_failure_osd_epoch": 0, 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "active_clients": [ 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.215 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "devicehealth", 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:0", 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1421508478 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:34.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "libcephsqlite", 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:0", 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 713463707 2023-11-24T08:08:34.217 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "rbd_support", 2023-11-24T08:08:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2023-11-24T08:08:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.218 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:0", 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1693742649 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "volumes", 2023-11-24T08:08:34.219 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:0", 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1325742100 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.220 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-11-24T08:08:34.221 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:34.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa2bc06ae40 msgr2=0x7fa2bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:34.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa2bc06ae40 0x7fa2bc06d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4038000 tx=0x7fa2c4032000 comp rx=0 tx=0).stop 2023-11-24T08:08:34.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 msgr2=0x7fa2d0141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:34.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d0141920 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000b4a0 tx=0x7fa2c000b960 comp rx=0 tx=0).stop 2023-11-24T08:08:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 shutdown_connections 2023-11-24T08:08:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fa2bc06ae40 0x7fa2bc06d300 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2d015e1e0 0x7fa2d00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2d0143ae0 0x7fa2d00cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 --2- 172.21.15.97:0/3179323079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2d00cf7d0 0x7fa2d0141920 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 >> 172.21.15.97:0/3179323079 conn(0x7fa2d006a800 msgr2=0x7fa2d006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:34.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.623+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 shutdown_connections 2023-11-24T08:08:34.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:32.624+0000 7fa2d6101640 1 -- 172.21.15.97:0/3179323079 wait complete. 2023-11-24T08:08:34.228 DEBUG:tasks.check_counter:Getting stats from y 2023-11-24T08:08:34.228 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.y.asok perf dump 2023-11-24T08:08:34.441 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:34.442 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-0": { 2023-11-24T08:08:34.442 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 390, 2023-11-24T08:08:34.442 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 222, 2023-11-24T08:08:34.443 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 3036000, 2023-11-24T08:08:34.443 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 3045238, 2023-11-24T08:08:34.443 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 124, 2023-11-24T08:08:34.444 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 15, 2023-11-24T08:08:34.444 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.187536211, 2023-11-24T08:08:34.444 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.013783304, 2023-11-24T08:08:34.444 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.135151618, 2023-11-24T08:08:34.445 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.005556903, 2023-11-24T08:08:34.445 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T08:08:34.445 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 205, 2023-11-24T08:08:34.445 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.234344028, 2023-11-24T08:08:34.446 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.001143141 2023-11-24T08:08:34.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.446 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2023-11-24T08:08:34.446 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.447 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.447 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.447 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 3036000, 2023-11-24T08:08:34.448 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 3044976 2023-11-24T08:08:34.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.448 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-1": { 2023-11-24T08:08:34.448 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 261, 2023-11-24T08:08:34.448 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 49, 2023-11-24T08:08:34.448 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 2528208, 2023-11-24T08:08:34.448 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 1063440, 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 163, 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 11, 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.174901927, 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.004624151, 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.180785118, 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T08:08:34.449 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 36, 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.035438007, 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000984389 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.451 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 2528208, 2023-11-24T08:08:34.451 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 1063440 2023-11-24T08:08:34.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.451 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-2": { 2023-11-24T08:08:34.451 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 650, 2023-11-24T08:08:34.451 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 400, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 2726626, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 3420512, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 43, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 20, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.161535681, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.062293784, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.141253583, 2023-11-24T08:08:34.452 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.000019864, 2023-11-24T08:08:34.453 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T08:08:34.453 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 386, 2023-11-24T08:08:34.453 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.065754029, 2023-11-24T08:08:34.453 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000170347 2023-11-24T08:08:34.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.453 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2023-11-24T08:08:34.453 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.454 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.454 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.454 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 2725744, 2023-11-24T08:08:34.454 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 3419872 2023-11-24T08:08:34.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.454 INFO:teuthology.orchestra.run.smithi097.stdout: "cct": { 2023-11-24T08:08:34.455 INFO:teuthology.orchestra.run.smithi097.stdout: "total_workers": 0, 2023-11-24T08:08:34.455 INFO:teuthology.orchestra.run.smithi097.stdout: "unhealthy_workers": 0 2023-11-24T08:08:34.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.455 INFO:teuthology.orchestra.run.smithi097.stdout: "client": { 2023-11-24T08:08:34.455 INFO:teuthology.orchestra.run.smithi097.stdout: "reply": { 2023-11-24T08:08:34.455 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.456 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.456 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.456 INFO:teuthology.orchestra.run.smithi097.stdout: "lat": { 2023-11-24T08:08:34.456 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.456 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.456 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.457 INFO:teuthology.orchestra.run.smithi097.stdout: "wrlat": { 2023-11-24T08:08:34.457 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.457 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.457 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.457 INFO:teuthology.orchestra.run.smithi097.stdout: "rdlat": { 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fsync": { 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.458 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.459 INFO:teuthology.orchestra.run.smithi097.stdout: "mdavg": 0.000000000, 2023-11-24T08:08:34.459 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsqsum": 0, 2023-11-24T08:08:34.459 INFO:teuthology.orchestra.run.smithi097.stdout: "mdops": 0, 2023-11-24T08:08:34.459 INFO:teuthology.orchestra.run.smithi097.stdout: "readavg": 0.000000000, 2023-11-24T08:08:34.459 INFO:teuthology.orchestra.run.smithi097.stdout: "readsqsum": 0, 2023-11-24T08:08:34.459 INFO:teuthology.orchestra.run.smithi097.stdout: "rdops": 0, 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: "writeavg": 0.000000000, 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: "writesqsum": 0, 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: "rdops": 0 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-Mgr": { 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.460 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 2, 2023-11-24T08:08:34.461 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.046461338, 2023-11-24T08:08:34.461 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.023230669 2023-11-24T08:08:34.461 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.461 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-MgrStandby": { 2023-11-24T08:08:34.461 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.461 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.462 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.462 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.462 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.462 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.462 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-balancer": { 2023-11-24T08:08:34.462 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.463 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.463 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.463 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.463 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.463 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.463 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-cmd_finisher": { 2023-11-24T08:08:34.464 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.464 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.464 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 17, 2023-11-24T08:08:34.464 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.001072819, 2023-11-24T08:08:34.464 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000063107 2023-11-24T08:08:34.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-crash": { 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.466 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-devicehealth": { 2023-11-24T08:08:34.466 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.466 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.466 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.466 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.466 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-iostat": { 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.467 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.468 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-nfs": { 2023-11-24T08:08:34.468 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.468 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.468 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.468 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.468 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-orchestrator": { 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.469 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-pg_autoscaler": { 2023-11-24T08:08:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.470 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-progress": { 2023-11-24T08:08:34.471 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-rbd_support": { 2023-11-24T08:08:34.472 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-restful": { 2023-11-24T08:08:34.473 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.474 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.474 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 16, 2023-11-24T08:08:34.474 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.005887749, 2023-11-24T08:08:34.474 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000367984 2023-11-24T08:08:34.474 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-status": { 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-telemetry": { 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.477 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-volumes": { 2023-11-24T08:08:34.477 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2023-11-24T08:08:34.477 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2023-11-24T08:08:34.477 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1, 2023-11-24T08:08:34.478 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000886502, 2023-11-24T08:08:34.478 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000886502 2023-11-24T08:08:34.478 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.478 INFO:teuthology.orchestra.run.smithi097.stdout: "libcephsqlite_striper": { 2023-11-24T08:08:34.478 INFO:teuthology.orchestra.run.smithi097.stdout: "update_metadata": 8, 2023-11-24T08:08:34.479 INFO:teuthology.orchestra.run.smithi097.stdout: "update_allocated": 2, 2023-11-24T08:08:34.479 INFO:teuthology.orchestra.run.smithi097.stdout: "update_size": 6, 2023-11-24T08:08:34.479 INFO:teuthology.orchestra.run.smithi097.stdout: "update_version": 8, 2023-11-24T08:08:34.479 INFO:teuthology.orchestra.run.smithi097.stdout: "shrink": 0, 2023-11-24T08:08:34.479 INFO:teuthology.orchestra.run.smithi097.stdout: "shrink_bytes": 0, 2023-11-24T08:08:34.479 INFO:teuthology.orchestra.run.smithi097.stdout: "lock": 11, 2023-11-24T08:08:34.479 INFO:teuthology.orchestra.run.smithi097.stdout: "unlock": 11 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: "libcephsqlite_vfs": { 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: "op_open": { 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 2, 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.121997922, 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.060998961 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.480 INFO:teuthology.orchestra.run.smithi097.stdout: "op_delete": { 2023-11-24T08:08:34.481 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.481 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.481 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.481 INFO:teuthology.orchestra.run.smithi097.stdout: "op_access": { 2023-11-24T08:08:34.481 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.481 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: "op_fullpathname": { 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1, 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: "op_currenttime": { 2023-11-24T08:08:34.483 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 4, 2023-11-24T08:08:34.483 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.483 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.483 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_close": { 2023-11-24T08:08:34.483 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.483 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_read": { 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 20, 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.021999627, 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.001099981 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.484 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_write": { 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 85, 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.015999728, 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000188232 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_truncate": { 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.485 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.486 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_sync": { 2023-11-24T08:08:34.486 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 24, 2023-11-24T08:08:34.486 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.200996580, 2023-11-24T08:08:34.486 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.008374857 2023-11-24T08:08:34.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_filesize": { 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 20, 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_lock": { 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 27, 2023-11-24T08:08:34.487 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.051999114, 2023-11-24T08:08:34.488 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.001925893 2023-11-24T08:08:34.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.488 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_unlock": { 2023-11-24T08:08:34.488 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 19, 2023-11-24T08:08:34.488 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.035999386, 2023-11-24T08:08:34.488 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.001894704 2023-11-24T08:08:34.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_checkreservedlock": { 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 9, 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_filecontrol": { 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 26, 2023-11-24T08:08:34.489 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.490 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.490 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_sectorsize": { 2023-11-24T08:08:34.490 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.490 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.490 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: "opf_devicecharacteristics": { 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 30, 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mempool": { 2023-11-24T08:08:34.491 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_bytes": 0, 2023-11-24T08:08:34.492 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_items": 0, 2023-11-24T08:08:34.492 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_bytes": 0, 2023-11-24T08:08:34.492 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_items": 0, 2023-11-24T08:08:34.492 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_bytes": 0, 2023-11-24T08:08:34.492 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_items": 0, 2023-11-24T08:08:34.492 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-24T08:08:34.492 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_items": 0, 2023-11-24T08:08:34.493 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-24T08:08:34.493 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_items": 0, 2023-11-24T08:08:34.493 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_bytes": 0, 2023-11-24T08:08:34.493 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_items": 0, 2023-11-24T08:08:34.493 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_bytes": 0, 2023-11-24T08:08:34.493 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_items": 0, 2023-11-24T08:08:34.493 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_bytes": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_items": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_bytes": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_items": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_bytes": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_items": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_items": 0, 2023-11-24T08:08:34.494 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_bytes": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_items": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_bytes": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_items": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_items": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_bytes": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_items": 0, 2023-11-24T08:08:34.495 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_bytes": 0, 2023-11-24T08:08:34.496 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_items": 0, 2023-11-24T08:08:34.496 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_bytes": 0, 2023-11-24T08:08:34.496 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_items": 0, 2023-11-24T08:08:34.496 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_bytes": 0, 2023-11-24T08:08:34.496 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_items": 0, 2023-11-24T08:08:34.496 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_bytes": 1611898, 2023-11-24T08:08:34.496 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_items": 275, 2023-11-24T08:08:34.497 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_bytes": 1496, 2023-11-24T08:08:34.497 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_items": 17, 2023-11-24T08:08:34.497 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bytes": 0, 2023-11-24T08:08:34.497 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_items": 0, 2023-11-24T08:08:34.497 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_bytes": 0, 2023-11-24T08:08:34.497 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_items": 0, 2023-11-24T08:08:34.497 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_bytes": 0, 2023-11-24T08:08:34.498 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_items": 0, 2023-11-24T08:08:34.498 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_bytes": 33368, 2023-11-24T08:08:34.498 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_items": 604, 2023-11-24T08:08:34.498 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_bytes": 0, 2023-11-24T08:08:34.498 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_items": 0, 2023-11-24T08:08:34.498 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_bytes": 12880, 2023-11-24T08:08:34.498 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_items": 308, 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_bytes": 0, 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_items": 0, 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_bytes": 0, 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_items": 0, 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_bytes": 0, 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_items": 0 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.499 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": { 2023-11-24T08:08:34.500 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_hit": 0, 2023-11-24T08:08:34.500 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_miss": 0 2023-11-24T08:08:34.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.500 INFO:teuthology.orchestra.run.smithi097.stdout: "objectcacher-libcephfs": { 2023-11-24T08:08:34.500 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_ops_hit": 0, 2023-11-24T08:08:34.500 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_ops_miss": 0, 2023-11-24T08:08:34.500 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_bytes_hit": 0, 2023-11-24T08:08:34.501 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_bytes_miss": 0, 2023-11-24T08:08:34.501 INFO:teuthology.orchestra.run.smithi097.stdout: "data_read": 0, 2023-11-24T08:08:34.501 INFO:teuthology.orchestra.run.smithi097.stdout: "data_written": 0, 2023-11-24T08:08:34.501 INFO:teuthology.orchestra.run.smithi097.stdout: "data_flushed": 0, 2023-11-24T08:08:34.501 INFO:teuthology.orchestra.run.smithi097.stdout: "data_overwritten_while_flushing": 0, 2023-11-24T08:08:34.501 INFO:teuthology.orchestra.run.smithi097.stdout: "write_ops_blocked": 0, 2023-11-24T08:08:34.502 INFO:teuthology.orchestra.run.smithi097.stdout: "write_bytes_blocked": 0, 2023-11-24T08:08:34.502 INFO:teuthology.orchestra.run.smithi097.stdout: "write_time_blocked": 0.000000000 2023-11-24T08:08:34.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.502 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter": { 2023-11-24T08:08:34.502 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2023-11-24T08:08:34.502 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2023-11-24T08:08:34.502 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 0, 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 0, 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 0, 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 0, 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.504 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2023-11-24T08:08:34.504 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2023-11-24T08:08:34.504 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.504 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0 2023-11-24T08:08:34.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.504 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 0, 2023-11-24T08:08:34.504 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 0, 2023-11-24T08:08:34.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2023-11-24T08:08:34.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2023-11-24T08:08:34.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2023-11-24T08:08:34.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2023-11-24T08:08:34.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2023-11-24T08:08:34.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2023-11-24T08:08:34.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2023-11-24T08:08:34.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2023-11-24T08:08:34.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2023-11-24T08:08:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2023-11-24T08:08:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T08:08:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2023-11-24T08:08:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2023-11-24T08:08:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2023-11-24T08:08:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2023-11-24T08:08:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2023-11-24T08:08:34.509 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2023-11-24T08:08:34.510 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2023-11-24T08:08:34.510 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2023-11-24T08:08:34.510 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2023-11-24T08:08:34.510 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 8, 2023-11-24T08:08:34.510 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2023-11-24T08:08:34.510 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 38, 2023-11-24T08:08:34.510 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 37, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 8, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 8, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 0, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 0, 2023-11-24T08:08:34.511 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter-0x55b5d42cc8c0": { 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 163, 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 2434694, 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 0, 2023-11-24T08:08:34.512 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 163, 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 163, 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 1.182979862, 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.007257545 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2023-11-24T08:08:34.513 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 163, 2023-11-24T08:08:34.514 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 307 2023-11-24T08:08:34.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.514 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 163, 2023-11-24T08:08:34.514 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 46, 2023-11-24T08:08:34.514 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 117, 2023-11-24T08:08:34.514 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2023-11-24T08:08:34.514 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 0, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 2, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 20, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 85, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2023-11-24T08:08:34.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 104, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 52, 2023-11-24T08:08:34.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 22, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 22, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2023-11-24T08:08:34.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2023-11-24T08:08:34.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2023-11-24T08:08:34.518 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2023-11-24T08:08:34.518 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2023-11-24T08:08:34.518 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2023-11-24T08:08:34.518 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2023-11-24T08:08:34.518 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2023-11-24T08:08:34.518 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2023-11-24T08:08:34.519 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2023-11-24T08:08:34.519 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2023-11-24T08:08:34.519 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2023-11-24T08:08:34.519 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2023-11-24T08:08:34.519 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2023-11-24T08:08:34.519 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2023-11-24T08:08:34.519 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 19, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 9, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 1, 2023-11-24T08:08:34.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 1, 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 0, 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 0, 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter-0x55b5d42ccaa0": { 2023-11-24T08:08:34.521 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 0, 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 0, 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 0, 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 0, 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.522 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.523 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.525 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2023-11-24T08:08:34.525 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2023-11-24T08:08:34.525 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.525 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0 2023-11-24T08:08:34.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 0, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 0, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 0, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 0, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 0, 2023-11-24T08:08:34.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 0, 2023-11-24T08:08:34.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 0, 2023-11-24T08:08:34.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2023-11-24T08:08:34.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2023-11-24T08:08:34.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2023-11-24T08:08:34.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2023-11-24T08:08:34.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2023-11-24T08:08:34.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2023-11-24T08:08:34.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2023-11-24T08:08:34.529 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2023-11-24T08:08:34.530 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2023-11-24T08:08:34.530 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2023-11-24T08:08:34.530 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2023-11-24T08:08:34.530 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2023-11-24T08:08:34.530 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2023-11-24T08:08:34.530 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2023-11-24T08:08:34.530 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2023-11-24T08:08:34.531 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2023-11-24T08:08:34.532 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 0, 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter-0x55b5d42ccd20": { 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 0, 2023-11-24T08:08:34.533 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 0, 2023-11-24T08:08:34.534 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 0, 2023-11-24T08:08:34.534 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 0, 2023-11-24T08:08:34.534 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2023-11-24T08:08:34.534 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.534 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.534 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 0, 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 0, 2023-11-24T08:08:34.535 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2023-11-24T08:08:34.536 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2023-11-24T08:08:34.537 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2023-11-24T08:08:34.537 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2023-11-24T08:08:34.537 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2023-11-24T08:08:34.537 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2023-11-24T08:08:34.537 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2023-11-24T08:08:34.537 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2023-11-24T08:08:34.537 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2023-11-24T08:08:34.538 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2023-11-24T08:08:34.539 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T08:08:34.539 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2023-11-24T08:08:34.539 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2023-11-24T08:08:34.539 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2023-11-24T08:08:34.539 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2023-11-24T08:08:34.539 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2023-11-24T08:08:34.539 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2023-11-24T08:08:34.540 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2023-11-24T08:08:34.540 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2023-11-24T08:08:34.540 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2023-11-24T08:08:34.540 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2023-11-24T08:08:34.540 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2023-11-24T08:08:34.540 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2023-11-24T08:08:34.541 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 0, 2023-11-24T08:08:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2023-11-24T08:08:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 0, 2023-11-24T08:08:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 0, 2023-11-24T08:08:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 0, 2023-11-24T08:08:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 0, 2023-11-24T08:08:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2023-11-24T08:08:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 0, 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter-0x55b5d4f8c000": { 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 1, 2023-11-24T08:08:34.543 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 39, 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 0, 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 1, 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1, 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.002999949, 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.002999949 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.544 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1, 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 1 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 1, 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 1, 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 0, 2023-11-24T08:08:34.545 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2023-11-24T08:08:34.546 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2023-11-24T08:08:34.546 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 0, 2023-11-24T08:08:34.546 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 0, 2023-11-24T08:08:34.546 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 0, 2023-11-24T08:08:34.546 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 0, 2023-11-24T08:08:34.546 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2023-11-24T08:08:34.546 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2023-11-24T08:08:34.547 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2023-11-24T08:08:34.548 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 1, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2023-11-24T08:08:34.549 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2023-11-24T08:08:34.550 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2023-11-24T08:08:34.550 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2023-11-24T08:08:34.550 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2023-11-24T08:08:34.550 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2023-11-24T08:08:34.550 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2023-11-24T08:08:34.550 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2023-11-24T08:08:34.550 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 0, 2023-11-24T08:08:34.551 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 1, 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 1, 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 0, 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 0, 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.552 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_client_bytes": { 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 134217728, 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 61, 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 165787, 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 61, 2023-11-24T08:08:34.553 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 61, 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 165787, 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.554 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.555 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_client_messages": { 2023-11-24T08:08:34.555 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.555 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 512, 2023-11-24T08:08:34.555 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.555 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 61, 2023-11-24T08:08:34.555 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 61, 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 61, 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 61, 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 61, 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.556 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_mds_bytes": { 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 134217728, 2023-11-24T08:08:34.557 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 108, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 821748, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 108, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 108, 2023-11-24T08:08:34.558 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 821748, 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_mds_messsages": { 2023-11-24T08:08:34.559 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 128, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 108, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 108, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 108, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.560 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 108, 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 108, 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.562 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_mon_bytes": { 2023-11-24T08:08:34.562 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.562 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 134217728, 2023-11-24T08:08:34.562 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.562 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 81, 2023-11-24T08:08:34.562 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 513032, 2023-11-24T08:08:34.562 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 81, 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 81, 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 513032, 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.563 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_mon_messsages": { 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 128, 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.564 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 81, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 81, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 81, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 81, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 81, 2023-11-24T08:08:34.565 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.566 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.566 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.566 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.566 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.566 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_osd_bytes": { 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 536870912, 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 439, 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 4750187, 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 439, 2023-11-24T08:08:34.567 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 439, 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 4750187, 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-mgr_osd_messsages": { 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 8192, 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 439, 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 439, 2023-11-24T08:08:34.569 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.570 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 439, 2023-11-24T08:08:34.570 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.570 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.570 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 439, 2023-11-24T08:08:34.570 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 439, 2023-11-24T08:08:34.570 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.570 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.571 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.572 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 386, 2023-11-24T08:08:34.572 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 686712, 2023-11-24T08:08:34.572 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.572 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 386, 2023-11-24T08:08:34.572 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.572 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.572 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 386, 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 686712, 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.573 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-mgr-0x55b5ce3d9680": { 2023-11-24T08:08:34.574 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.574 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.574 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.574 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 689, 2023-11-24T08:08:34.574 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 6250754, 2023-11-24T08:08:34.574 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.575 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 689, 2023-11-24T08:08:34.575 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.575 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.575 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 689, 2023-11-24T08:08:34.575 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 6250754, 2023-11-24T08:08:34.575 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.575 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.576 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 176, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 359590, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 176, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 176, 2023-11-24T08:08:34.577 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 359590, 2023-11-24T08:08:34.578 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.578 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.578 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.578 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.578 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.579 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b5d42ccc80": { 2023-11-24T08:08:34.579 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.579 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.580 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.580 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 9, 2023-11-24T08:08:34.580 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 314711, 2023-11-24T08:08:34.580 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 9, 2023-11-24T08:08:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 9, 2023-11-24T08:08:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 314711, 2023-11-24T08:08:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b5d42ccf00": { 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.582 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 10, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 314735, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 10, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 10, 2023-11-24T08:08:34.583 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 314735, 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b5d42cd5e0": { 2023-11-24T08:08:34.584 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.585 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.585 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.585 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 8, 2023-11-24T08:08:34.585 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 184480, 2023-11-24T08:08:34.585 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.585 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 8, 2023-11-24T08:08:34.585 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.586 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.586 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 8, 2023-11-24T08:08:34.586 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 184480, 2023-11-24T08:08:34.586 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.586 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.586 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.586 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes": { 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2023-11-24T08:08:34.587 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.588 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2023-11-24T08:08:34.588 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.588 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.588 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2023-11-24T08:08:34.588 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2023-11-24T08:08:34.588 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.588 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes-0x55b5ce3d9540": { 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.589 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.590 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 1, 2023-11-24T08:08:34.590 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2023-11-24T08:08:34.590 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.590 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 1, 2023-11-24T08:08:34.590 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.591 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.591 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 1, 2023-11-24T08:08:34.591 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2023-11-24T08:08:34.591 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.591 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.591 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.591 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes-0x55b5d42cc6e0": { 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 163, 2023-11-24T08:08:34.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 2433005, 2023-11-24T08:08:34.593 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.593 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 163, 2023-11-24T08:08:34.593 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.593 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.593 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 163, 2023-11-24T08:08:34.593 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 2433005, 2023-11-24T08:08:34.593 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes-0x55b5d42ccbe0": { 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.594 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.595 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.596 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes-0x55b5d42cce60": { 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2023-11-24T08:08:34.597 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.598 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.598 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2023-11-24T08:08:34.598 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2023-11-24T08:08:34.598 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.598 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.598 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.598 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops": { 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2023-11-24T08:08:34.599 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.600 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops-0x55b5d42cc820": { 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2023-11-24T08:08:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 163, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 163, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 163, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 163, 2023-11-24T08:08:34.602 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 163, 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops-0x55b5d42ccb40": { 2023-11-24T08:08:34.603 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.604 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.606 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops-0x55b5d42ccdc0": { 2023-11-24T08:08:34.606 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.606 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2023-11-24T08:08:34.606 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.606 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2023-11-24T08:08:34.606 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2023-11-24T08:08:34.606 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.607 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops-0x55b5d42cd540": { 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2023-11-24T08:08:34.608 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 1, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 1, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 1, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 1, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 1, 2023-11-24T08:08:34.609 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2023-11-24T08:08:34.610 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2023-11-24T08:08:34.610 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2023-11-24T08:08:34.610 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2023-11-24T08:08:34.610 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.610 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-11-24T08:08:34.610 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:34.612 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.complete_latency.avgcount=1 2023-11-24T08:08:34.612 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.queue_len=0 2023-11-24T08:08:34.612 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mgr daemons: {'finisher-volumes.complete_latency.avgcount'} 2023-11-24T08:08:34.616 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-24T08:08:34.626 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-24T08:08:34.626 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:08:34.626 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:34.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:08:34.688 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-11-24T08:08:34.688 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:34.739 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:08:34.740 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:08:34.740 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:34.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:08:34.800 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-11-24T08:08:34.800 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:08:34.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054288,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:08:34.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:34.851 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-11-24T08:08:34.951 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:08:34.951 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:08:34.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:34.952 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:08:35.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:35.051 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:08:35.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:35.143 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-11-24T08:08:35.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:35.277 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-11-24T08:08:35.336 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:08:35.336 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:08:35.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:35.337 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:08:35.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:35.433 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:08:35.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:08:35.537 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2023-11-24T08:08:35.669 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T08:08:35.679 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:08:35.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.867+0000 7fe1bccc2640 1 Processor -- start 2023-11-24T08:08:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.867+0000 7fe1bccc2640 1 -- start start 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1bccc2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1b813e360 0x7fe1b80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1bccc2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1bccc2640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b815c5f0 con 0x7fe1b813df80 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1bccc2640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b806c470 con 0x7fe1b813e360 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1bccc2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b806c750 con 0x7fe1b815f9c0 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1b5d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1b813e360 0x7fe1b80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1b5d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe1b813e360 0x7fe1b80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55308/0 (socket says 172.21.15.97:55308) 2023-11-24T08:08:35.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1b659c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe1b813df80 0x7fe1b815bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41378/0 (socket says 172.21.15.97:41378) 2023-11-24T08:08:35.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.869+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/158327719 learned_addr learned my addr 172.21.15.97:0/158327719 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.870+0000 7fe1b6d9d640 1 --2- 172.21.15.97:0/158327719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.870+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/158327719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 msgr2=0x7fe1b80cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.870+0000 7fe1b5d9b640 1 --2- 172.21.15.97:0/158327719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.870+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/158327719 >> v1:172.21.15.97:6789/0 conn(0x7fe1b813df80 legacy=0x7fe1b815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.870+0000 7fe1b559a640 1 -- 172.21.15.97:0/158327719 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769151766 0 0) 0x7fe1b815c5f0 con 0x7fe1b813df80 2023-11-24T08:08:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.870+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/158327719 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b806ca30 con 0x7fe1b813e360 2023-11-24T08:08:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.870+0000 7fe1b6d9d640 1 --2- 172.21.15.97:0/158327719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.871+0000 7fe1b5d9b640 1 --2- 172.21.15.97:0/158327719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b80cf290 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce468861b8524cc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.871+0000 7fe1b559a640 1 -- 172.21.15.97:0/158327719 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0030840 con 0x7fe1b813e360 2023-11-24T08:08:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.871+0000 7fe1b559a640 1 -- 172.21.15.97:0/158327719 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a00309a0 con 0x7fe1b813e360 2023-11-24T08:08:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.871+0000 7fe1b559a640 1 -- 172.21.15.97:0/158327719 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0030d30 con 0x7fe1b813e360 2023-11-24T08:08:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 -- 172.21.15.97:0/158327719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 msgr2=0x7fe1b80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/158327719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b80cf290 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a002b980 comp rx=0 tx=0).stop 2023-11-24T08:08:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 -- 172.21.15.97:0/158327719 shutdown_connections 2023-11-24T08:08:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/158327719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/158327719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b80cf290 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:35.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 -- 172.21.15.97:0/158327719 >> 172.21.15.97:0/158327719 conn(0x7fe1b806a800 msgr2=0x7fe1b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:35.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 -- 172.21.15.97:0/158327719 shutdown_connections 2023-11-24T08:08:35.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.872+0000 7fe1bccc2640 1 -- 172.21.15.97:0/158327719 wait complete. 2023-11-24T08:08:35.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.874+0000 7fe1bccc2640 1 Processor -- start 2023-11-24T08:08:35.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.874+0000 7fe1bccc2640 1 -- start start 2023-11-24T08:08:35.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1bccc2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b813df80 0x7fe1b813d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:35.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1bccc2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b81f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:35.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1bccc2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:35.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1bccc2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8153010 con 0x7fe1b813e360 2023-11-24T08:08:35.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1bccc2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8152140 con 0x7fe1b813df80 2023-11-24T08:08:35.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1bccc2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b813dd60 con 0x7fe1b815f9c0 2023-11-24T08:08:35.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1b5d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b81f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:35.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1b5d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b81f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55312/0 (socket says 172.21.15.97:55312) 2023-11-24T08:08:35.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.875+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/2801457917 learned_addr learned my addr 172.21.15.97:0/2801457917 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:35.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1b659c640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b813df80 0x7fe1b813d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:35.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/2801457917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 msgr2=0x7fe1b80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:35.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1b5d9b640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:35.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/2801457917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b813df80 msgr2=0x7fe1b813d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:35.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1b5d9b640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b813df80 0x7fe1b813d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:35.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1b5d9b640 1 -- 172.21.15.97:0/2801457917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00094d0 con 0x7fe1b813e360 2023-11-24T08:08:35.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1b5d9b640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b81f3030 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe1a002b9c0 tx=0x7fe1a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:35.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1aeffd640 1 -- 172.21.15.97:0/2801457917 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0030810 con 0x7fe1b813e360 2023-11-24T08:08:35.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1aeffd640 1 -- 172.21.15.97:0/2801457917 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0044480 con 0x7fe1b813e360 2023-11-24T08:08:35.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1aeffd640 1 -- 172.21.15.97:0/2801457917 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0044850 con 0x7fe1b813e360 2023-11-24T08:08:35.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b81f3570 con 0x7fe1b813e360 2023-11-24T08:08:35.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.876+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b8152670 con 0x7fe1b813e360 2023-11-24T08:08:35.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.877+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b8153150 con 0x7fe1b813e360 2023-11-24T08:08:35.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.878+0000 7fe1aeffd640 1 -- 172.21.15.97:0/2801457917 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1a002f390 con 0x7fe1b813e360 2023-11-24T08:08:35.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.879+0000 7fe1aeffd640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe19806ae40 0x7fe19806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:35.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.879+0000 7fe1aeffd640 1 -- 172.21.15.97:0/2801457917 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1a003e070 con 0x7fe1b813e360 2023-11-24T08:08:35.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.880+0000 7fe1b659c640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe19806ae40 0x7fe19806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:35.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.880+0000 7fe1b659c640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe19806ae40 0x7fe19806d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000f60 tx=0x7fe1a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:35.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:35.884+0000 7fe1aeffd640 1 -- 172.21.15.97:0/2801457917 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1b8153150 con 0x7fe1b813e360 2023-11-24T08:08:36.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.068+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1b806cff0 con 0x7fe19806ae40 2023-11-24T08:08:36.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.075+0000 7fe1aeffd640 1 -- 172.21.15.97:0/2801457917 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49167 (secure 0 0 0) 0x7fe1a80070d0 con 0x7fe19806ae40 2023-11-24T08:08:36.078 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:36.078 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:08:36.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe19806ae40 msgr2=0x7fe19806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe19806ae40 0x7fe19806d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000f60 tx=0x7fe1a8009040 comp rx=0 tx=0).stop 2023-11-24T08:08:36.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 msgr2=0x7fe1b81f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b81f3030 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe1a002b9c0 tx=0x7fe1a0004730 comp rx=0 tx=0).stop 2023-11-24T08:08:36.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 shutdown_connections 2023-11-24T08:08:36.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe19806ae40 0x7fe19806d300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b815f9c0 0x7fe1b80b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1b813e360 0x7fe1b81f3030 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 --2- 172.21.15.97:0/2801457917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b813df80 0x7fe1b813d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 >> 172.21.15.97:0/2801457917 conn(0x7fe1b806a800 msgr2=0x7fe1b80aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:36.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 shutdown_connections 2023-11-24T08:08:36.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.077+0000 7fe1bccc2640 1 -- 172.21.15.97:0/2801457917 wait complete. 2023-11-24T08:08:36.099 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-11-24T08:08:35.302041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224908,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749812,"statfs":{"total":773094113280,"available":772863807488,"internally_reserved":0,"allocated":4694016,"data_stored":2558328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002094"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:08:29.309364+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:08:29.309364+0000","last_peered":"2023-11-24T08:08:29.309364+0000","last_clean":"2023-11-24T08:08:29.309364+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:08:29.309364+0000","last_undegraded":"2023-11-24T08:08:29.309364+0000","last_fullsized":"2023-11-24T08:08:29.309364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1359999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1830000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.478},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0780000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.367},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.55}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6599999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.732},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":1.4039999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.304},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.7270000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.417}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.206},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.609}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.661}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.464},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0579999999999998,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.385}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.391},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.272}]},{"osd":2,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.429}]},{"osd":3,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.48},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5229999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.5620000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.026},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.617}]},{"osd":7,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.3380000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2629999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4379999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5099999999999998,"5min":3.5099999999999998,"15min":3.5099999999999998},"last":0.995},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.329}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.498}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.611}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.04}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.448}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.171}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.482},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.542}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.3740000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.335},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.28}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":1.075}]},{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.375},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.2909999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.492},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.6240000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.536},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.675}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.319}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":1.585}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.624},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.139}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.099}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.427},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1659999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.3939999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.169}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.095},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.399}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.359},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.3759999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:36.101 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:36.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.313+0000 7fe5bf431640 1 Processor -- start 2023-11-24T08:08:36.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.314+0000 7fe5bf431640 1 -- start start 2023-11-24T08:08:36.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bf431640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe5b813df80 0x7fe5b815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bf431640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe5b80cf9a0 0x7fe5b80cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bf431640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b806c470 con 0x7fe5b813e360 2023-11-24T08:08:36.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bf431640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b806c750 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bf431640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b806ca30 con 0x7fe5b813df80 2023-11-24T08:08:36.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bd9ce640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe5b80cf9a0 0x7fe5b80cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bc9cc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe5b813e360 0x7fe5b80cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33874/0 (socket says 172.21.15.97:33874) 2023-11-24T08:08:36.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.315+0000 7fe5bc9cc640 1 -- 172.21.15.97:0/520267402 learned_addr learned my addr 172.21.15.97:0/520267402 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:36.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.316+0000 7fe5bd1cd640 1 --2- 172.21.15.97:0/520267402 >> v2:172.21.15.183:3300/0 conn(0x7fe5b813df80 0x7fe5b815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.316+0000 7fe5affff640 1 -- 172.21.15.97:0/520267402 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695225455 0 0) 0x7fe5b806c470 con 0x7fe5b813e360 2023-11-24T08:08:36.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.316+0000 7fe5bd9ce640 1 -- 172.21.15.97:0/520267402 >> v2:172.21.15.183:3300/0 conn(0x7fe5b813df80 msgr2=0x7fe5b815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:36.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.316+0000 7fe5bd9ce640 1 --2- 172.21.15.97:0/520267402 >> v2:172.21.15.183:3300/0 conn(0x7fe5b813df80 0x7fe5b815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.316+0000 7fe5bd9ce640 1 -- 172.21.15.97:0/520267402 >> v1:172.21.15.97:6789/0 conn(0x7fe5b813e360 legacy=0x7fe5b80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.316+0000 7fe5bd9ce640 1 -- 172.21.15.97:0/520267402 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b806cd10 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.317+0000 7fe5bd9ce640 1 --2- 172.21.15.97:0/520267402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80cd840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8072770 tx=0x7fe5b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b916f82541a1b663 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:36.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.317+0000 7fe5affff640 1 -- 172.21.15.97:0/520267402 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b002cc80 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.317+0000 7fe5affff640 1 -- 172.21.15.97:0/520267402 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b002cde0 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.317+0000 7fe5affff640 1 -- 172.21.15.97:0/520267402 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0034660 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 -- 172.21.15.97:0/520267402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 msgr2=0x7fe5b80cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 --2- 172.21.15.97:0/520267402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80cd840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8072770 tx=0x7fe5b002bed0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 -- 172.21.15.97:0/520267402 shutdown_connections 2023-11-24T08:08:36.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 --2- 172.21.15.97:0/520267402 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80cd840 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 --2- 172.21.15.97:0/520267402 >> v2:172.21.15.183:3300/0 conn(0x7fe5b813df80 0x7fe5b815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 -- 172.21.15.97:0/520267402 >> 172.21.15.97:0/520267402 conn(0x7fe5b806a800 msgr2=0x7fe5b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:36.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 -- 172.21.15.97:0/520267402 shutdown_connections 2023-11-24T08:08:36.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.318+0000 7fe5bf431640 1 -- 172.21.15.97:0/520267402 wait complete. 2023-11-24T08:08:36.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.320+0000 7fe5bf431640 1 Processor -- start 2023-11-24T08:08:36.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.320+0000 7fe5bf431640 1 -- start start 2023-11-24T08:08:36.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bf431640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bf431640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b813df80 0x7fe5b813d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bf431640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5b813e360 0x7fe5b815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bf431640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81e63b0 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bf431640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81e5730 con 0x7fe5b813df80 2023-11-24T08:08:36.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bf431640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81e5a10 con 0x7fe5b813e360 2023-11-24T08:08:36.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bd1cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bd1cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40450/0 (socket says 172.21.15.97:40450) 2023-11-24T08:08:36.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bd1cd640 1 -- 172.21.15.97:0/2395163626 learned_addr learned my addr 172.21.15.97:0/2395163626 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:36.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bd9ce640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5b813e360 0x7fe5b815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bd1cd640 1 -- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5b813e360 msgr2=0x7fe5b815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.321+0000 7fe5bc9cc640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b813df80 0x7fe5b813d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bd1cd640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5b813e360 0x7fe5b815d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bd1cd640 1 -- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b813df80 msgr2=0x7fe5b813d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bd1cd640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b813df80 0x7fe5b813d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bd1cd640 1 -- 172.21.15.97:0/2395163626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009a70 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bc9cc640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b813df80 0x7fe5b813d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:36.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bd1cd640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80b3eb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400d800 tx=0x7fe5b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:36.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5adffb640 1 -- 172.21.15.97:0/2395163626 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400b6c0 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5adffb640 1 -- 172.21.15.97:0/2395163626 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400b820 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5adffb640 1 -- 172.21.15.97:0/2395163626 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400bbb0 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b81e5cf0 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.322+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b81e5390 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.323+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b80675d0 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.324+0000 7fe5adffb640 1 -- 172.21.15.97:0/2395163626 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5b400bd10 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.325+0000 7fe5adffb640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe59c06ae40 0x7fe59c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.325+0000 7fe5adffb640 1 -- 172.21.15.97:0/2395163626 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5b4089950 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.325+0000 7fe5bc9cc640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe59c06ae40 0x7fe59c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.326+0000 7fe5bc9cc640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe59c06ae40 0x7fe59c06d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe5b815ad40 tx=0x7fe5a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:36.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.329+0000 7fe5adffb640 1 -- 172.21.15.97:0/2395163626 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5b4054c60 con 0x7fe5b80cf9a0 2023-11-24T08:08:36.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.519+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5b81e5b80 con 0x7fe59c06ae40 2023-11-24T08:08:36.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.525+0000 7fe5adffb640 1 -- 172.21.15.97:0/2395163626 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49167 (secure 0 0 0) 0x7fe5b81e5b80 con 0x7fe59c06ae40 2023-11-24T08:08:36.528 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:36.529 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:08:36.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe59c06ae40 msgr2=0x7fe59c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe59c06ae40 0x7fe59c06d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe5b815ad40 tx=0x7fe5a8009040 comp rx=0 tx=0).stop 2023-11-24T08:08:36.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 msgr2=0x7fe5b80b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80b3eb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400d800 tx=0x7fe5b400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 shutdown_connections 2023-11-24T08:08:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe59c06ae40 0x7fe59c06d300 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5b813e360 0x7fe5b815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5b813df80 0x7fe5b813d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.527+0000 7fe5bf431640 1 --2- 172.21.15.97:0/2395163626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5b80cf9a0 0x7fe5b80b3eb0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.528+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 >> 172.21.15.97:0/2395163626 conn(0x7fe5b806a800 msgr2=0x7fe5b80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.528+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 shutdown_connections 2023-11-24T08:08:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.528+0000 7fe5bf431640 1 -- 172.21.15.97:0/2395163626 wait complete. 2023-11-24T08:08:36.549 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-11-24T08:08:35.302041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224908,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749812,"statfs":{"total":773094113280,"available":772863807488,"internally_reserved":0,"allocated":4694016,"data_stored":2558328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002094"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:08:29.309364+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:08:29.309364+0000","last_peered":"2023-11-24T08:08:29.309364+0000","last_clean":"2023-11-24T08:08:29.309364+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:08:29.309364+0000","last_undegraded":"2023-11-24T08:08:29.309364+0000","last_fullsized":"2023-11-24T08:08:29.309364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1359999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1830000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.478},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0780000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.367},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.55}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6599999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.732},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":1.4039999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.304},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.7270000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.417}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.206},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.609}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.661}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.464},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0579999999999998,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.385}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.391},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.272}]},{"osd":2,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.429}]},{"osd":3,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.48},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5229999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.5620000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.026},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.617}]},{"osd":7,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.3380000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2629999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4379999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5099999999999998,"5min":3.5099999999999998,"15min":3.5099999999999998},"last":0.995},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.329}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.498}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.611}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.04}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.448}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.171}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.482},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.542}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.3740000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.335},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.28}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":1.075}]},{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.375},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.2909999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.492},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.6240000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.536},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.675}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.319}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":1.585}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.624},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.139}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.099}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.427},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1659999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.3939999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.169}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.095},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.399}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.359},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.3759999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:36.550 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:08:36.551 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:36.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.765+0000 7f9250f33640 1 Processor -- start 2023-11-24T08:08:36.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.765+0000 7f9250f33640 1 -- start start 2023-11-24T08:08:36.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.767+0000 7f9250f33640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f924c13e360 0x7f924c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.767+0000 7f9250f33640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c15c5f0 con 0x7f924c13df80 2023-11-24T08:08:36.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.767+0000 7f9250f33640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c06c470 con 0x7f924c15f9c0 2023-11-24T08:08:36.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.767+0000 7f9250f33640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c06c750 con 0x7f924c13e360 2023-11-24T08:08:36.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.767+0000 7f9241d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f924c13e360 0x7f924c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.767+0000 7f924a59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f924c13df80 0x7f924c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33878/0 (socket says 172.21.15.97:33878) 2023-11-24T08:08:36.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.767+0000 7f924a59c640 1 -- 172.21.15.97:0/470925120 learned_addr learned my addr 172.21.15.97:0/470925120 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:36.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.768+0000 7f9241d9b640 1 -- 172.21.15.97:0/470925120 >> v1:172.21.15.183:6789/0 conn(0x7f924c15f9c0 legacy=0x7f924c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:36.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.768+0000 7f9241d9b640 1 -- 172.21.15.97:0/470925120 >> v1:172.21.15.97:6789/0 conn(0x7f924c13df80 legacy=0x7f924c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.768+0000 7f9249d9b640 1 -- 172.21.15.97:0/470925120 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165247648 0 0) 0x7f924c15c5f0 con 0x7f924c13df80 2023-11-24T08:08:36.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.768+0000 7f9241d9b640 1 -- 172.21.15.97:0/470925120 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c06ca30 con 0x7f924c13e360 2023-11-24T08:08:36.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.769+0000 7f9241d9b640 1 --2- 172.21.15.97:0/470925120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c13e360 0x7f924c0cf290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9234009d90 tx=0x7f923402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815671129edb770f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.769+0000 7f9249d9b640 1 -- 172.21.15.97:0/470925120 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923402cc60 con 0x7f924c13e360 2023-11-24T08:08:36.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.769+0000 7f9249d9b640 1 -- 172.21.15.97:0/470925120 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923402cdc0 con 0x7f924c13e360 2023-11-24T08:08:36.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.769+0000 7f9249d9b640 1 -- 172.21.15.97:0/470925120 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234034660 con 0x7f924c13e360 2023-11-24T08:08:36.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.770+0000 7f9250f33640 1 -- 172.21.15.97:0/470925120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c13e360 msgr2=0x7f924c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.770+0000 7f9250f33640 1 --2- 172.21.15.97:0/470925120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c13e360 0x7f924c0cf290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9234009d90 tx=0x7f923402beb0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.770+0000 7f9250f33640 1 -- 172.21.15.97:0/470925120 shutdown_connections 2023-11-24T08:08:36.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.770+0000 7f9250f33640 1 --2- 172.21.15.97:0/470925120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c13e360 0x7f924c0cf290 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.770+0000 7f9250f33640 1 -- 172.21.15.97:0/470925120 >> 172.21.15.97:0/470925120 conn(0x7f924c06a800 msgr2=0x7f924c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:36.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.770+0000 7f9250f33640 1 -- 172.21.15.97:0/470925120 shutdown_connections 2023-11-24T08:08:36.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.770+0000 7f9250f33640 1 -- 172.21.15.97:0/470925120 wait complete. 2023-11-24T08:08:36.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.772+0000 7f9250f33640 1 Processor -- start 2023-11-24T08:08:36.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.772+0000 7f9250f33640 1 -- start start 2023-11-24T08:08:36.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f9250f33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f924c13df80 0x7f924c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f9250f33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f924c13e360 0x7f924c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f9250f33640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c15f9c0 0x7f924c0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f9250f33640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c150110 con 0x7f924c15f9c0 2023-11-24T08:08:36.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f9250f33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c1e9920 con 0x7f924c13df80 2023-11-24T08:08:36.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f9250f33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c1e8880 con 0x7f924c13e360 2023-11-24T08:08:36.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f924ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c15f9c0 0x7f924c0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f924ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c15f9c0 0x7f924c0b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40470/0 (socket says 172.21.15.97:40470) 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.773+0000 7f924ad9d640 1 -- 172.21.15.97:0/3159552894 learned_addr learned my addr 172.21.15.97:0/3159552894 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924a59c640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f924c13df80 0x7f924c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f9241d9b640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f924c13e360 0x7f924c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924ad9d640 1 -- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f924c13e360 msgr2=0x7f924c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924ad9d640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f924c13e360 0x7f924c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924ad9d640 1 -- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f924c13df80 msgr2=0x7f924c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924ad9d640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f924c13df80 0x7f924c14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924ad9d640 1 -- 172.21.15.97:0/3159552894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234009a70 con 0x7f924c15f9c0 2023-11-24T08:08:36.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924a59c640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f924c13df80 0x7f924c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:36.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f924ad9d640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c15f9c0 0x7f924c0b3230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f924400c3e0 tx=0x7f924400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:36.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f92437fe640 1 -- 172.21.15.97:0/3159552894 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244011790 con 0x7f924c15f9c0 2023-11-24T08:08:36.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f92437fe640 1 -- 172.21.15.97:0/3159552894 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92440118f0 con 0x7f924c15f9c0 2023-11-24T08:08:36.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f92437fe640 1 -- 172.21.15.97:0/3159552894 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244011ce0 con 0x7f924c15f9c0 2023-11-24T08:08:36.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c1e8b60 con 0x7f924c15f9c0 2023-11-24T08:08:36.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.774+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c1e9120 con 0x7f924c15f9c0 2023-11-24T08:08:36.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.776+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c0675d0 con 0x7f924c15f9c0 2023-11-24T08:08:36.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.777+0000 7f92437fe640 1 -- 172.21.15.97:0/3159552894 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f924401c460 con 0x7f924c15f9c0 2023-11-24T08:08:36.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.777+0000 7f92437fe640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f922c06ae40 0x7f922c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:36.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.778+0000 7f92437fe640 1 -- 172.21.15.97:0/3159552894 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9244089250 con 0x7f924c15f9c0 2023-11-24T08:08:36.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.778+0000 7f924a59c640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f922c06ae40 0x7f922c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:36.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.778+0000 7f924a59c640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f922c06ae40 0x7f922c06d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f923c000f60 tx=0x7f923c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:36.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.782+0000 7f92437fe640 1 -- 172.21.15.97:0/3159552894 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9244054570 con 0x7f924c15f9c0 2023-11-24T08:08:36.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.968+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f924c06cff0 con 0x7f922c06ae40 2023-11-24T08:08:36.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.972+0000 7f92437fe640 1 -- 172.21.15.97:0/3159552894 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49167 (secure 0 0 0) 0x7f923c001d70 con 0x7f922c06ae40 2023-11-24T08:08:36.975 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:36.975 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:08:36.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f922c06ae40 msgr2=0x7f922c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f922c06ae40 0x7f922c06d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f923c000f60 tx=0x7f923c009040 comp rx=0 tx=0).stop 2023-11-24T08:08:36.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c15f9c0 msgr2=0x7f924c0b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:36.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c15f9c0 0x7f924c0b3230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f924400c3e0 tx=0x7f924400c8a0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 shutdown_connections 2023-11-24T08:08:36.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f922c06ae40 0x7f922c06d300 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f924c15f9c0 0x7f924c0b3230 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f924c13e360 0x7f924c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 --2- 172.21.15.97:0/3159552894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f924c13df80 0x7f924c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:36.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.974+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 >> 172.21.15.97:0/3159552894 conn(0x7f924c06a800 msgr2=0x7f924c0705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:36.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.975+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 shutdown_connections 2023-11-24T08:08:36.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:36.975+0000 7f9250f33640 1 -- 172.21.15.97:0/3159552894 wait complete. 2023-11-24T08:08:36.995 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-11-24T08:08:35.302041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224908,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749812,"statfs":{"total":773094113280,"available":772863807488,"internally_reserved":0,"allocated":4694016,"data_stored":2558328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002094"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:08:29.309364+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:08:29.309364+0000","last_peered":"2023-11-24T08:08:29.309364+0000","last_clean":"2023-11-24T08:08:29.309364+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:08:29.309364+0000","last_undegraded":"2023-11-24T08:08:29.309364+0000","last_fullsized":"2023-11-24T08:08:29.309364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1359999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1830000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.478},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0780000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.367},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.55}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6599999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.732},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":1.4039999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.304},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.7270000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.145},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.417}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.206},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.609}]},{"osd":4,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.347}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.661}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.464},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":3.0579999999999998,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.385}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.391},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.272}]},{"osd":2,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.429}]},{"osd":3,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.48},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5229999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.5620000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.026},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.617}]},{"osd":7,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.3380000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2629999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4379999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5099999999999998,"5min":3.5099999999999998,"15min":3.5099999999999998},"last":0.995},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.329}]},{"osd":6,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.498}]},{"osd":7,"last update":"Fri Nov 24 08:07:35 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.611}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.04}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.448}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.171}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.482},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.542}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.3740000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.335},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.28}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":1.075}]},{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.375},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.2909999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.492},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.0030000000000001,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.6240000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.536},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.675}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.319}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":1.585}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.624},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.139}]},{"osd":5,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.099}]},{"osd":6,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.0569999999999999,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.427},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1659999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:34 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.3939999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.169}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.095},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.399}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.359},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.3759999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:36.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:08:37.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.208+0000 7f5846347640 1 Processor -- start 2023-11-24T08:08:37.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.208+0000 7f5846347640 1 -- start start 2023-11-24T08:08:37.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5846347640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58400cc500 0x7f58400cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:37.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5846347640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f584006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:37.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5846347640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5840070e50 con 0x7f5840143c40 2023-11-24T08:08:37.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5846347640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58400723c0 con 0x7f58400cc500 2023-11-24T08:08:37.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5846347640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58400cced0 con 0x7f584006d160 2023-11-24T08:08:37.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5844b44640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58400cc500 0x7f58400cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5844b44640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58400cc500 0x7f58400cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40486/0 (socket says 172.21.15.97:40486) 2023-11-24T08:08:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5844b44640 1 -- 172.21.15.97:0/2063217205 learned_addr learned my addr 172.21.15.97:0/2063217205 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.210+0000 7f5845345640 1 --1- 172.21.15.97:0/2063217205 >> v1:172.21.15.97:6789/0 conn(0x7f5840143c40 0x7f5840071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33884/0 (socket says 172.21.15.97:33884) 2023-11-24T08:08:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.211+0000 7f5845b46640 1 --2- 172.21.15.97:0/2063217205 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f584006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.211+0000 7f5844b44640 1 -- 172.21.15.97:0/2063217205 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 msgr2=0x7f584006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.211+0000 7f5844b44640 1 --2- 172.21.15.97:0/2063217205 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f584006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.211+0000 7f5844b44640 1 -- 172.21.15.97:0/2063217205 >> v1:172.21.15.97:6789/0 conn(0x7f5840143c40 legacy=0x7f5840071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.211+0000 7f5844b44640 1 -- 172.21.15.97:0/2063217205 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840144020 con 0x7f58400cc500 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.211+0000 7f5837fff640 1 -- 172.21.15.97:0/2063217205 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377507812 0 0) 0x7f5840070e50 con 0x7f5840143c40 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.211+0000 7f5845b46640 1 --2- 172.21.15.97:0/2063217205 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f584006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.212+0000 7f5844b44640 1 --2- 172.21.15.97:0/2063217205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cc500 0x7f58400cc990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5830009870 tx=0x7f583002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e66beaddd468922 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.212+0000 7f5837fff640 1 -- 172.21.15.97:0/2063217205 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830031640 con 0x7f58400cc500 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.212+0000 7f5837fff640 1 -- 172.21.15.97:0/2063217205 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58300317a0 con 0x7f58400cc500 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.212+0000 7f5837fff640 1 -- 172.21.15.97:0/2063217205 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830031b30 con 0x7f58400cc500 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 -- 172.21.15.97:0/2063217205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cc500 msgr2=0x7f58400cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:37.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 --2- 172.21.15.97:0/2063217205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cc500 0x7f58400cc990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5830009870 tx=0x7f583002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 -- 172.21.15.97:0/2063217205 shutdown_connections 2023-11-24T08:08:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 --2- 172.21.15.97:0/2063217205 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f584006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 --2- 172.21.15.97:0/2063217205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58400cc500 0x7f58400cc990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 -- 172.21.15.97:0/2063217205 >> 172.21.15.97:0/2063217205 conn(0x7f584006a800 msgr2=0x7f584006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 -- 172.21.15.97:0/2063217205 shutdown_connections 2023-11-24T08:08:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.213+0000 7f5846347640 1 -- 172.21.15.97:0/2063217205 wait complete. 2023-11-24T08:08:37.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.215+0000 7f5846347640 1 Processor -- start 2023-11-24T08:08:37.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.215+0000 7f5846347640 1 -- start start 2023-11-24T08:08:37.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5846347640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f58400b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:37.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5846347640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58400cc500 0x7f584013c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:37.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5846347640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5840143c40 0x7f584013c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:37.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5846347640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58400c47b0 con 0x7f5840143c40 2023-11-24T08:08:37.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5846347640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584013ef90 con 0x7f58400cc500 2023-11-24T08:08:37.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5846347640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58400c3e10 con 0x7f584006d160 2023-11-24T08:08:37.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5845b46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5840143c40 0x7f584013c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5845b46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5840143c40 0x7f584013c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40498/0 (socket says 172.21.15.97:40498) 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5845b46640 1 -- 172.21.15.97:0/1402572404 learned_addr learned my addr 172.21.15.97:0/1402572404 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5844b44640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58400cc500 0x7f584013c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5845345640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f58400b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5845b46640 1 -- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 msgr2=0x7f58400b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5845b46640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f58400b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.216+0000 7f5845b46640 1 -- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58400cc500 msgr2=0x7f584013c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:37.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5845b46640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58400cc500 0x7f584013c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5845b46640 1 -- 172.21.15.97:0/1402572404 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300094d0 con 0x7f5840143c40 2023-11-24T08:08:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5844b44640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58400cc500 0x7f584013c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5845345640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f58400b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5845b46640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5840143c40 0x7f584013c7b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f583800cef0 tx=0x7f583800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5835ffb640 1 -- 172.21.15.97:0/1402572404 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800d840 con 0x7f5840143c40 2023-11-24T08:08:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5835ffb640 1 -- 172.21.15.97:0/1402572404 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583800d9c0 con 0x7f5840143c40 2023-11-24T08:08:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5835ffb640 1 -- 172.21.15.97:0/1402572404 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800dd70 con 0x7f5840143c40 2023-11-24T08:08:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58400c40f0 con 0x7f5840143c40 2023-11-24T08:08:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.217+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58400b3390 con 0x7f5840143c40 2023-11-24T08:08:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.218+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58400c48f0 con 0x7f5840143c40 2023-11-24T08:08:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.219+0000 7f5835ffb640 1 -- 172.21.15.97:0/1402572404 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f583801e3b0 con 0x7f5840143c40 2023-11-24T08:08:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.220+0000 7f5835ffb640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f582406ae40 0x7f582406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.220+0000 7f5835ffb640 1 -- 172.21.15.97:0/1402572404 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5838089e90 con 0x7f5840143c40 2023-11-24T08:08:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.220+0000 7f5845345640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f582406ae40 0x7f582406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.221+0000 7f5845345640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f582406ae40 0x7f582406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f583c000f60 tx=0x7f583c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:37.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.225+0000 7f5835ffb640 1 -- 172.21.15.97:0/1402572404 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58400c48f0 con 0x7f5840143c40 2023-11-24T08:08:37.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.419+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58400c48f0 con 0x7f5840143c40 2023-11-24T08:08:37.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.420+0000 7f5835ffb640 1 -- 172.21.15.97:0/1402572404 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+12986 (secure 0 0 0) 0x7f58400c48f0 con 0x7f5840143c40 2023-11-24T08:08:37.423 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:37.423 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":38,"fsid":"bcc30232-58ca-4ca3-86d0-71be2a8a6471","created":"2023-11-24T08:06:22.323269+0000","modified":"2023-11-24T08:08:30.128509+0000","last_up_change":"2023-11-24T08:06:34.217142+0000","last_in_change":"2023-11-24T08:06:25.807374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:06:35.332785+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05f88460-1812-46e4-8211-b9a58577f862","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6809","nonce":1087850663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6811","nonce":1087850663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6815","nonce":1087850663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1087850663},{"type":"v1","addr":"172.21.15.97:6813","nonce":1087850663}]},"public_addr":"172.21.15.97:6809/1087850663","cluster_addr":"172.21.15.97:6811/1087850663","heartbeat_back_addr":"172.21.15.97:6815/1087850663","heartbeat_front_addr":"172.21.15.97:6813/1087850663","state":["exists","up"]},{"osd":1,"uuid":"8d28ab52-43c9-4d73-9b9c-657a944e4655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6801","nonce":2437632405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6803","nonce":2437632405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6807","nonce":2437632405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2437632405},{"type":"v1","addr":"172.21.15.97:6805","nonce":2437632405}]},"public_addr":"172.21.15.97:6801/2437632405","cluster_addr":"172.21.15.97:6803/2437632405","heartbeat_back_addr":"172.21.15.97:6807/2437632405","heartbeat_front_addr":"172.21.15.97:6805/2437632405","state":["exists","up"]},{"osd":2,"uuid":"dcd3d758-4f3e-406f-81f3-6b23892a26d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6817","nonce":2868474403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6819","nonce":2868474403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6823","nonce":2868474403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2868474403},{"type":"v1","addr":"172.21.15.97:6821","nonce":2868474403}]},"public_addr":"172.21.15.97:6817/2868474403","cluster_addr":"172.21.15.97:6819/2868474403","heartbeat_back_addr":"172.21.15.97:6823/2868474403","heartbeat_front_addr":"172.21.15.97:6821/2868474403","state":["exists","up"]},{"osd":3,"uuid":"9331e8e6-c5fe-4633-8e9e-87442adf70ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6825","nonce":1194273011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6827","nonce":1194273011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6831","nonce":1194273011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1194273011},{"type":"v1","addr":"172.21.15.97:6829","nonce":1194273011}]},"public_addr":"172.21.15.97:6825/1194273011","cluster_addr":"172.21.15.97:6827/1194273011","heartbeat_back_addr":"172.21.15.97:6831/1194273011","heartbeat_front_addr":"172.21.15.97:6829/1194273011","state":["exists","up"]},{"osd":4,"uuid":"3367d2f7-5bf7-4236-93ad-56c480dba2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6801","nonce":1731286381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6803","nonce":1731286381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6807","nonce":1731286381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":1731286381},{"type":"v1","addr":"172.21.15.183:6805","nonce":1731286381}]},"public_addr":"172.21.15.183:6801/1731286381","cluster_addr":"172.21.15.183:6803/1731286381","heartbeat_back_addr":"172.21.15.183:6807/1731286381","heartbeat_front_addr":"172.21.15.183:6805/1731286381","state":["exists","up"]},{"osd":5,"uuid":"a21f3456-2ae2-4304-8f08-1cba93ad2e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6817","nonce":3585625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6821","nonce":3585625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6827","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6829","nonce":3585625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":3585625163},{"type":"v1","addr":"172.21.15.183:6825","nonce":3585625163}]},"public_addr":"172.21.15.183:6817/3585625163","cluster_addr":"172.21.15.183:6821/3585625163","heartbeat_back_addr":"172.21.15.183:6829/3585625163","heartbeat_front_addr":"172.21.15.183:6825/3585625163","state":["exists","up"]},{"osd":6,"uuid":"95dfafb5-84b2-4680-906c-fdb99aba144c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6820","nonce":553932600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6824","nonce":553932600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6831","nonce":553932600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":553932600},{"type":"v1","addr":"172.21.15.183:6828","nonce":553932600}]},"public_addr":"172.21.15.183:6820/553932600","cluster_addr":"172.21.15.183:6824/553932600","heartbeat_back_addr":"172.21.15.183:6831/553932600","heartbeat_front_addr":"172.21.15.183:6828/553932600","state":["exists","up"]},{"osd":7,"uuid":"6731ed00-f858-42ec-ad53-1d31d1b20790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6809","nonce":1489077381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6811","nonce":1489077381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6815","nonce":1489077381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1489077381},{"type":"v1","addr":"172.21.15.183:6813","nonce":1489077381}]},"public_addr":"172.21.15.183:6809/1489077381","cluster_addr":"172.21.15.183:6811/1489077381","heartbeat_back_addr":"172.21.15.183:6815/1489077381","heartbeat_front_addr":"172.21.15.183:6813/1489077381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.308576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.014470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.132780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.169079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.115445+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.195658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.202595+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:06:31.133293+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/4116734497":"2023-11-25T08:08:26.845147+0000","172.21.15.97:6834/4116734497":"2023-11-25T08:08:26.845147+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:08:37.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.422+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f582406ae40 msgr2=0x7f582406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.422+0000 7f5846347640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f582406ae40 0x7f582406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f583c000f60 tx=0x7f583c009040 comp rx=0 tx=0).stop 2023-11-24T08:08:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.422+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5840143c40 msgr2=0x7f584013c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.422+0000 7f5846347640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5840143c40 0x7f584013c7b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f583800cef0 tx=0x7f583800a710 comp rx=0 tx=0).stop 2023-11-24T08:08:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 shutdown_connections 2023-11-24T08:08:37.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f582406ae40 0x7f582406d300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5840143c40 0x7f584013c7b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58400cc500 0x7f584013c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 --2- 172.21.15.97:0/1402572404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f584006d160 0x7f58400b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:37.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 >> 172.21.15.97:0/1402572404 conn(0x7f584006a800 msgr2=0x7f5840071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:37.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 shutdown_connections 2023-11-24T08:08:37.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:37.423+0000 7f5846347640 1 -- 172.21.15.97:0/1402572404 wait complete. 2023-11-24T08:08:38.445 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T08:08:38.446 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:38.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.672+0000 7fbab2090640 1 Processor -- start 2023-11-24T08:08:38.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.672+0000 7fbab2090640 1 -- start start 2023-11-24T08:08:38.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.674+0000 7fbab2090640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbaac0ae5a0 0x7fbaac15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.674+0000 7fbab2090640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbaac0cf290 0x7fbaac0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.674+0000 7fbab2090640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac070c40 con 0x7fbaac0b3ae0 2023-11-24T08:08:38.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.674+0000 7fbab2090640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac071450 con 0x7fbaac0cf290 2023-11-24T08:08:38.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.674+0000 7fbab2090640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac0cfc60 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.674+0000 7fbaabfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbaac0cf290 0x7fbaac0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.674+0000 7fbaabfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbaac0cf290 0x7fbaac0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40512/0 (socket says 172.21.15.97:40512) 2023-11-24T08:08:38.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.675+0000 7fbaabfff640 1 -- 172.21.15.97:0/2649134745 learned_addr learned my addr 172.21.15.97:0/2649134745 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.675+0000 7fbaab7fe640 1 --2- 172.21.15.97:0/2649134745 >> v2:172.21.15.183:3300/0 conn(0x7fbaac0ae5a0 0x7fbaac15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.675+0000 7fbaabfff640 1 -- 172.21.15.97:0/2649134745 >> v2:172.21.15.183:3300/0 conn(0x7fbaac0ae5a0 msgr2=0x7fbaac15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.675+0000 7fbaabfff640 1 --2- 172.21.15.97:0/2649134745 >> v2:172.21.15.183:3300/0 conn(0x7fbaac0ae5a0 0x7fbaac15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.675+0000 7fbaabfff640 1 -- 172.21.15.97:0/2649134745 >> v1:172.21.15.183:6789/0 conn(0x7fbaac0b3ae0 legacy=0x7fbaac06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.675+0000 7fbaabfff640 1 -- 172.21.15.97:0/2649134745 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac06c470 con 0x7fbaac0cf290 2023-11-24T08:08:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.676+0000 7fbaabfff640 1 --2- 172.21.15.97:0/2649134745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0cf290 0x7fbaac0cf720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0cfe20 tx=0x7fbaa402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f43111d9b5df84 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:38.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.676+0000 7fbaaa7fc640 1 -- 172.21.15.97:0/2649134745 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa402cbb0 con 0x7fbaac0cf290 2023-11-24T08:08:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.676+0000 7fbaaa7fc640 1 -- 172.21.15.97:0/2649134745 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa402cd10 con 0x7fbaac0cf290 2023-11-24T08:08:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.676+0000 7fbaaa7fc640 1 -- 172.21.15.97:0/2649134745 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4034610 con 0x7fbaac0cf290 2023-11-24T08:08:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 -- 172.21.15.97:0/2649134745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0cf290 msgr2=0x7fbaac0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 --2- 172.21.15.97:0/2649134745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0cf290 0x7fbaac0cf720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0cfe20 tx=0x7fbaa402c010 comp rx=0 tx=0).stop 2023-11-24T08:08:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 -- 172.21.15.97:0/2649134745 shutdown_connections 2023-11-24T08:08:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 --2- 172.21.15.97:0/2649134745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0cf290 0x7fbaac0cf720 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 --2- 172.21.15.97:0/2649134745 >> v2:172.21.15.183:3300/0 conn(0x7fbaac0ae5a0 0x7fbaac15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 -- 172.21.15.97:0/2649134745 >> 172.21.15.97:0/2649134745 conn(0x7fbaac06a800 msgr2=0x7fbaac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:38.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 -- 172.21.15.97:0/2649134745 shutdown_connections 2023-11-24T08:08:38.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.677+0000 7fbab2090640 1 -- 172.21.15.97:0/2649134745 wait complete. 2023-11-24T08:08:38.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.679+0000 7fbab2090640 1 Processor -- start 2023-11-24T08:08:38.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.679+0000 7fbab2090640 1 -- start start 2023-11-24T08:08:38.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbab2090640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0ae5a0 0x7fbaac1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbab2090640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac0b3ae0 0x7fbaac1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbab2090640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaac0cf290 0x7fbaac15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbab2090640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac14e120 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbab2090640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac14f800 con 0x7fbaac0b3ae0 2023-11-24T08:08:38.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbab2090640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac158e00 con 0x7fbaac0cf290 2023-11-24T08:08:38.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbaab7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0ae5a0 0x7fbaac1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbaab7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0ae5a0 0x7fbaac1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40524/0 (socket says 172.21.15.97:40524) 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.680+0000 7fbaab7fe640 1 -- 172.21.15.97:0/953691127 learned_addr learned my addr 172.21.15.97:0/953691127 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaabfff640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaac0cf290 0x7fbaac15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaaaffd640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac0b3ae0 0x7fbaac1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaab7fe640 1 -- 172.21.15.97:0/953691127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaac0cf290 msgr2=0x7fbaac15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaab7fe640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaac0cf290 0x7fbaac15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaab7fe640 1 -- 172.21.15.97:0/953691127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac0b3ae0 msgr2=0x7fbaac1492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaab7fe640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbaac0b3ae0 0x7fbaac1492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaab7fe640 1 -- 172.21.15.97:0/953691127 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4009b30 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbaab7fe640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0ae5a0 0x7fbaac1587d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00d800 tx=0x7fba9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:38.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00b6c0 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c00b820 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00bbb0 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.681+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac1f5f90 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.682+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac1f6550 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.682+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbaac071170 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.683+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba9c00bd10 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.684+0000 7fba93fff640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fba9806ae90 0x7fba9806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.684+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba9c0898d0 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.685+0000 7fba93fff640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7fba98070cf0 0x7fba98073110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.685+0000 7fbaaaffd640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fba9806ae90 0x7fba9806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.685+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 --> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba980737c0 con 0x7fba98070cf0 2023-11-24T08:08:38.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.685+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba9c08e2a0 con 0x7fbaac0ae5a0 2023-11-24T08:08:38.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.685+0000 7fbaabfff640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7fba98070cf0 0x7fba98073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.685+0000 7fbaaaffd640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fba9806ae90 0x7fba9806d350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbaac15d2e0 tx=0x7fbaa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:38.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.685+0000 7fbaabfff640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7fba98070cf0 0x7fba98073110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:38.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.686+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== osd.0 v2:172.21.15.97:6808/1087850663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fba980737c0 con 0x7fba98070cf0 2023-11-24T08:08:38.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 --> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbaac06c750 con 0x7fba98070cf0 2023-11-24T08:08:38.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fba93fff640 1 -- 172.21.15.97:0/953691127 <== osd.0 v2:172.21.15.97:6808/1087850663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbaa402cb60 con 0x7fba98070cf0 2023-11-24T08:08:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:38.704 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7fba98070cf0 msgr2=0x7fba98073110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fbab2090640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6808/1087850663,v1:172.21.15.97:6809/1087850663] conn(0x7fba98070cf0 0x7fba98073110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fba9806ae90 msgr2=0x7fba9806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fbab2090640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fba9806ae90 0x7fba9806d350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbaac15d2e0 tx=0x7fbaa0009040 comp rx=0 tx=0).stop 2023-11-24T08:08:38.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0ae5a0 msgr2=0x7fbaac1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.701+0000 7fbab2090640 1 --2- 172.21.15.97:0/953691127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaac0ae5a0 0x7fbaac1587d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00d800 tx=0x7fba9c00dcc0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.702+0000 7fbaabfff640 1 -- 172.21.15.97:0/953691127 reap_dead start 2023-11-24T08:08:38.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.702+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 shutdown_connections 2023-11-24T08:08:38.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.702+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 >> 172.21.15.97:0/953691127 conn(0x7fbaac06a800 msgr2=0x7fbaac0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:38.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.702+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 shutdown_connections 2023-11-24T08:08:38.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.702+0000 7fbab2090640 1 -- 172.21.15.97:0/953691127 wait complete. 2023-11-24T08:08:38.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T08:08:38.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.927+0000 7f6ff4875640 1 Processor -- start 2023-11-24T08:08:38.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.928+0000 7f6ff4875640 1 -- start start 2023-11-24T08:08:38.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6ff4875640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ff013df80 0x7f6ff015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6ff4875640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6ff013e360 0x7f6ff00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6ff4875640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff006c470 con 0x7f6ff015f9c0 2023-11-24T08:08:38.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6ff4875640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff006c750 con 0x7f6ff013df80 2023-11-24T08:08:38.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6ff4875640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff006ca30 con 0x7f6ff013e360 2023-11-24T08:08:38.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6fee59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ff013df80 0x7f6ff015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6feed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6ff015f9c0 0x7f6ff01408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33890/0 (socket says 172.21.15.97:33890) 2023-11-24T08:08:38.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6feed9d640 1 -- 172.21.15.97:0/1339832312 learned_addr learned my addr 172.21.15.97:0/1339832312 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:38.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.929+0000 7f6fedd9b640 1 --2- 172.21.15.97:0/1339832312 >> v2:172.21.15.183:3300/0 conn(0x7f6ff013e360 0x7f6ff00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.930+0000 7f6fed59a640 1 -- 172.21.15.97:0/1339832312 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784983755 0 0) 0x7f6ff006c470 con 0x7f6ff015f9c0 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.930+0000 7f6fee59c640 1 -- 172.21.15.97:0/1339832312 >> v2:172.21.15.183:3300/0 conn(0x7f6ff013e360 msgr2=0x7f6ff00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.930+0000 7f6fee59c640 1 --2- 172.21.15.97:0/1339832312 >> v2:172.21.15.183:3300/0 conn(0x7f6ff013e360 0x7f6ff00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.930+0000 7f6fee59c640 1 -- 172.21.15.97:0/1339832312 >> v1:172.21.15.97:6789/0 conn(0x7f6ff015f9c0 legacy=0x7f6ff01408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.930+0000 7f6fee59c640 1 -- 172.21.15.97:0/1339832312 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff006cd10 con 0x7f6ff013df80 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.931+0000 7f6fee59c640 1 --2- 172.21.15.97:0/1339832312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff013df80 0x7f6ff015bee0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6ff006ded0 tx=0x7f6fe002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bb104835693f75 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.931+0000 7f6fed59a640 1 -- 172.21.15.97:0/1339832312 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe002cc70 con 0x7f6ff013df80 2023-11-24T08:08:38.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.931+0000 7f6fed59a640 1 -- 172.21.15.97:0/1339832312 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe002cdd0 con 0x7f6ff013df80 2023-11-24T08:08:38.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.931+0000 7f6fed59a640 1 -- 172.21.15.97:0/1339832312 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0034660 con 0x7f6ff013df80 2023-11-24T08:08:38.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 -- 172.21.15.97:0/1339832312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff013df80 msgr2=0x7f6ff015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 --2- 172.21.15.97:0/1339832312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff013df80 0x7f6ff015bee0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6ff006ded0 tx=0x7f6fe002bec0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 -- 172.21.15.97:0/1339832312 shutdown_connections 2023-11-24T08:08:38.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 --2- 172.21.15.97:0/1339832312 >> v2:172.21.15.183:3300/0 conn(0x7f6ff013e360 0x7f6ff00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 --2- 172.21.15.97:0/1339832312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff013df80 0x7f6ff015bee0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 -- 172.21.15.97:0/1339832312 >> 172.21.15.97:0/1339832312 conn(0x7f6ff006a800 msgr2=0x7f6ff006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:38.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 -- 172.21.15.97:0/1339832312 shutdown_connections 2023-11-24T08:08:38.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.932+0000 7f6ff4875640 1 -- 172.21.15.97:0/1339832312 wait complete. 2023-11-24T08:08:38.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.933+0000 7f6ff4875640 1 Processor -- start 2023-11-24T08:08:38.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.934+0000 7f6ff4875640 1 -- start start 2023-11-24T08:08:38.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.934+0000 7f6ff4875640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff013df80 0x7f6ff01f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.934+0000 7f6ff4875640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff013e360 0x7f6ff0151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.934+0000 7f6ff4875640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff015f9c0 0x7f6ff01319c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.934+0000 7f6ff4875640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff014fb30 con 0x7f6ff015f9c0 2023-11-24T08:08:38.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.934+0000 7f6ff4875640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00b32b0 con 0x7f6ff013df80 2023-11-24T08:08:38.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.934+0000 7f6ff4875640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00b3590 con 0x7f6ff013e360 2023-11-24T08:08:38.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff015f9c0 0x7f6ff01319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff015f9c0 0x7f6ff01319c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40540/0 (socket says 172.21.15.97:40540) 2023-11-24T08:08:38.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 -- 172.21.15.97:0/611744317 learned_addr learned my addr 172.21.15.97:0/611744317 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:38.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 -- 172.21.15.97:0/611744317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff013e360 msgr2=0x7f6ff0151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff013e360 0x7f6ff0151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 -- 172.21.15.97:0/611744317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff013df80 msgr2=0x7f6ff01f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff013df80 0x7f6ff01f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 -- 172.21.15.97:0/611744317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009a70 con 0x7f6ff015f9c0 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.935+0000 7f6feed9d640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff015f9c0 0x7f6ff01319c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c430 tx=0x7f6fe800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.936+0000 7f6fe6ffd640 1 -- 172.21.15.97:0/611744317 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80074e0 con 0x7f6ff015f9c0 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.936+0000 7f6fe6ffd640 1 -- 172.21.15.97:0/611744317 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe8007660 con 0x7f6ff015f9c0 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.936+0000 7f6fe6ffd640 1 -- 172.21.15.97:0/611744317 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8004a20 con 0x7f6ff015f9c0 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.936+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff00b3870 con 0x7f6ff015f9c0 2023-11-24T08:08:38.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.936+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff00b3b50 con 0x7f6ff015f9c0 2023-11-24T08:08:38.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.937+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff01316e0 con 0x7f6ff015f9c0 2023-11-24T08:08:38.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.938+0000 7f6fe6ffd640 1 -- 172.21.15.97:0/611744317 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6fe8004b80 con 0x7f6ff015f9c0 2023-11-24T08:08:38.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.939+0000 7f6fe6ffd640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6fd006ae40 0x7f6fd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:38.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.939+0000 7f6fe6ffd640 1 -- 172.21.15.97:0/611744317 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6fe8089130 con 0x7f6ff015f9c0 2023-11-24T08:08:38.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.939+0000 7f6fee59c640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6fd006ae40 0x7f6fd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:38.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.940+0000 7f6fee59c640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6fd006ae40 0x7f6fd006d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0036000 tx=0x7f6fe002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:38.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:38.943+0000 7f6fe6ffd640 1 -- 172.21.15.97:0/611744317 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ff01316e0 con 0x7f6ff015f9c0 2023-11-24T08:08:39.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.132+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ff00ce850 con 0x7f6fd006ae40 2023-11-24T08:08:39.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.133+0000 7f6fe6ffd640 1 -- 172.21.15.97:0/611744317 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6fe002ca70 con 0x7f6fd006ae40 2023-11-24T08:08:39.136 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T08:08:39.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6fd006ae40 msgr2=0x7f6fd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6fd006ae40 0x7f6fd006d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0036000 tx=0x7f6fe002e000 comp rx=0 tx=0).stop 2023-11-24T08:08:39.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff015f9c0 msgr2=0x7f6ff01319c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff015f9c0 0x7f6ff01319c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c430 tx=0x7f6fe800c8f0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 shutdown_connections 2023-11-24T08:08:39.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6fd006ae40 0x7f6fd006d300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ff015f9c0 0x7f6ff01319c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff013e360 0x7f6ff0151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 --2- 172.21.15.97:0/611744317 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff013df80 0x7f6ff01f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 >> 172.21.15.97:0/611744317 conn(0x7f6ff006a800 msgr2=0x7f6ff00b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:39.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 shutdown_connections 2023-11-24T08:08:39.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.136+0000 7f6ff4875640 1 -- 172.21.15.97:0/611744317 wait complete. 2023-11-24T08:08:39.158 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T08:08:39.158 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:39.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.373+0000 7f70f359e640 1 Processor -- start 2023-11-24T08:08:39.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.373+0000 7f70f359e640 1 -- start start 2023-11-24T08:08:39.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.374+0000 7f70f359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f415a120 0x7f70f40ad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.374+0000 7f70f359e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f415a500 con 0x7f70f4071870 2023-11-24T08:08:39.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.374+0000 7f70f359e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f406f020 con 0x7f70f406e360 2023-11-24T08:08:39.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.375+0000 7f70f359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40add60 con 0x7f70f415a120 2023-11-24T08:08:39.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.375+0000 7f70f2d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f70f4071870 0x7f70f40b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33900/0 (socket says 172.21.15.97:33900) 2023-11-24T08:08:39.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.375+0000 7f70f2d9d640 1 -- 172.21.15.97:0/201085279 learned_addr learned my addr 172.21.15.97:0/201085279 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:39.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.375+0000 7f70f259c640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f415a120 0x7f70f40ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.375+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754198718 0 0) 0x7f70ec001490 con 0x7f70f4071870 2023-11-24T08:08:39.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.375+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0005730 con 0x7f70f4071870 2023-11-24T08:08:39.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2786362908 0 0) 0x7f70e0005730 con 0x7f70f4071870 2023-11-24T08:08:39.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f415a120 msgr2=0x7f70f40ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:39.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f415a120 0x7f70f40ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 >> v1:172.21.15.183:6789/0 conn(0x7f70f406e360 legacy=0x7f70f4071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f406ed40 con 0x7f70f4071870 2023-11-24T08:08:39.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f70ec001b80 con 0x7f70f4071870 2023-11-24T08:08:39.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 >> v1:172.21.15.97:6789/0 conn(0x7f70f4071870 legacy=0x7f70f40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70e0005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00069d0 0x7f70e0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f415a120 0x7f70e0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40add60 con 0x7f70e0005bb0 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000dc40 con 0x7f70e00069d0 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e000de00 con 0x7f70f415a120 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f259c640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70e0005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f259c640 1 -- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f415a120 msgr2=0x7f70e0007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f259c640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f415a120 0x7f70e0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f259c640 1 -- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00069d0 msgr2=0x7f70e0006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:39.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f259c640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00069d0 0x7f70e0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.376+0000 7f70f259c640 1 -- 172.21.15.97:0/201085279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0005730 con 0x7f70e0005bb0 2023-11-24T08:08:39.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.377+0000 7f70f259c640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70e0005fd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009a90 tx=0x7f70e0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d773ed4c19f3e975 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:39.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e402c6b0 con 0x7f70e0005bb0 2023-11-24T08:08:39.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e402c810 con 0x7f70e0005bb0 2023-11-24T08:08:39.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f1d9b640 1 -- 172.21.15.97:0/201085279 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e402cba0 con 0x7f70e0005bb0 2023-11-24T08:08:39.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f359e640 1 -- 172.21.15.97:0/201085279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 msgr2=0x7f70e0005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f359e640 1 --2- 172.21.15.97:0/201085279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70e0005fd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009a90 tx=0x7f70e0007a00 comp rx=0 tx=0).stop 2023-11-24T08:08:39.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f2d9d640 1 -- 172.21.15.97:0/201085279 reap_dead start 2023-11-24T08:08:39.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f359e640 1 -- 172.21.15.97:0/201085279 shutdown_connections 2023-11-24T08:08:39.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.378+0000 7f70f359e640 1 -- 172.21.15.97:0/201085279 >> 172.21.15.97:0/201085279 conn(0x7f70f40b19c0 msgr2=0x7f70f40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:39.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.379+0000 7f70f359e640 1 -- 172.21.15.97:0/201085279 shutdown_connections 2023-11-24T08:08:39.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.379+0000 7f70f359e640 1 -- 172.21.15.97:0/201085279 wait complete. 2023-11-24T08:08:39.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.380+0000 7f70f359e640 1 Processor -- start 2023-11-24T08:08:39.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.380+0000 7f70f359e640 1 -- start start 2023-11-24T08:08:39.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.381+0000 7f70f359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70f409b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.381+0000 7f70f359e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40aead0 0x7f70f40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.381+0000 7f70f359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f409cfe0 0x7f70f409d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.381+0000 7f70f359e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4158260 con 0x7f70e0005bb0 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.381+0000 7f70f359e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f41ef830 con 0x7f70f40aead0 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.381+0000 7f70f359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40af470 con 0x7f70f409cfe0 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70f409b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70f409b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40564/0 (socket says 172.21.15.97:40564) 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 -- 172.21.15.97:0/487533020 learned_addr learned my addr 172.21.15.97:0/487533020 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:39.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 -- 172.21.15.97:0/487533020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f409cfe0 msgr2=0x7f70f409d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70f409cfe0 0x7f70f409d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 -- 172.21.15.97:0/487533020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40aead0 msgr2=0x7f70f40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70ebfff640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40aead0 0x7f70f40aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40aead0 0x7f70f40aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 -- 172.21.15.97:0/487533020 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f409bbc0 con 0x7f70e0005bb0 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70ebfff640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70f40aead0 0x7f70f40aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.382+0000 7f70f259c640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70f409b680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f70e4037040 tx=0x7f70e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:39.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.383+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4003810 con 0x7f70e0005bb0 2023-11-24T08:08:39.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.383+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4003970 con 0x7f70e0005bb0 2023-11-24T08:08:39.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.383+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f40cfd10 con 0x7f70e0005bb0 2023-11-24T08:08:39.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.383+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4003ce0 con 0x7f70e0005bb0 2023-11-24T08:08:39.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.383+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f40d01a0 con 0x7f70e0005bb0 2023-11-24T08:08:39.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.384+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70f40b33b0 con 0x7f70e0005bb0 2023-11-24T08:08:39.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.385+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70e403e400 con 0x7f70e0005bb0 2023-11-24T08:08:39.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.386+0000 7f70eaffd640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f70d406ae70 0x7f70d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.386+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f70e40ab500 con 0x7f70e0005bb0 2023-11-24T08:08:39.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.386+0000 7f70ebfff640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f70d406ae70 0x7f70d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.386+0000 7f70eaffd640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f70d4070cd0 0x7f70d40730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.386+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 --> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70d40737a0 con 0x7f70d4070cd0 2023-11-24T08:08:39.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.386+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e40ab870 con 0x7f70e0005bb0 2023-11-24T08:08:39.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.387+0000 7f70f2d9d640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f70d4070cd0 0x7f70d40730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.387+0000 7f70ebfff640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f70d406ae70 0x7f70d406d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cb6f0 tx=0x7f70dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:39.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.387+0000 7f70f2d9d640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f70d4070cd0 0x7f70d40730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:39.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.388+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== osd.1 v2:172.21.15.97:6800/2437632405 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f70d40737a0 con 0x7f70d4070cd0 2023-11-24T08:08:39.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.402+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 --> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70f40b30d0 con 0x7f70d4070cd0 2023-11-24T08:08:39.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70eaffd640 1 -- 172.21.15.97:0/487533020 <== osd.1 v2:172.21.15.97:6800/2437632405 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f70ec007bf0 con 0x7f70d4070cd0 2023-11-24T08:08:39.406 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:39.406 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:39.406 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:39.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f70d4070cd0 msgr2=0x7f70d40730f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70f359e640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6800/2437632405,v1:172.21.15.97:6801/2437632405] conn(0x7f70d4070cd0 0x7f70d40730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f70d406ae70 msgr2=0x7f70d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70f359e640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f70d406ae70 0x7f70d406d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cb6f0 tx=0x7f70dc009040 comp rx=0 tx=0).stop 2023-11-24T08:08:39.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 msgr2=0x7f70f409b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70f359e640 1 --2- 172.21.15.97:0/487533020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70e0005bb0 0x7f70f409b680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f70e4037040 tx=0x7f70e4004730 comp rx=0 tx=0).stop 2023-11-24T08:08:39.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.403+0000 7f70f2d9d640 1 -- 172.21.15.97:0/487533020 reap_dead start 2023-11-24T08:08:39.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.404+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 shutdown_connections 2023-11-24T08:08:39.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.404+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 >> 172.21.15.97:0/487533020 conn(0x7f70f40b19c0 msgr2=0x7f70f4071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:39.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.404+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 shutdown_connections 2023-11-24T08:08:39.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.404+0000 7f70f359e640 1 -- 172.21.15.97:0/487533020 wait complete. 2023-11-24T08:08:39.424 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T08:08:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.623+0000 7f03bddc1640 1 Processor -- start 2023-11-24T08:08:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.623+0000 7f03bddc1640 1 -- start start 2023-11-24T08:08:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.624+0000 7f03bddc1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f03b806c470 0x7f03b80cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.624+0000 7f03bddc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b80ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03bddc1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b806ca10 con 0x7f03b81447f0 2023-11-24T08:08:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03bddc1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b806d690 con 0x7f03b806c470 2023-11-24T08:08:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03bddc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80cebb0 con 0x7f03b806dab0 2023-11-24T08:08:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03bcdbf640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f03b81447f0 0x7f03b815c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33902/0 (socket says 172.21.15.97:33902) 2023-11-24T08:08:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03bcdbf640 1 -- 172.21.15.97:0/78375836 learned_addr learned my addr 172.21.15.97:0/78375836 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03b7fff640 1 --2- 172.21.15.97:0/78375836 >> v2:172.21.15.97:3300/0 conn(0x7f03b806c470 0x7f03b80cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03bd5c0640 1 --2- 172.21.15.97:0/78375836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b80ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03b77fe640 1 -- 172.21.15.97:0/78375836 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599068685 0 0) 0x7f03b806ca10 con 0x7f03b81447f0 2023-11-24T08:08:39.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03b7fff640 1 -- 172.21.15.97:0/78375836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 msgr2=0x7f03b80ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:39.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03b7fff640 1 --2- 172.21.15.97:0/78375836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b80ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03b7fff640 1 -- 172.21.15.97:0/78375836 >> v1:172.21.15.97:6789/0 conn(0x7f03b81447f0 legacy=0x7f03b815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03b7fff640 1 -- 172.21.15.97:0/78375836 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b806ccf0 con 0x7f03b806c470 2023-11-24T08:08:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.625+0000 7f03bd5c0640 1 --2- 172.21.15.97:0/78375836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b80ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.626+0000 7f03b7fff640 1 --2- 172.21.15.97:0/78375836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b80cc5e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097a0 tx=0x7f03a802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24bd824b98ae24f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03b77fe640 1 -- 172.21.15.97:0/78375836 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80316f0 con 0x7f03b806c470 2023-11-24T08:08:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03b77fe640 1 -- 172.21.15.97:0/78375836 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8031850 con 0x7f03b806c470 2023-11-24T08:08:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03b77fe640 1 -- 172.21.15.97:0/78375836 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8031be0 con 0x7f03b806c470 2023-11-24T08:08:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03bddc1640 1 -- 172.21.15.97:0/78375836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 msgr2=0x7f03b80cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03bddc1640 1 --2- 172.21.15.97:0/78375836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b80cc5e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097a0 tx=0x7f03a802b790 comp rx=0 tx=0).stop 2023-11-24T08:08:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03bddc1640 1 -- 172.21.15.97:0/78375836 shutdown_connections 2023-11-24T08:08:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03bddc1640 1 --2- 172.21.15.97:0/78375836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b80ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03bddc1640 1 --2- 172.21.15.97:0/78375836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b80cc5e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03bddc1640 1 -- 172.21.15.97:0/78375836 >> 172.21.15.97:0/78375836 conn(0x7f03b806a3e0 msgr2=0x7f03b806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.627+0000 7f03bddc1640 1 -- 172.21.15.97:0/78375836 shutdown_connections 2023-11-24T08:08:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.628+0000 7f03bddc1640 1 -- 172.21.15.97:0/78375836 wait complete. 2023-11-24T08:08:39.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.629+0000 7f03bddc1640 1 Processor -- start 2023-11-24T08:08:39.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.629+0000 7f03bddc1640 1 -- start start 2023-11-24T08:08:39.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.630+0000 7f03bddc1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b813f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.630+0000 7f03bddc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b815db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.630+0000 7f03bddc1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03b81447f0 0x7f03b814d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.630+0000 7f03bddc1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b814dee0 con 0x7f03b806c470 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.630+0000 7f03bddc1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b814e1c0 con 0x7f03b81447f0 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.630+0000 7f03bddc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b813e9b0 con 0x7f03b806dab0 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b813f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b813f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40592/0 (socket says 172.21.15.97:40592) 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 -- 172.21.15.97:0/503822379 learned_addr learned my addr 172.21.15.97:0/503822379 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bd5c0640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03b81447f0 0x7f03b814d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03b7fff640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 -- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 msgr2=0x7f03b815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b815db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 -- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03b81447f0 msgr2=0x7f03b814d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03b81447f0 0x7f03b814d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 -- 172.21.15.97:0/503822379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8009400 con 0x7f03b806c470 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.631+0000 7f03bcdbf640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b813f1b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c430 tx=0x7f03ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.632+0000 7f03b57fa640 1 -- 172.21.15.97:0/503822379 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac0074e0 con 0x7f03b806c470 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.632+0000 7f03b57fa640 1 -- 172.21.15.97:0/503822379 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac007660 con 0x7f03b806c470 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.632+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b813ec90 con 0x7f03b806c470 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.632+0000 7f03b57fa640 1 -- 172.21.15.97:0/503822379 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac004a20 con 0x7f03b806c470 2023-11-24T08:08:39.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.632+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b8158b80 con 0x7f03b806c470 2023-11-24T08:08:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.633+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b8067450 con 0x7f03b806c470 2023-11-24T08:08:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.634+0000 7f03b57fa640 1 -- 172.21.15.97:0/503822379 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03ac004b80 con 0x7f03b806c470 2023-11-24T08:08:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.635+0000 7f03b57fa640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f03a406ae40 0x7f03a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.635+0000 7f03b57fa640 1 -- 172.21.15.97:0/503822379 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f03ac089270 con 0x7f03b806c470 2023-11-24T08:08:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.635+0000 7f03b7fff640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f03a406ae40 0x7f03a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.636+0000 7f03b7fff640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f03a406ae40 0x7f03a406d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.639+0000 7f03b57fa640 1 -- 172.21.15.97:0/503822379 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03ac0544f0 con 0x7f03b806c470 2023-11-24T08:08:39.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.828+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f03b815cc20 con 0x7f03a406ae40 2023-11-24T08:08:39.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.828+0000 7f03b57fa640 1 -- 172.21.15.97:0/503822379 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03b815cc20 con 0x7f03a406ae40 2023-11-24T08:08:39.831 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T08:08:39.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f03a406ae40 msgr2=0x7f03a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f03a406ae40 0x7f03a406d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a8008030 comp rx=0 tx=0).stop 2023-11-24T08:08:39.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 msgr2=0x7f03b813f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:39.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b813f1b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c430 tx=0x7f03ac00c8f0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 shutdown_connections 2023-11-24T08:08:39.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f03a406ae40 0x7f03a406d300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03b81447f0 0x7f03b814d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03b806dab0 0x7f03b815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 --2- 172.21.15.97:0/503822379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03b806c470 0x7f03b813f1b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:39.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 >> 172.21.15.97:0/503822379 conn(0x7f03b806a3e0 msgr2=0x7f03b815a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:39.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.831+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 shutdown_connections 2023-11-24T08:08:39.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:39.832+0000 7f03bddc1640 1 -- 172.21.15.97:0/503822379 wait complete. 2023-11-24T08:08:39.852 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T08:08:39.852 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:40.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.065+0000 7f8387fff640 1 Processor -- start 2023-11-24T08:08:40.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.065+0000 7f8387fff640 1 -- start start 2023-11-24T08:08:40.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f8387fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8388071410 0x7f8388146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f8387fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f838806c7c0 0x7f83880717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f8387fff640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838806cc50 con 0x7f8388071d30 2023-11-24T08:08:40.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f8387fff640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838806cec0 con 0x7f8388071410 2023-11-24T08:08:40.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f8387fff640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838806d1a0 con 0x7f838806c7c0 2023-11-24T08:08:40.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f8386ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8388071410 0x7f8388146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f83877fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8388071d30 0x7f83880b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33918/0 (socket says 172.21.15.97:33918) 2023-11-24T08:08:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.067+0000 7f83877fe640 1 -- 172.21.15.97:0/131622913 learned_addr learned my addr 172.21.15.97:0/131622913 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.068+0000 7f837ffff640 1 --2- 172.21.15.97:0/131622913 >> v2:172.21.15.183:3300/0 conn(0x7f838806c7c0 0x7f83880717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.068+0000 7f8386ffd640 1 -- 172.21.15.97:0/131622913 >> v2:172.21.15.183:3300/0 conn(0x7f838806c7c0 msgr2=0x7f83880717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.068+0000 7f8386ffd640 1 --2- 172.21.15.97:0/131622913 >> v2:172.21.15.183:3300/0 conn(0x7f838806c7c0 0x7f83880717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.068+0000 7f8386ffd640 1 -- 172.21.15.97:0/131622913 >> v1:172.21.15.97:6789/0 conn(0x7f8388071d30 legacy=0x7f83880b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.068+0000 7f8386ffd640 1 -- 172.21.15.97:0/131622913 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838806d480 con 0x7f8388071410 2023-11-24T08:08:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.068+0000 7f83867fc640 1 -- 172.21.15.97:0/131622913 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266977525 0 0) 0x7f838806cc50 con 0x7f8388071d30 2023-11-24T08:08:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.069+0000 7f8386ffd640 1 --2- 172.21.15.97:0/131622913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071410 0x7f8388146770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8388146ef0 tx=0x7f837802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb91af96650cdeb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.069+0000 7f83867fc640 1 -- 172.21.15.97:0/131622913 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378031830 con 0x7f8388071410 2023-11-24T08:08:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.069+0000 7f83867fc640 1 -- 172.21.15.97:0/131622913 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378031990 con 0x7f8388071410 2023-11-24T08:08:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.069+0000 7f83867fc640 1 -- 172.21.15.97:0/131622913 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378031d20 con 0x7f8388071410 2023-11-24T08:08:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 -- 172.21.15.97:0/131622913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071410 msgr2=0x7f8388146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 --2- 172.21.15.97:0/131622913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071410 0x7f8388146770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8388146ef0 tx=0x7f837802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 -- 172.21.15.97:0/131622913 shutdown_connections 2023-11-24T08:08:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 --2- 172.21.15.97:0/131622913 >> v2:172.21.15.183:3300/0 conn(0x7f838806c7c0 0x7f83880717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 --2- 172.21.15.97:0/131622913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071410 0x7f8388146770 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 -- 172.21.15.97:0/131622913 >> 172.21.15.97:0/131622913 conn(0x7f838806a800 msgr2=0x7f838806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:40.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 -- 172.21.15.97:0/131622913 shutdown_connections 2023-11-24T08:08:40.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.070+0000 7f8387fff640 1 -- 172.21.15.97:0/131622913 wait complete. 2023-11-24T08:08:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.072+0000 7f8387fff640 1 Processor -- start 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.072+0000 7f8387fff640 1 -- start start 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f8387fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f838806c7c0 0x7f83880cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f8387fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8388071410 0x7f83880aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f8387fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071d30 0x7f83880af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f8387fff640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c4d60 con 0x7f8388071d30 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f8387fff640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c5490 con 0x7f838806c7c0 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f8387fff640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8388132a50 con 0x7f8388071410 2023-11-24T08:08:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f83877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071d30 0x7f83880af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f83877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071d30 0x7f83880af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40606/0 (socket says 172.21.15.97:40606) 2023-11-24T08:08:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.073+0000 7f83877fe640 1 -- 172.21.15.97:0/2307263272 learned_addr learned my addr 172.21.15.97:0/2307263272 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f8386ffd640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f838806c7c0 0x7f83880cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f837ffff640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8388071410 0x7f83880aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f83877fe640 1 -- 172.21.15.97:0/2307263272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8388071410 msgr2=0x7f83880aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f83877fe640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8388071410 0x7f83880aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f83877fe640 1 -- 172.21.15.97:0/2307263272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f838806c7c0 msgr2=0x7f83880cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f83877fe640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f838806c7c0 0x7f83880cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f83877fe640 1 -- 172.21.15.97:0/2307263272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009400 con 0x7f8388071d30 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f83877fe640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071d30 0x7f83880af260 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f838000c7e0 tx=0x7f838000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.074+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838000a640 con 0x7f8388071d30 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.075+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838000a7c0 con 0x7f8388071d30 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.075+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83880c4a80 con 0x7f8388071d30 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.075+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838000ab70 con 0x7f8388071d30 2023-11-24T08:08:40.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.075+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83881326e0 con 0x7f8388071d30 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.076+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8388072180 con 0x7f8388071d30 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.077+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f838000acd0 con 0x7f8388071d30 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.077+0000 7f837f7fe640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f836806ae40 0x7f836806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.078+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8380088b80 con 0x7f8388071d30 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.078+0000 7f837f7fe640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7f8368070ca0 0x7f83680730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.078+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 --> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8368073770 con 0x7f8368070ca0 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.078+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f838008d260 con 0x7f8388071d30 2023-11-24T08:08:40.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.078+0000 7f8386ffd640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f836806ae40 0x7f836806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.078+0000 7f837ffff640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7f8368070ca0 0x7f83680730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.079+0000 7f8386ffd640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f836806ae40 0x7f836806d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8378036000 tx=0x7f837803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.079+0000 7f837ffff640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7f8368070ca0 0x7f83680730c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.079+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== osd.2 v2:172.21.15.97:6816/2868474403 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8368073770 con 0x7f8368070ca0 2023-11-24T08:08:40.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.094+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 --> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f838806da40 con 0x7f8368070ca0 2023-11-24T08:08:40.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.094+0000 7f837f7fe640 1 -- 172.21.15.97:0/2307263272 <== osd.2 v2:172.21.15.97:6816/2868474403 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f837000b520 con 0x7f8368070ca0 2023-11-24T08:08:40.097 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:40.097 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:40.097 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:40.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.094+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7f8368070ca0 msgr2=0x7f83680730c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.094+0000 7f8387fff640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6816/2868474403,v1:172.21.15.97:6817/2868474403] conn(0x7f8368070ca0 0x7f83680730c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f836806ae40 msgr2=0x7f836806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f836806ae40 0x7f836806d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8378036000 tx=0x7f837803c040 comp rx=0 tx=0).stop 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071d30 msgr2=0x7f83880af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 --2- 172.21.15.97:0/2307263272 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8388071d30 0x7f83880af260 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f838000c7e0 tx=0x7f838000cca0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f83877fe640 1 -- 172.21.15.97:0/2307263272 reap_dead start 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 shutdown_connections 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 >> 172.21.15.97:0/2307263272 conn(0x7f838806a800 msgr2=0x7f83880b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 shutdown_connections 2023-11-24T08:08:40.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.095+0000 7f8387fff640 1 -- 172.21.15.97:0/2307263272 wait complete. 2023-11-24T08:08:40.116 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T08:08:40.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.329+0000 7f7024c09640 1 Processor -- start 2023-11-24T08:08:40.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.329+0000 7f7024c09640 1 -- start start 2023-11-24T08:08:40.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f7024c09640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f702013df80 0x7f702015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f7024c09640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702006c470 con 0x7f702013e360 2023-11-24T08:08:40.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f7024c09640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702006c750 con 0x7f70200cf9a0 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f7024c09640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702006ca30 con 0x7f702013df80 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f701e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f702013df80 0x7f702015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f701e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f702013df80 0x7f702015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40614/0 (socket says 172.21.15.97:40614) 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f701e59c640 1 -- 172.21.15.97:0/105176080 learned_addr learned my addr 172.21.15.97:0/105176080 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.331+0000 7f7017fff640 1 --1- 172.21.15.97:0/105176080 >> v1:172.21.15.97:6789/0 conn(0x7f702013e360 0x7f70200cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33932/0 (socket says 172.21.15.97:33932) 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.332+0000 7f701e59c640 1 -- 172.21.15.97:0/105176080 >> v1:172.21.15.183:6789/0 conn(0x7f70200cf9a0 legacy=0x7f70200cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.332+0000 7f701e59c640 1 -- 172.21.15.97:0/105176080 >> v1:172.21.15.97:6789/0 conn(0x7f702013e360 legacy=0x7f70200cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.332+0000 7f701e59c640 1 -- 172.21.15.97:0/105176080 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702006cd10 con 0x7f702013df80 2023-11-24T08:08:40.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.332+0000 7f701dd9b640 1 -- 172.21.15.97:0/105176080 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513155251 0 0) 0x7f702006c470 con 0x7f702013e360 2023-11-24T08:08:40.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.333+0000 7f701e59c640 1 --2- 172.21.15.97:0/105176080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f702015bee0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7010009870 tx=0x7f701002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2d82e90326798d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.333+0000 7f701dd9b640 1 -- 172.21.15.97:0/105176080 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010030860 con 0x7f702013df80 2023-11-24T08:08:40.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.333+0000 7f701dd9b640 1 -- 172.21.15.97:0/105176080 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70100309c0 con 0x7f702013df80 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.333+0000 7f701dd9b640 1 -- 172.21.15.97:0/105176080 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010030d50 con 0x7f702013df80 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.334+0000 7f7024c09640 1 -- 172.21.15.97:0/105176080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 msgr2=0x7f702015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.334+0000 7f7024c09640 1 --2- 172.21.15.97:0/105176080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f702015bee0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7010009870 tx=0x7f701002b9a0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.334+0000 7f7024c09640 1 -- 172.21.15.97:0/105176080 shutdown_connections 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.334+0000 7f7024c09640 1 --2- 172.21.15.97:0/105176080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f702015bee0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.334+0000 7f7024c09640 1 -- 172.21.15.97:0/105176080 >> 172.21.15.97:0/105176080 conn(0x7f702006a800 msgr2=0x7f702006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.334+0000 7f7024c09640 1 -- 172.21.15.97:0/105176080 shutdown_connections 2023-11-24T08:08:40.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.334+0000 7f7024c09640 1 -- 172.21.15.97:0/105176080 wait complete. 2023-11-24T08:08:40.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.336+0000 7f7024c09640 1 Processor -- start 2023-11-24T08:08:40.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.336+0000 7f7024c09640 1 -- start start 2023-11-24T08:08:40.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7024c09640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70200cf9a0 0x7f702013d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7024c09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f70201448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7024c09640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f702013e360 0x7f70201e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7024c09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201e7390 con 0x7f702013df80 2023-11-24T08:08:40.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7024c09640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201e7670 con 0x7f702013e360 2023-11-24T08:08:40.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7024c09640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70201e7950 con 0x7f70200cf9a0 2023-11-24T08:08:40.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7017fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f70201448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7017fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f70201448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40620/0 (socket says 172.21.15.97:40620) 2023-11-24T08:08:40.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7017fff640 1 -- 172.21.15.97:0/557395214 learned_addr learned my addr 172.21.15.97:0/557395214 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:40.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f701e59c640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70200cf9a0 0x7f702013d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7017fff640 1 -- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70200cf9a0 msgr2=0x7f702013d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7017fff640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70200cf9a0 0x7f702013d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f701ed9d640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f702013e360 0x7f70201e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.337+0000 7f7017fff640 1 -- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f702013e360 msgr2=0x7f70201e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7017fff640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f702013e360 0x7f70201e6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7017fff640 1 -- 172.21.15.97:0/557395214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100094d0 con 0x7f702013df80 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f701ed9d640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f702013e360 0x7f70201e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7017fff640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f70201448a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f700800c4b0 tx=0x7f700800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7016ffd640 1 -- 172.21.15.97:0/557395214 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080074e0 con 0x7f702013df80 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7016ffd640 1 -- 172.21.15.97:0/557395214 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008007660 con 0x7f702013df80 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7016ffd640 1 -- 172.21.15.97:0/557395214 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008004a20 con 0x7f702013df80 2023-11-24T08:08:40.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70201e7c30 con 0x7f702013df80 2023-11-24T08:08:40.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.338+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7020144de0 con 0x7f702013df80 2023-11-24T08:08:40.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.339+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70201e8150 con 0x7f702013df80 2023-11-24T08:08:40.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.340+0000 7f7016ffd640 1 -- 172.21.15.97:0/557395214 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7008004b80 con 0x7f702013df80 2023-11-24T08:08:40.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.341+0000 7f7016ffd640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f700006ae90 0x7f700006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.341+0000 7f7016ffd640 1 -- 172.21.15.97:0/557395214 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f70080889d0 con 0x7f702013df80 2023-11-24T08:08:40.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.341+0000 7f701e59c640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f700006ae90 0x7f700006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.342+0000 7f701e59c640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f700006ae90 0x7f700006d350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7010036000 tx=0x7f701003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.346+0000 7f7016ffd640 1 -- 172.21.15.97:0/557395214 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70201e8150 con 0x7f702013df80 2023-11-24T08:08:40.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.535+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f70201e77e0 con 0x7f700006ae90 2023-11-24T08:08:40.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.536+0000 7f7016ffd640 1 -- 172.21.15.97:0/557395214 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f70201e77e0 con 0x7f700006ae90 2023-11-24T08:08:40.539 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T08:08:40.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f700006ae90 msgr2=0x7f700006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f700006ae90 0x7f700006d350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7010036000 tx=0x7f701003b040 comp rx=0 tx=0).stop 2023-11-24T08:08:40.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 msgr2=0x7f70201448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f70201448a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f700800c4b0 tx=0x7f700800c970 comp rx=0 tx=0).stop 2023-11-24T08:08:40.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 shutdown_connections 2023-11-24T08:08:40.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f700006ae90 0x7f700006d350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f702013e360 0x7f70201e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f702013df80 0x7f70201448a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 --2- 172.21.15.97:0/557395214 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70200cf9a0 0x7f702013d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 >> 172.21.15.97:0/557395214 conn(0x7f702006a800 msgr2=0x7f70200aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:40.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 shutdown_connections 2023-11-24T08:08:40.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.539+0000 7f7024c09640 1 -- 172.21.15.97:0/557395214 wait complete. 2023-11-24T08:08:40.561 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T08:08:40.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:40.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.772+0000 7f31c4b05640 1 Processor -- start 2023-11-24T08:08:40.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.772+0000 7f31c4b05640 1 -- start start 2023-11-24T08:08:40.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31c4b05640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f31c013df80 0x7f31c015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31c4b05640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31c00cf9a0 0x7f31c00cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31c4b05640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c006c470 con 0x7f31c013e360 2023-11-24T08:08:40.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31c4b05640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c006c750 con 0x7f31c013df80 2023-11-24T08:08:40.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31c4b05640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c006ca30 con 0x7f31c00cf9a0 2023-11-24T08:08:40.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31be59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f31c013df80 0x7f31c015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31b5d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f31c013e360 0x7f31c00cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33934/0 (socket says 172.21.15.97:33934) 2023-11-24T08:08:40.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.774+0000 7f31b5d9b640 1 -- 172.21.15.97:0/3267765762 learned_addr learned my addr 172.21.15.97:0/3267765762 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:40.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.775+0000 7f31be59c640 1 -- 172.21.15.97:0/3267765762 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cf9a0 msgr2=0x7f31c00cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:40.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.775+0000 7f31be59c640 1 --2- 172.21.15.97:0/3267765762 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cf9a0 0x7f31c00cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.775+0000 7f31be59c640 1 -- 172.21.15.97:0/3267765762 >> v1:172.21.15.97:6789/0 conn(0x7f31c013e360 legacy=0x7f31c00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.775+0000 7f31be59c640 1 -- 172.21.15.97:0/3267765762 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c006cd10 con 0x7f31c013df80 2023-11-24T08:08:40.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.776+0000 7f31be59c640 1 --2- 172.21.15.97:0/3267765762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c015bee0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f31c00ccb10 tx=0x7f31b002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417981399a4110e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.776+0000 7f31bdd9b640 1 -- 172.21.15.97:0/3267765762 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b002cc70 con 0x7f31c013df80 2023-11-24T08:08:40.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.776+0000 7f31bdd9b640 1 -- 172.21.15.97:0/3267765762 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b002cdd0 con 0x7f31c013df80 2023-11-24T08:08:40.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.776+0000 7f31bdd9b640 1 -- 172.21.15.97:0/3267765762 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0034660 con 0x7f31c013df80 2023-11-24T08:08:40.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 -- 172.21.15.97:0/3267765762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 msgr2=0x7f31c015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 --2- 172.21.15.97:0/3267765762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c015bee0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f31c00ccb10 tx=0x7f31b002bec0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 -- 172.21.15.97:0/3267765762 shutdown_connections 2023-11-24T08:08:40.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 --2- 172.21.15.97:0/3267765762 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cf9a0 0x7f31c00cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 --2- 172.21.15.97:0/3267765762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c015bee0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 -- 172.21.15.97:0/3267765762 >> 172.21.15.97:0/3267765762 conn(0x7f31c006a800 msgr2=0x7f31c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:40.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 -- 172.21.15.97:0/3267765762 shutdown_connections 2023-11-24T08:08:40.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.777+0000 7f31c4b05640 1 -- 172.21.15.97:0/3267765762 wait complete. 2023-11-24T08:08:40.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.778+0000 7f31c4b05640 1 Processor -- start 2023-11-24T08:08:40.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.779+0000 7f31c4b05640 1 -- start start 2023-11-24T08:08:40.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.779+0000 7f31c4b05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c00cf9a0 0x7f31c0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.779+0000 7f31c4b05640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c013cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.779+0000 7f31c4b05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c013e360 0x7f31c00b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.779+0000 7f31c4b05640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0155d70 con 0x7f31c013df80 2023-11-24T08:08:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.779+0000 7f31c4b05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0155fc0 con 0x7f31c013e360 2023-11-24T08:08:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.779+0000 7f31c4b05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01562a0 con 0x7f31c00cf9a0 2023-11-24T08:08:40.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c013cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c013cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40638/0 (socket says 172.21.15.97:40638) 2023-11-24T08:08:40.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 -- 172.21.15.97:0/2549261304 learned_addr learned my addr 172.21.15.97:0/2549261304 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:40.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 -- 172.21.15.97:0/2549261304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c00cf9a0 msgr2=0x7f31c0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c00cf9a0 0x7f31c0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 -- 172.21.15.97:0/2549261304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c013e360 msgr2=0x7f31c00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c013e360 0x7f31c00b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 -- 172.21.15.97:0/2549261304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009a70 con 0x7f31c013df80 2023-11-24T08:08:40.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.780+0000 7f31b5d9b640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c013cda0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c500 tx=0x7f31a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.781+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8005ce0 con 0x7f31c013df80 2023-11-24T08:08:40.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.781+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8005e40 con 0x7f31c013df80 2023-11-24T08:08:40.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.781+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80072f0 con 0x7f31c013df80 2023-11-24T08:08:40.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.781+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c0156580 con 0x7f31c013df80 2023-11-24T08:08:40.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.781+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c013da30 con 0x7f31c013df80 2023-11-24T08:08:40.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.782+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31c00cd170 con 0x7f31c013df80 2023-11-24T08:08:40.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.783+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31a8007510 con 0x7f31c013df80 2023-11-24T08:08:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.784+0000 7f31b77fe640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f31a006ae40 0x7f31a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.784+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31a80886c0 con 0x7f31c013df80 2023-11-24T08:08:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.784+0000 7f31be59c640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f31a006ae40 0x7f31a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.784+0000 7f31b77fe640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7f31a0070ca0 0x7f31a00730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.784+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 --> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31a0073770 con 0x7f31a0070ca0 2023-11-24T08:08:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.784+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a808ad80 con 0x7f31c013df80 2023-11-24T08:08:40.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.784+0000 7f31bed9d640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7f31a0070ca0 0x7f31a00730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:40.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.785+0000 7f31be59c640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f31a006ae40 0x7f31a006d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f31b0036000 tx=0x7f31b002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.785+0000 7f31bed9d640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7f31a0070ca0 0x7f31a00730c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:40.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.786+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== osd.3 v2:172.21.15.97:6824/1194273011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f31a0073770 con 0x7f31a0070ca0 2023-11-24T08:08:40.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.799+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 --> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31c015f9c0 con 0x7f31a0070ca0 2023-11-24T08:08:40.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31b77fe640 1 -- 172.21.15.97:0/2549261304 <== osd.3 v2:172.21.15.97:6824/1194273011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f31b8009720 con 0x7f31a0070ca0 2023-11-24T08:08:40.803 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:40.803 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:40.803 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:40.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7f31a0070ca0 msgr2=0x7f31a00730c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6824/1194273011,v1:172.21.15.97:6825/1194273011] conn(0x7f31a0070ca0 0x7f31a00730c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f31a006ae40 msgr2=0x7f31a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f31a006ae40 0x7f31a006d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f31b0036000 tx=0x7f31b002e000 comp rx=0 tx=0).stop 2023-11-24T08:08:40.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 msgr2=0x7f31c013cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:40.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 --2- 172.21.15.97:0/2549261304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c013df80 0x7f31c013cda0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c500 tx=0x7f31a800c9c0 comp rx=0 tx=0).stop 2023-11-24T08:08:40.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31bed9d640 1 -- 172.21.15.97:0/2549261304 reap_dead start 2023-11-24T08:08:40.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 shutdown_connections 2023-11-24T08:08:40.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 >> 172.21.15.97:0/2549261304 conn(0x7f31c006a800 msgr2=0x7f31c015c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:40.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.800+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 shutdown_connections 2023-11-24T08:08:40.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:40.801+0000 7f31c4b05640 1 -- 172.21.15.97:0/2549261304 wait complete. 2023-11-24T08:08:40.819 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T08:08:41.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.021+0000 7f0486947640 1 Processor -- start 2023-11-24T08:08:41.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.021+0000 7f0486947640 1 -- start start 2023-11-24T08:08:41.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0486947640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f048013cda0 0x7f048015da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0486947640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f048015dfa0 0x7f04800cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0486947640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0480071b50 con 0x7f04800cdef0 2023-11-24T08:08:41.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0486947640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04800700f0 con 0x7f048013cda0 2023-11-24T08:08:41.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0486947640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048015e3e0 con 0x7f048015dfa0 2023-11-24T08:08:41.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0486146640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f04800cdef0 0x7f048015a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33950/0 (socket says 172.21.15.97:33950) 2023-11-24T08:08:41.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0486146640 1 -- 172.21.15.97:0/2771478635 learned_addr learned my addr 172.21.15.97:0/2771478635 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:41.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0485144640 1 --2- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f048015dfa0 0x7f04800cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.023+0000 7f0485945640 1 --2- 172.21.15.97:0/2771478635 >> v2:172.21.15.183:3300/0 conn(0x7f048013cda0 0x7f048015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.024+0000 7f0484943640 1 -- 172.21.15.97:0/2771478635 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782445000 0 0) 0x7f0480071b50 con 0x7f04800cdef0 2023-11-24T08:08:41.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.024+0000 7f0484943640 1 -- 172.21.15.97:0/2771478635 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f046c003520 con 0x7f04800cdef0 2023-11-24T08:08:41.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.024+0000 7f0485945640 1 -- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f048015dfa0 msgr2=0x7f04800cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:41.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.024+0000 7f0485945640 1 --2- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f048015dfa0 0x7f04800cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.024+0000 7f0485945640 1 -- 172.21.15.97:0/2771478635 >> v1:172.21.15.97:6789/0 conn(0x7f04800cdef0 legacy=0x7f048015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.024+0000 7f0484943640 1 -- 172.21.15.97:0/2771478635 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972337570 0 0) 0x7f046c003520 con 0x7f04800cdef0 2023-11-24T08:08:41.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.024+0000 7f0485945640 1 -- 172.21.15.97:0/2771478635 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800ce720 con 0x7f048013cda0 2023-11-24T08:08:41.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.025+0000 7f0485945640 1 --2- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 0x7f048015da60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f047c0097a0 tx=0x7f047c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9612ff5e1a2d50a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.026+0000 7f0484943640 1 -- 172.21.15.97:0/2771478635 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04780019f0 con 0x7f048013cda0 2023-11-24T08:08:41.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.026+0000 7f0484943640 1 -- 172.21.15.97:0/2771478635 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c02e050 con 0x7f048013cda0 2023-11-24T08:08:41.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.026+0000 7f0484943640 1 -- 172.21.15.97:0/2771478635 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c030730 con 0x7f048013cda0 2023-11-24T08:08:41.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 -- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 msgr2=0x7f048015da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 --2- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 0x7f048015da60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f047c0097a0 tx=0x7f047c02b710 comp rx=0 tx=0).stop 2023-11-24T08:08:41.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 -- 172.21.15.97:0/2771478635 shutdown_connections 2023-11-24T08:08:41.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 --2- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f048015dfa0 0x7f04800cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 --2- 172.21.15.97:0/2771478635 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 0x7f048015da60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 -- 172.21.15.97:0/2771478635 >> 172.21.15.97:0/2771478635 conn(0x7f048006a3e0 msgr2=0x7f048006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:41.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 -- 172.21.15.97:0/2771478635 shutdown_connections 2023-11-24T08:08:41.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.027+0000 7f0486947640 1 -- 172.21.15.97:0/2771478635 wait complete. 2023-11-24T08:08:41.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.029+0000 7f0486947640 1 Processor -- start 2023-11-24T08:08:41.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.029+0000 7f0486947640 1 -- start start 2023-11-24T08:08:41.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486947640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04800cdef0 0x7f0480150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486947640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 0x7f048013a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486947640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f048015dfa0 0x7f0480071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486947640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048015a410 con 0x7f048015dfa0 2023-11-24T08:08:41.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486947640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04801528c0 con 0x7f048013cda0 2023-11-24T08:08:41.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486947640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0480152ba0 con 0x7f04800cdef0 2023-11-24T08:08:41.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486146640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f048015dfa0 0x7f0480071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486146640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f048015dfa0 0x7f0480071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40646/0 (socket says 172.21.15.97:40646) 2023-11-24T08:08:41.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0486146640 1 -- 172.21.15.97:0/858505282 learned_addr learned my addr 172.21.15.97:0/858505282 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:41.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0485945640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04800cdef0 0x7f0480150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.030+0000 7f0485144640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 0x7f048013a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486146640 1 -- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04800cdef0 msgr2=0x7f0480150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486146640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04800cdef0 0x7f0480150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486146640 1 -- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 msgr2=0x7f048013a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486146640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 0x7f048013a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486146640 1 -- 172.21.15.97:0/858505282 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c009400 con 0x7f048015dfa0 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486146640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f048015dfa0 0x7f0480071290 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f047800cc70 tx=0x7f047800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f04767fc640 1 -- 172.21.15.97:0/858505282 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047800ce80 con 0x7f048015dfa0 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f04767fc640 1 -- 172.21.15.97:0/858505282 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478012400 con 0x7f048015dfa0 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f04767fc640 1 -- 172.21.15.97:0/858505282 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04780127d0 con 0x7f048015dfa0 2023-11-24T08:08:41.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0480152e80 con 0x7f048015dfa0 2023-11-24T08:08:41.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.031+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04801507b0 con 0x7f048015dfa0 2023-11-24T08:08:41.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.032+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0480067450 con 0x7f048015dfa0 2023-11-24T08:08:41.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.033+0000 7f04767fc640 1 -- 172.21.15.97:0/858505282 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0478007070 con 0x7f048015dfa0 2023-11-24T08:08:41.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.035+0000 7f04767fc640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f046406ae40 0x7f046406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.035+0000 7f04767fc640 1 -- 172.21.15.97:0/858505282 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0478089410 con 0x7f048015dfa0 2023-11-24T08:08:41.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.035+0000 7f0485945640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f046406ae40 0x7f046406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.036+0000 7f0485945640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f046406ae40 0x7f046406d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f047c034000 tx=0x7f047c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.039+0000 7f04767fc640 1 -- 172.21.15.97:0/858505282 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0478054850 con 0x7f048015dfa0 2023-11-24T08:08:41.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.232+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0480152740 con 0x7f046406ae40 2023-11-24T08:08:41.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.233+0000 7f04767fc640 1 -- 172.21.15.97:0/858505282 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f047c030820 con 0x7f046406ae40 2023-11-24T08:08:41.235 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T08:08:41.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.235+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f046406ae40 msgr2=0x7f046406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.235+0000 7f0486947640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f046406ae40 0x7f046406d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f047c034000 tx=0x7f047c008030 comp rx=0 tx=0).stop 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.235+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f048015dfa0 msgr2=0x7f0480071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.235+0000 7f0486947640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f048015dfa0 0x7f0480071290 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f047800cc70 tx=0x7f047800a430 comp rx=0 tx=0).stop 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 shutdown_connections 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f046406ae40 0x7f046406d300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f048015dfa0 0x7f0480071290 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f048013cda0 0x7f048013a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 --2- 172.21.15.97:0/858505282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04800cdef0 0x7f0480150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 >> 172.21.15.97:0/858505282 conn(0x7f048006a3e0 msgr2=0x7f048006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 shutdown_connections 2023-11-24T08:08:41.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.236+0000 7f0486947640 1 -- 172.21.15.97:0/858505282 wait complete. 2023-11-24T08:08:41.256 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T08:08:41.257 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.474+0000 7f72e1533640 1 Processor -- start 2023-11-24T08:08:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.474+0000 7f72e1533640 1 -- start start 2023-11-24T08:08:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72e1533640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72dc150760 0x7f72dc072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72e1533640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f72dc15d300 0x7f72dc15d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72e1533640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc15dc80 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72e1533640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0b3710 con 0x7f72dc150760 2023-11-24T08:08:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72e1533640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc071190 con 0x7f72dc15d300 2023-11-24T08:08:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72daffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72dc150760 0x7f72dc072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72daffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72dc150760 0x7f72dc072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40656/0 (socket says 172.21.15.97:40656) 2023-11-24T08:08:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.476+0000 7f72daffd640 1 -- 172.21.15.97:0/2174601247 learned_addr learned my addr 172.21.15.97:0/2174601247 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.477+0000 7f72daffd640 1 -- 172.21.15.97:0/2174601247 >> v2:172.21.15.183:3300/0 conn(0x7f72dc15d300 msgr2=0x7f72dc15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:41.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.477+0000 7f72da7fc640 1 --2- 172.21.15.97:0/2174601247 >> v2:172.21.15.183:3300/0 conn(0x7f72dc15d300 0x7f72dc15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.477+0000 7f72daffd640 1 --2- 172.21.15.97:0/2174601247 >> v2:172.21.15.183:3300/0 conn(0x7f72dc15d300 0x7f72dc15d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.477+0000 7f72daffd640 1 -- 172.21.15.97:0/2174601247 >> v1:172.21.15.183:6789/0 conn(0x7f72dc0b2bd0 legacy=0x7f72dc0b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:41.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.477+0000 7f72daffd640 1 -- 172.21.15.97:0/2174601247 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc071470 con 0x7f72dc150760 2023-11-24T08:08:41.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.477+0000 7f72da7fc640 1 --2- 172.21.15.97:0/2174601247 >> v2:172.21.15.183:3300/0 conn(0x7f72dc15d300 0x7f72dc15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:41.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.478+0000 7f72daffd640 1 --2- 172.21.15.97:0/2174601247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc150760 0x7f72dc072230 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b1ca0 tx=0x7f72cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84abc1563d97387d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.478+0000 7f72d9ffb640 1 -- 172.21.15.97:0/2174601247 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc031870 con 0x7f72dc150760 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.478+0000 7f72d9ffb640 1 -- 172.21.15.97:0/2174601247 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0319d0 con 0x7f72dc150760 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.478+0000 7f72d9ffb640 1 -- 172.21.15.97:0/2174601247 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc031d60 con 0x7f72dc150760 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 -- 172.21.15.97:0/2174601247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc150760 msgr2=0x7f72dc072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 --2- 172.21.15.97:0/2174601247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc150760 0x7f72dc072230 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b1ca0 tx=0x7f72cc02b910 comp rx=0 tx=0).stop 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 -- 172.21.15.97:0/2174601247 shutdown_connections 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 --2- 172.21.15.97:0/2174601247 >> v2:172.21.15.183:3300/0 conn(0x7f72dc15d300 0x7f72dc15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 --2- 172.21.15.97:0/2174601247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc150760 0x7f72dc072230 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 -- 172.21.15.97:0/2174601247 >> 172.21.15.97:0/2174601247 conn(0x7f72dc06a800 msgr2=0x7f72dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:41.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 -- 172.21.15.97:0/2174601247 shutdown_connections 2023-11-24T08:08:41.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.479+0000 7f72e1533640 1 -- 172.21.15.97:0/2174601247 wait complete. 2023-11-24T08:08:41.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.481+0000 7f72e1533640 1 Processor -- start 2023-11-24T08:08:41.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.481+0000 7f72e1533640 1 -- start start 2023-11-24T08:08:41.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72e1533640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc0b2bd0 0x7f72dc1efa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72e1533640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc150760 0x7f72dc147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72e1533640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72dc15d300 0x7f72dc1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72e1533640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc150eb0 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72e1533640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1599d0 con 0x7f72dc150760 2023-11-24T08:08:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72e1533640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1582e0 con 0x7f72dc15d300 2023-11-24T08:08:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72daffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc0b2bd0 0x7f72dc1efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72daffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc0b2bd0 0x7f72dc1efa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40672/0 (socket says 172.21.15.97:40672) 2023-11-24T08:08:41.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.482+0000 7f72daffd640 1 -- 172.21.15.97:0/803041608 learned_addr learned my addr 172.21.15.97:0/803041608 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72daffd640 1 -- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72dc15d300 msgr2=0x7f72dc1591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72daffd640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72dc15d300 0x7f72dc1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72daffd640 1 -- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc150760 msgr2=0x7f72dc147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72da7fc640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc150760 0x7f72dc147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72daffd640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72dc150760 0x7f72dc147740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72daffd640 1 -- 172.21.15.97:0/803041608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0094d0 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72daffd640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc0b2bd0 0x7f72dc1efa40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f72cc000c00 tx=0x7f72cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc031820 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0443f0 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0447a0 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc159730 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.483+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc157c90 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.484+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72dc071d10 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.486+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72cc04d450 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.486+0000 7f72c37fe640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72c806ae40 0x7f72c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.486+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72cc02d040 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.487+0000 7f72da7fc640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72c806ae40 0x7f72c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.487+0000 7f72c37fe640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7f72c8070ca0 0x7f72c80730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.487+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 --> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72c8073770 con 0x7f72c8070ca0 2023-11-24T08:08:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.487+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72cc0b02a0 con 0x7f72dc0b2bd0 2023-11-24T08:08:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.487+0000 7f72da7fc640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72c806ae40 0x7f72c806d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f72dc14d2b0 tx=0x7f72d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.487+0000 7f72db7fe640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7f72c8070ca0 0x7f72c80730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.489+0000 7f72db7fe640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7f72c8070ca0 0x7f72c80730c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.491+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== osd.4 v2:172.21.15.183:6800/1731286381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f72c8073770 con 0x7f72c8070ca0 2023-11-24T08:08:41.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.505+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 --> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f72dc071a30 con 0x7f72c8070ca0 2023-11-24T08:08:41.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.506+0000 7f72c37fe640 1 -- 172.21.15.97:0/803041608 <== osd.4 v2:172.21.15.183:6800/1731286381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f72d400ac70 con 0x7f72c8070ca0 2023-11-24T08:08:41.508 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:41.509 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:41.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.506+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7f72c8070ca0 msgr2=0x7f72c80730c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.506+0000 7f72e1533640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.183:6800/1731286381,v1:172.21.15.183:6801/1731286381] conn(0x7f72c8070ca0 0x7f72c80730c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72c806ae40 msgr2=0x7f72c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f72c806ae40 0x7f72c806d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f72dc14d2b0 tx=0x7f72d0008040 comp rx=0 tx=0).stop 2023-11-24T08:08:41.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc0b2bd0 msgr2=0x7f72dc1efa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 --2- 172.21.15.97:0/803041608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72dc0b2bd0 0x7f72dc1efa40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f72cc000c00 tx=0x7f72cc0046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72db7fe640 1 -- 172.21.15.97:0/803041608 reap_dead start 2023-11-24T08:08:41.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 shutdown_connections 2023-11-24T08:08:41.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 >> 172.21.15.97:0/803041608 conn(0x7f72dc06a800 msgr2=0x7f72dc070350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:41.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 shutdown_connections 2023-11-24T08:08:41.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.507+0000 7f72e1533640 1 -- 172.21.15.97:0/803041608 wait complete. 2023-11-24T08:08:41.527 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T08:08:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.731+0000 7f9c2631d640 1 Processor -- start 2023-11-24T08:08:41.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.732+0000 7f9c2631d640 1 -- start start 2023-11-24T08:08:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.733+0000 7f9c2631d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a3e0 0x7f9c200ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.733+0000 7f9c2631d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c200d0b60 0x7f9c200aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.733+0000 7f9c2631d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c2006a7c0 0x7f9c2006f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.733+0000 7f9c2631d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200af320 con 0x7f9c2006a7c0 2023-11-24T08:08:41.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.733+0000 7f9c2631d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c20071de0 con 0x7f9c200d0b60 2023-11-24T08:08:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.733+0000 7f9c2631d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c20072030 con 0x7f9c2006a3e0 2023-11-24T08:08:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.733+0000 7f9c248ba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c2006a7c0 0x7f9c2006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c248ba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c2006a7c0 0x7f9c2006f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40676/0 (socket says 172.21.15.97:40676) 2023-11-24T08:08:41.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c248ba640 1 -- 172.21.15.97:0/2621954184 learned_addr learned my addr 172.21.15.97:0/2621954184 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c1ffff640 1 --2- 172.21.15.97:0/2621954184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a3e0 0x7f9c200ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c1f7fe640 1 --2- 172.21.15.97:0/2621954184 >> v2:172.21.15.183:3300/0 conn(0x7f9c200d0b60 0x7f9c200aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c248ba640 1 -- 172.21.15.97:0/2621954184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a3e0 msgr2=0x7f9c200ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c248ba640 1 --2- 172.21.15.97:0/2621954184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a3e0 0x7f9c200ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c248ba640 1 -- 172.21.15.97:0/2621954184 >> v2:172.21.15.183:3300/0 conn(0x7f9c200d0b60 msgr2=0x7f9c200aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c248ba640 1 --2- 172.21.15.97:0/2621954184 >> v2:172.21.15.183:3300/0 conn(0x7f9c200d0b60 0x7f9c200aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c248ba640 1 -- 172.21.15.97:0/2621954184 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20072310 con 0x7f9c2006a7c0 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.734+0000 7f9c1f7fe640 1 --2- 172.21.15.97:0/2621954184 >> v2:172.21.15.183:3300/0 conn(0x7f9c200d0b60 0x7f9c200aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.735+0000 7f9c248ba640 1 --2- 172.21.15.97:0/2621954184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c2006a7c0 0x7f9c2006f080 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9c2006e5a0 tx=0x7f9c1802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13f02db3ab04b6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c1effd640 1 -- 172.21.15.97:0/2621954184 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18031870 con 0x7f9c2006a7c0 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c1effd640 1 -- 172.21.15.97:0/2621954184 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180319d0 con 0x7f9c2006a7c0 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c1effd640 1 -- 172.21.15.97:0/2621954184 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18031d60 con 0x7f9c2006a7c0 2023-11-24T08:08:41.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 -- 172.21.15.97:0/2621954184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c2006a7c0 msgr2=0x7f9c2006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 --2- 172.21.15.97:0/2621954184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c2006a7c0 0x7f9c2006f080 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9c2006e5a0 tx=0x7f9c1802b910 comp rx=0 tx=0).stop 2023-11-24T08:08:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 -- 172.21.15.97:0/2621954184 shutdown_connections 2023-11-24T08:08:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 --2- 172.21.15.97:0/2621954184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c2006a7c0 0x7f9c2006f080 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 --2- 172.21.15.97:0/2621954184 >> v2:172.21.15.183:3300/0 conn(0x7f9c200d0b60 0x7f9c200aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 --2- 172.21.15.97:0/2621954184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a3e0 0x7f9c200ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 -- 172.21.15.97:0/2621954184 >> 172.21.15.97:0/2621954184 conn(0x7f9c200cfef0 msgr2=0x7f9c200d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:41.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 -- 172.21.15.97:0/2621954184 shutdown_connections 2023-11-24T08:08:41.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.736+0000 7f9c2631d640 1 -- 172.21.15.97:0/2621954184 wait complete. 2023-11-24T08:08:41.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.738+0000 7f9c2631d640 1 Processor -- start 2023-11-24T08:08:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.738+0000 7f9c2631d640 1 -- start start 2023-11-24T08:08:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c2631d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c2006a3e0 0x7f9c20149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c2631d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a7c0 0x7f9c2015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c2631d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c200d0b60 0x7f9c20156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c2631d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c20149f40 con 0x7f9c200d0b60 2023-11-24T08:08:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c2631d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c201f6450 con 0x7f9c2006a3e0 2023-11-24T08:08:41.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c2631d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c201f6730 con 0x7f9c2006a7c0 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c248ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c200d0b60 0x7f9c20156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c248ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c200d0b60 0x7f9c20156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40682/0 (socket says 172.21.15.97:40682) 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.739+0000 7f9c248ba640 1 -- 172.21.15.97:0/962724444 learned_addr learned my addr 172.21.15.97:0/962724444 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c1ffff640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c2006a3e0 0x7f9c20149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c1f7fe640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a7c0 0x7f9c2015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c248ba640 1 -- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a7c0 msgr2=0x7f9c2015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c248ba640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a7c0 0x7f9c2015fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c248ba640 1 -- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c2006a3e0 msgr2=0x7f9c20149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c248ba640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c2006a3e0 0x7f9c20149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c248ba640 1 -- 172.21.15.97:0/962724444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180094d0 con 0x7f9c200d0b60 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c1f7fe640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a7c0 0x7f9c2015fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c248ba640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c200d0b60 0x7f9c20156440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9c180090b0 tx=0x7f9c180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c1cff9640 1 -- 172.21.15.97:0/962724444 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1803ac60 con 0x7f9c200d0b60 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.740+0000 7f9c1cff9640 1 -- 172.21.15.97:0/962724444 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1803adc0 con 0x7f9c200d0b60 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.741+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c201f6a10 con 0x7f9c200d0b60 2023-11-24T08:08:41.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.741+0000 7f9c1cff9640 1 -- 172.21.15.97:0/962724444 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18044630 con 0x7f9c200d0b60 2023-11-24T08:08:41.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.741+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c201f6fd0 con 0x7f9c200d0b60 2023-11-24T08:08:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.742+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c201f71c0 con 0x7f9c200d0b60 2023-11-24T08:08:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.743+0000 7f9c1cff9640 1 -- 172.21.15.97:0/962724444 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c1804d450 con 0x7f9c200d0b60 2023-11-24T08:08:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.743+0000 7f9c1cff9640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9c0006ae40 0x7f9c0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.744+0000 7f9c1cff9640 1 -- 172.21.15.97:0/962724444 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c1802d040 con 0x7f9c200d0b60 2023-11-24T08:08:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.744+0000 7f9c1ffff640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9c0006ae40 0x7f9c0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:41.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.744+0000 7f9c1ffff640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9c0006ae40 0x7f9c0006d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009a60 tx=0x7f9c10003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:41.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.748+0000 7f9c1cff9640 1 -- 172.21.15.97:0/962724444 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c18076cc0 con 0x7f9c200d0b60 2023-11-24T08:08:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.936+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c201f68a0 con 0x7f9c0006ae40 2023-11-24T08:08:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.937+0000 7f9c1cff9640 1 -- 172.21.15.97:0/962724444 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9c201f68a0 con 0x7f9c0006ae40 2023-11-24T08:08:41.940 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T08:08:41.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9c0006ae40 msgr2=0x7f9c0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9c0006ae40 0x7f9c0006d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009a60 tx=0x7f9c10003990 comp rx=0 tx=0).stop 2023-11-24T08:08:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c200d0b60 msgr2=0x7f9c20156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c200d0b60 0x7f9c20156440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9c180090b0 tx=0x7f9c180046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 shutdown_connections 2023-11-24T08:08:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9c0006ae40 0x7f9c0006d300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c200d0b60 0x7f9c20156440 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c2006a7c0 0x7f9c2015fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 --2- 172.21.15.97:0/962724444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c2006a3e0 0x7f9c20149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 >> 172.21.15.97:0/962724444 conn(0x7f9c200cfef0 msgr2=0x7f9c2006ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 shutdown_connections 2023-11-24T08:08:41.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:41.940+0000 7f9c2631d640 1 -- 172.21.15.97:0/962724444 wait complete. 2023-11-24T08:08:41.961 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T08:08:41.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.178+0000 7fe15e7b7640 1 Processor -- start 2023-11-24T08:08:42.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.179+0000 7fe15e7b7640 1 -- start start 2023-11-24T08:08:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.180+0000 7fe15e7b7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe1580cf9a0 0x7fe15815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.180+0000 7fe15e7b7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 0x7fe1580702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.180+0000 7fe15e7b7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1580b1ee0 con 0x7fe158143ae0 2023-11-24T08:08:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.180+0000 7fe15e7b7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1580b2780 con 0x7fe1580cf9a0 2023-11-24T08:08:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.180+0000 7fe15e7b7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15815e990 con 0x7fe15815e1e0 2023-11-24T08:08:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.181+0000 7fe15cd54640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 0x7fe1580702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.181+0000 7fe14ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe1580cf9a0 0x7fe15815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.181+0000 7fe157fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe158143ae0 0x7fe1580cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:39482/0 (socket says 172.21.15.97:39482) 2023-11-24T08:08:42.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.181+0000 7fe157fff640 1 -- 172.21.15.97:0/1872969876 learned_addr learned my addr 172.21.15.97:0/1872969876 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:42.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.182+0000 7fe14ffff640 1 -- 172.21.15.97:0/1872969876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 msgr2=0x7fe1580702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.182+0000 7fe14ffff640 1 --2- 172.21.15.97:0/1872969876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 0x7fe1580702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.182+0000 7fe14ffff640 1 -- 172.21.15.97:0/1872969876 >> v1:172.21.15.183:6789/0 conn(0x7fe158143ae0 legacy=0x7fe1580cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.182+0000 7fe14ffff640 1 -- 172.21.15.97:0/1872969876 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580b2130 con 0x7fe1580cf9a0 2023-11-24T08:08:42.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.183+0000 7fe14ffff640 1 --2- 172.21.15.97:0/1872969876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 0x7fe15815dca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe1400097a0 tx=0x7fe14002dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d074b80c7beeff6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe1577fe640 1 -- 172.21.15.97:0/1872969876 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14002f8a0 con 0x7fe1580cf9a0 2023-11-24T08:08:42.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe1577fe640 1 -- 172.21.15.97:0/1872969876 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14002fa00 con 0x7fe1580cf9a0 2023-11-24T08:08:42.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe1577fe640 1 -- 172.21.15.97:0/1872969876 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14002fd90 con 0x7fe1580cf9a0 2023-11-24T08:08:42.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1872969876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 msgr2=0x7fe15815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe15e7b7640 1 --2- 172.21.15.97:0/1872969876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 0x7fe15815dca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe1400097a0 tx=0x7fe14002dae0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1872969876 shutdown_connections 2023-11-24T08:08:42.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe15e7b7640 1 --2- 172.21.15.97:0/1872969876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 0x7fe1580702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe15e7b7640 1 --2- 172.21.15.97:0/1872969876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 0x7fe15815dca0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1872969876 >> 172.21.15.97:0/1872969876 conn(0x7fe15806a800 msgr2=0x7fe15806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.184+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1872969876 shutdown_connections 2023-11-24T08:08:42.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.185+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1872969876 wait complete. 2023-11-24T08:08:42.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.186+0000 7fe15e7b7640 1 Processor -- start 2023-11-24T08:08:42.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.186+0000 7fe15e7b7640 1 -- start start 2023-11-24T08:08:42.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.187+0000 7fe15e7b7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 0x7fe158141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.187+0000 7fe15e7b7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe158143ae0 0x7fe1581f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.187+0000 7fe15e7b7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 0x7fe15815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.187+0000 7fe15e7b7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581f3b00 con 0x7fe158143ae0 2023-11-24T08:08:42.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.187+0000 7fe15e7b7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580c45c0 con 0x7fe1580cf9a0 2023-11-24T08:08:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.187+0000 7fe15e7b7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580c4180 con 0x7fe15815e1e0 2023-11-24T08:08:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe158143ae0 0x7fe1581f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe158143ae0 0x7fe1581f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40692/0 (socket says 172.21.15.97:40692) 2023-11-24T08:08:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 -- 172.21.15.97:0/1940518703 learned_addr learned my addr 172.21.15.97:0/1940518703 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe15cd54640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 0x7fe15815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe157fff640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 0x7fe158141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 -- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 msgr2=0x7fe15815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe15815e1e0 0x7fe15815b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 -- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 msgr2=0x7fe158141b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 0x7fe158141b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 -- 172.21.15.97:0/1940518703 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140009400 con 0x7fe158143ae0 2023-11-24T08:08:42.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe157fff640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1580cf9a0 0x7fe158141b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:42.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.188+0000 7fe14ffff640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe158143ae0 0x7fe1581f2a70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe140009890 tx=0x7fe1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.189+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140030ab0 con 0x7fe158143ae0 2023-11-24T08:08:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.189+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe140030c30 con 0x7fe158143ae0 2023-11-24T08:08:42.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.189+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140042410 con 0x7fe158143ae0 2023-11-24T08:08:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.189+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1581f2fb0 con 0x7fe158143ae0 2023-11-24T08:08:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.189+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1581f3540 con 0x7fe158143ae0 2023-11-24T08:08:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.190+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe15815e670 con 0x7fe158143ae0 2023-11-24T08:08:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.191+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe140039400 con 0x7fe158143ae0 2023-11-24T08:08:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.192+0000 7fe1557fa640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe13806ae40 0x7fe13806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.192+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1400aad60 con 0x7fe158143ae0 2023-11-24T08:08:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.192+0000 7fe157fff640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe13806ae40 0x7fe13806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.192+0000 7fe1557fa640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7fe138070ca0 0x7fe1380730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.192+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 --> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe138073770 con 0x7fe138070ca0 2023-11-24T08:08:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.192+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1400ad340 con 0x7fe158143ae0 2023-11-24T08:08:42.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.193+0000 7fe157fff640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe13806ae40 0x7fe13806d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe148007fd0 tx=0x7fe148009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.193+0000 7fe15cd54640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7fe138070ca0 0x7fe1380730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.194+0000 7fe15cd54640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7fe138070ca0 0x7fe1380730c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.196+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== osd.5 v2:172.21.15.183:6816/3585625163 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe138073770 con 0x7fe138070ca0 2023-11-24T08:08:42.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.211+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 --> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe1580c4320 con 0x7fe138070ca0 2023-11-24T08:08:42.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.212+0000 7fe1557fa640 1 -- 172.21.15.97:0/1940518703 <== osd.5 v2:172.21.15.183:6816/3585625163 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe1580c4320 con 0x7fe138070ca0 2023-11-24T08:08:42.215 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:42.215 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:42.215 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.212+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7fe138070ca0 msgr2=0x7fe1380730c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.212+0000 7fe15e7b7640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.183:6816/3585625163,v1:172.21.15.183:6817/3585625163] conn(0x7fe138070ca0 0x7fe1380730c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe13806ae40 msgr2=0x7fe13806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fe13806ae40 0x7fe13806d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe148007fd0 tx=0x7fe148009040 comp rx=0 tx=0).stop 2023-11-24T08:08:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe158143ae0 msgr2=0x7fe1581f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 --2- 172.21.15.97:0/1940518703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe158143ae0 0x7fe1581f2a70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe140009890 tx=0x7fe1400046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15cd54640 1 -- 172.21.15.97:0/1940518703 reap_dead start 2023-11-24T08:08:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 shutdown_connections 2023-11-24T08:08:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 >> 172.21.15.97:0/1940518703 conn(0x7fe15806a800 msgr2=0x7fe15806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 shutdown_connections 2023-11-24T08:08:42.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.213+0000 7fe15e7b7640 1 -- 172.21.15.97:0/1940518703 wait complete. 2023-11-24T08:08:42.231 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T08:08:42.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.436+0000 7fcf61bc4640 1 Processor -- start 2023-11-24T08:08:42.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.437+0000 7fcf61bc4640 1 -- start start 2023-11-24T08:08:42.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.438+0000 7fcf61bc4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 0x7fcf5c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.438+0000 7fcf61bc4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcf5c0cf7d0 0x7fcf5c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.438+0000 7fcf61bc4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0cfbf0 con 0x7fcf5c070ea0 2023-11-24T08:08:42.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.438+0000 7fcf61bc4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c14b6a0 con 0x7fcf5c0cf7d0 2023-11-24T08:08:42.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.438+0000 7fcf61bc4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c071690 con 0x7fcf5c14b2c0 2023-11-24T08:08:42.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.439+0000 7fcf5bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcf5c070ea0 0x7fcf5c0b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33952/0 (socket says 172.21.15.97:33952) 2023-11-24T08:08:42.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.439+0000 7fcf5bfff640 1 -- 172.21.15.97:0/1069545767 learned_addr learned my addr 172.21.15.97:0/1069545767 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:42.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.439+0000 7fcf5affd640 1 --2- 172.21.15.97:0/1069545767 >> v2:172.21.15.183:3300/0 conn(0x7fcf5c0cf7d0 0x7fcf5c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.439+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 0x7fcf5c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.439+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806376246 0 0) 0x7fcf5c0cfbf0 con 0x7fcf5c070ea0 2023-11-24T08:08:42.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.439+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf48003520 con 0x7fcf5c070ea0 2023-11-24T08:08:42.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1711304651 0 0) 0x7fcf48003520 con 0x7fcf5c070ea0 2023-11-24T08:08:42.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 msgr2=0x7fcf5c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 0x7fcf5c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 >> v2:172.21.15.183:3300/0 conn(0x7fcf5c0cf7d0 msgr2=0x7fcf5c070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 --2- 172.21.15.97:0/1069545767 >> v2:172.21.15.183:3300/0 conn(0x7fcf5c0cf7d0 0x7fcf5c070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c071970 con 0x7fcf5c070ea0 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fcf54001670 con 0x7fcf5c070ea0 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 >> v1:172.21.15.97:6789/0 conn(0x7fcf5c070ea0 legacy=0x7fcf5c0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf480047c0 0x7fcf48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 0x7fcf48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c14b6a0 con 0x7fcf48003970 2023-11-24T08:08:42.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c071690 con 0x7fcf480047c0 2023-11-24T08:08:42.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800b980 con 0x7fcf5c14b2c0 2023-11-24T08:08:42.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5bfff640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 0x7fcf48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.440+0000 7fcf5affd640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf480047c0 0x7fcf48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.441+0000 7fcf5b7fe640 1 -- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 msgr2=0x7fcf48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.441+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c14b2c0 0x7fcf48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.441+0000 7fcf5b7fe640 1 -- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf480047c0 msgr2=0x7fcf48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.441+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf480047c0 0x7fcf48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.441+0000 7fcf5b7fe640 1 -- 172.21.15.97:0/1069545767 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48003520 con 0x7fcf48003970 2023-11-24T08:08:42.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.441+0000 7fcf5affd640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf480047c0 0x7fcf48004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:42.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.442+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf48003d90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009fc0 tx=0x7fcf480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6523676c5e066c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.442+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c02cc00 con 0x7fcf48003970 2023-11-24T08:08:42.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.442+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00f040 con 0x7fcf48003970 2023-11-24T08:08:42.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.442+0000 7fcf5a7fc640 1 -- 172.21.15.97:0/1069545767 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c034440 con 0x7fcf48003970 2023-11-24T08:08:42.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.443+0000 7fcf61bc4640 1 -- 172.21.15.97:0/1069545767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 msgr2=0x7fcf48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.443+0000 7fcf61bc4640 1 --2- 172.21.15.97:0/1069545767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf48003d90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009fc0 tx=0x7fcf480057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.443+0000 7fcf5bfff640 1 -- 172.21.15.97:0/1069545767 reap_dead start 2023-11-24T08:08:42.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.443+0000 7fcf61bc4640 1 -- 172.21.15.97:0/1069545767 shutdown_connections 2023-11-24T08:08:42.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.443+0000 7fcf61bc4640 1 -- 172.21.15.97:0/1069545767 >> 172.21.15.97:0/1069545767 conn(0x7fcf5c06a800 msgr2=0x7fcf5c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:42.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.443+0000 7fcf61bc4640 1 -- 172.21.15.97:0/1069545767 shutdown_connections 2023-11-24T08:08:42.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.443+0000 7fcf61bc4640 1 -- 172.21.15.97:0/1069545767 wait complete. 2023-11-24T08:08:42.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.445+0000 7fcf61bc4640 1 Processor -- start 2023-11-24T08:08:42.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.445+0000 7fcf61bc4640 1 -- start start 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf61bc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf5c161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf61bc4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf5c163980 0x7fcf5c13f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf61bc4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c0cd570 0x7fcf5c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf61bc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cdf60 con 0x7fcf48003970 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf61bc4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c13ffa0 con 0x7fcf5c163980 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf61bc4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c140280 con 0x7fcf5c0cd570 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf5c161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf5c161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40716/0 (socket says 172.21.15.97:40716) 2023-11-24T08:08:42.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.446+0000 7fcf5b7fe640 1 -- 172.21.15.97:0/639723421 learned_addr learned my addr 172.21.15.97:0/639723421 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:42.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf5b7fe640 1 -- 172.21.15.97:0/639723421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c0cd570 msgr2=0x7fcf5c0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c0cd570 0x7fcf5c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf5b7fe640 1 -- 172.21.15.97:0/639723421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf5c163980 msgr2=0x7fcf5c13f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf5c163980 0x7fcf5c13f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf5b7fe640 1 -- 172.21.15.97:0/639723421 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c140560 con 0x7fcf48003970 2023-11-24T08:08:42.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf5b7fe640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf5c161290 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c037040 tx=0x7fcf4c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf53fff640 1 -- 172.21.15.97:0/639723421 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c034bd0 con 0x7fcf48003970 2023-11-24T08:08:42.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf53fff640 1 -- 172.21.15.97:0/639723421 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c034d30 con 0x7fcf48003970 2023-11-24T08:08:42.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c140840 con 0x7fcf48003970 2023-11-24T08:08:42.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.447+0000 7fcf53fff640 1 -- 172.21.15.97:0/639723421 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c034ea0 con 0x7fcf48003970 2023-11-24T08:08:42.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.448+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c1f7380 con 0x7fcf48003970 2023-11-24T08:08:42.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.449+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c1f7570 con 0x7fcf48003970 2023-11-24T08:08:42.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.449+0000 7fcf53fff640 1 -- 172.21.15.97:0/639723421 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf4c040450 con 0x7fcf48003970 2023-11-24T08:08:42.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.450+0000 7fcf53fff640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcf3c06ae40 0x7fcf3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.450+0000 7fcf53fff640 1 -- 172.21.15.97:0/639723421 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf4c0abbc0 con 0x7fcf48003970 2023-11-24T08:08:42.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.451+0000 7fcf5affd640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcf3c06ae40 0x7fcf3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.451+0000 7fcf5affd640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcf3c06ae40 0x7fcf3c06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c1646a0 tx=0x7fcf44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.455+0000 7fcf53fff640 1 -- 172.21.15.97:0/639723421 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf5c1f7570 con 0x7fcf48003970 2023-11-24T08:08:42.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.645+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf5c0cbc40 con 0x7fcf3c06ae40 2023-11-24T08:08:42.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.646+0000 7fcf53fff640 1 -- 172.21.15.97:0/639723421 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf44006bd0 con 0x7fcf3c06ae40 2023-11-24T08:08:42.649 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T08:08:42.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcf3c06ae40 msgr2=0x7fcf3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcf3c06ae40 0x7fcf3c06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c1646a0 tx=0x7fcf44008040 comp rx=0 tx=0).stop 2023-11-24T08:08:42.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 msgr2=0x7fcf5c161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf5c161290 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c037040 tx=0x7fcf4c009750 comp rx=0 tx=0).stop 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 shutdown_connections 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fcf3c06ae40 0x7fcf3c06d300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf5c0cd570 0x7fcf5c0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf5c163980 0x7fcf5c13f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 --2- 172.21.15.97:0/639723421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf48003970 0x7fcf5c161290 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 >> 172.21.15.97:0/639723421 conn(0x7fcf5c06a800 msgr2=0x7fcf5c149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:42.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 shutdown_connections 2023-11-24T08:08:42.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.649+0000 7fcf61bc4640 1 -- 172.21.15.97:0/639723421 wait complete. 2023-11-24T08:08:42.670 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T08:08:42.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:42.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.874+0000 7fd6afb48640 1 Processor -- start 2023-11-24T08:08:42.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.874+0000 7fd6afb48640 1 -- start start 2023-11-24T08:08:42.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.876+0000 7fd6afb48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd6a80cd240 0x7fd6a80b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.876+0000 7fd6afb48640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a806cea0 con 0x7fd6a809a170 2023-11-24T08:08:42.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.876+0000 7fd6afb48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a806cbc0 con 0x7fd6a806c6b0 2023-11-24T08:08:42.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.876+0000 7fd6afb48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a806f350 con 0x7fd6a80cd240 2023-11-24T08:08:42.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.876+0000 7fd6ae0e5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd6a809a170 0x7fd6a80cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33968/0 (socket says 172.21.15.97:33968) 2023-11-24T08:08:42.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.876+0000 7fd6ae0e5640 1 -- 172.21.15.97:0/2320290829 learned_addr learned my addr 172.21.15.97:0/2320290829 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:42.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ad8e4640 1 --2- 172.21.15.97:0/2320290829 >> v2:172.21.15.183:3300/0 conn(0x7fd6a80cd240 0x7fd6a80b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200851917 0 0) 0x7fd6a806cea0 con 0x7fd6a809a170 2023-11-24T08:08:42.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd690003520 con 0x7fd6a809a170 2023-11-24T08:08:42.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431137009 0 0) 0x7fd690003520 con 0x7fd6a809a170 2023-11-24T08:08:42.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 >> v2:172.21.15.183:3300/0 conn(0x7fd6a80cd240 msgr2=0x7fd6a80b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 --2- 172.21.15.97:0/2320290829 >> v2:172.21.15.183:3300/0 conn(0x7fd6a80cd240 0x7fd6a80b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 >> v1:172.21.15.183:6789/0 conn(0x7fd6a806c6b0 legacy=0x7fd6a8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a806f630 con 0x7fd6a809a170 2023-11-24T08:08:42.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7fd6a00019f0 con 0x7fd6a809a170 2023-11-24T08:08:42.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 >> v1:172.21.15.97:6789/0 conn(0x7fd6a809a170 legacy=0x7fd6a80cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd690003970 0x7fd690003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd690004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd690005180 0x7fd69000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a806f350 con 0x7fd6900047c0 2023-11-24T08:08:42.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69000c020 con 0x7fd690005180 2023-11-24T08:08:42.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.877+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69000c1e0 con 0x7fd690003970 2023-11-24T08:08:42.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.878+0000 7fd6ad0e3640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd690004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.878+0000 7fd6ad0e3640 1 -- 172.21.15.97:0/2320290829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd690003970 msgr2=0x7fd690003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.878+0000 7fd6ad0e3640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd690003970 0x7fd690003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.878+0000 7fd6ad0e3640 1 -- 172.21.15.97:0/2320290829 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd690005180 msgr2=0x7fd69000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:42.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.878+0000 7fd6ad0e3640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd690005180 0x7fd69000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.878+0000 7fd6ae0e5640 1 -- 172.21.15.97:0/2320290829 reap_dead start 2023-11-24T08:08:42.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.878+0000 7fd6ad0e3640 1 -- 172.21.15.97:0/2320290829 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690003520 con 0x7fd6900047c0 2023-11-24T08:08:42.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.879+0000 7fd6ad0e3640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd690004c40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4001720 tx=0x7fd6900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e677fc5c04d5c522 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.879+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a40052d0 con 0x7fd6900047c0 2023-11-24T08:08:42.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.879+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a402e050 con 0x7fd6900047c0 2023-11-24T08:08:42.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.879+0000 7fd6ac8e2640 1 -- 172.21.15.97:0/2320290829 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4003830 con 0x7fd6900047c0 2023-11-24T08:08:42.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.880+0000 7fd6afb48640 1 -- 172.21.15.97:0/2320290829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 msgr2=0x7fd690004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.880+0000 7fd6afb48640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd690004c40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4001720 tx=0x7fd6900057f0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.880+0000 7fd6afb48640 1 -- 172.21.15.97:0/2320290829 shutdown_connections 2023-11-24T08:08:42.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.880+0000 7fd6afb48640 1 --2- 172.21.15.97:0/2320290829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd690004c40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.880+0000 7fd6afb48640 1 -- 172.21.15.97:0/2320290829 >> 172.21.15.97:0/2320290829 conn(0x7fd6a80b2d00 msgr2=0x7fd6a80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:42.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.880+0000 7fd6afb48640 1 -- 172.21.15.97:0/2320290829 shutdown_connections 2023-11-24T08:08:42.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.880+0000 7fd6afb48640 1 -- 172.21.15.97:0/2320290829 wait complete. 2023-11-24T08:08:42.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.882+0000 7fd6afb48640 1 Processor -- start 2023-11-24T08:08:42.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.882+0000 7fd6afb48640 1 -- start start 2023-11-24T08:08:42.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6afb48640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd6a80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6afb48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6a80c9bb0 0x7fd6a8151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6afb48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6a80c82e0 0x7fd6a80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6afb48640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80c9720 con 0x7fd6900047c0 2023-11-24T08:08:42.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6afb48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80c8b10 con 0x7fd6a80c9bb0 2023-11-24T08:08:42.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6afb48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80c8df0 con 0x7fd6a80c82e0 2023-11-24T08:08:42.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6ad8e4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd6a80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6ad8e4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd6a80b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40728/0 (socket says 172.21.15.97:40728) 2023-11-24T08:08:42.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.883+0000 7fd6ad8e4640 1 -- 172.21.15.97:0/259989843 learned_addr learned my addr 172.21.15.97:0/259989843 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:42.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ae0e5640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6a80c82e0 0x7fd6a80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ad0e3640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6a80c9bb0 0x7fd6a8151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ad8e4640 1 -- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6a80c82e0 msgr2=0x7fd6a80b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ad8e4640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6a80c82e0 0x7fd6a80b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ad8e4640 1 -- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6a80c9bb0 msgr2=0x7fd6a8151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ad8e4640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6a80c9bb0 0x7fd6a8151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ad8e4640 1 -- 172.21.15.97:0/259989843 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80c90d0 con 0x7fd6900047c0 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6ad8e4640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd6a80b5330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e770 tx=0x7fd69800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69800c730 con 0x7fd6900047c0 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69800c890 con 0x7fd6900047c0 2023-11-24T08:08:42.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69800cc40 con 0x7fd6900047c0 2023-11-24T08:08:42.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.884+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a80c93b0 con 0x7fd6900047c0 2023-11-24T08:08:42.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.885+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a80b6380 con 0x7fd6900047c0 2023-11-24T08:08:42.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.885+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6a80cd620 con 0x7fd6900047c0 2023-11-24T08:08:42.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.887+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd698013470 con 0x7fd6900047c0 2023-11-24T08:08:42.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.887+0000 7fd69e7fc640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd69406ae70 0x7fd69406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.888+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd698089540 con 0x7fd6900047c0 2023-11-24T08:08:42.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.888+0000 7fd6ad0e3640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd69406ae70 0x7fd69406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.888+0000 7fd69e7fc640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7fd694070cd0 0x7fd6940730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:42.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.888+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 --> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6940737a0 con 0x7fd694070cd0 2023-11-24T08:08:42.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.888+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd69808bc00 con 0x7fd6900047c0 2023-11-24T08:08:42.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.888+0000 7fd6ad0e3640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd69406ae70 0x7fd69406d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4033000 tx=0x7fd6a4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.889+0000 7fd6ae0e5640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7fd694070cd0 0x7fd6940730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:42.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.890+0000 7fd6ae0e5640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7fd694070cd0 0x7fd6940730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:42.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.891+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== osd.6 v2:172.21.15.183:6818/553932600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd6940737a0 con 0x7fd694070cd0 2023-11-24T08:08:42.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.906+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 --> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd6a80c9860 con 0x7fd694070cd0 2023-11-24T08:08:42.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd69e7fc640 1 -- 172.21.15.97:0/259989843 <== osd.6 v2:172.21.15.183:6818/553932600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd6a0001e60 con 0x7fd694070cd0 2023-11-24T08:08:42.909 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:42.910 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:42.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7fd694070cd0 msgr2=0x7fd6940730f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.183:6818/553932600,v1:172.21.15.183:6820/553932600] conn(0x7fd694070cd0 0x7fd6940730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:42.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd69406ae70 msgr2=0x7fd69406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fd69406ae70 0x7fd69406d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4033000 tx=0x7fd6a4009030 comp rx=0 tx=0).stop 2023-11-24T08:08:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 msgr2=0x7fd6a80b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 --2- 172.21.15.97:0/259989843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6900047c0 0x7fd6a80b5330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e770 tx=0x7fd69800ec30 comp rx=0 tx=0).stop 2023-11-24T08:08:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6ae0e5640 1 -- 172.21.15.97:0/259989843 reap_dead start 2023-11-24T08:08:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 shutdown_connections 2023-11-24T08:08:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 >> 172.21.15.97:0/259989843 conn(0x7fd6a80b2d00 msgr2=0x7fd6a8099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 shutdown_connections 2023-11-24T08:08:42.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:42.907+0000 7fd6afb48640 1 -- 172.21.15.97:0/259989843 wait complete. 2023-11-24T08:08:42.927 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T08:08:43.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.136+0000 7f6aecd47640 1 Processor -- start 2023-11-24T08:08:43.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.136+0000 7f6aecd47640 1 -- start start 2023-11-24T08:08:43.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6aecd47640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ae813cda0 0x7f6ae815da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6aecd47640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae80cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6aecd47640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8071b50 con 0x7f6ae80cdef0 2023-11-24T08:08:43.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6aecd47640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80700f0 con 0x7f6ae813cda0 2023-11-24T08:08:43.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6aecd47640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae815e3e0 con 0x7f6ae815dfa0 2023-11-24T08:08:43.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6ae77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ae813cda0 0x7f6ae815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6ae77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ae813cda0 0x7f6ae815da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40730/0 (socket says 172.21.15.97:40730) 2023-11-24T08:08:43.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.138+0000 7f6ae77fe640 1 -- 172.21.15.97:0/2436142088 learned_addr learned my addr 172.21.15.97:0/2436142088 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:43.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.139+0000 7f6adffff640 1 --2- 172.21.15.97:0/2436142088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae80cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.139+0000 7f6ae77fe640 1 -- 172.21.15.97:0/2436142088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 msgr2=0x7f6ae80cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:43.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.139+0000 7f6ae77fe640 1 --2- 172.21.15.97:0/2436142088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae80cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.139+0000 7f6ae77fe640 1 -- 172.21.15.97:0/2436142088 >> v1:172.21.15.183:6789/0 conn(0x7f6ae80cdef0 legacy=0x7f6ae815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:43.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.139+0000 7f6ae77fe640 1 -- 172.21.15.97:0/2436142088 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80ce720 con 0x7f6ae813cda0 2023-11-24T08:08:43.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.140+0000 7f6ae77fe640 1 --2- 172.21.15.97:0/2436142088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae813cda0 0x7f6ae815da60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009870 tx=0x7f6ad802da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fa8763b5b4b1cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.140+0000 7f6ae6ffd640 1 -- 172.21.15.97:0/2436142088 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad802f830 con 0x7f6ae813cda0 2023-11-24T08:08:43.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.140+0000 7f6ae6ffd640 1 -- 172.21.15.97:0/2436142088 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad802f990 con 0x7f6ae813cda0 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.140+0000 7f6ae6ffd640 1 -- 172.21.15.97:0/2436142088 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad802fd20 con 0x7f6ae813cda0 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 -- 172.21.15.97:0/2436142088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae813cda0 msgr2=0x7f6ae815da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 --2- 172.21.15.97:0/2436142088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae813cda0 0x7f6ae815da60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009870 tx=0x7f6ad802da70 comp rx=0 tx=0).stop 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 -- 172.21.15.97:0/2436142088 shutdown_connections 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 --2- 172.21.15.97:0/2436142088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae80cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 --2- 172.21.15.97:0/2436142088 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae813cda0 0x7f6ae815da60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 -- 172.21.15.97:0/2436142088 >> 172.21.15.97:0/2436142088 conn(0x7f6ae806a3e0 msgr2=0x7f6ae806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:43.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 -- 172.21.15.97:0/2436142088 shutdown_connections 2023-11-24T08:08:43.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.141+0000 7f6aecd47640 1 -- 172.21.15.97:0/2436142088 wait complete. 2023-11-24T08:08:43.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.143+0000 7f6aecd47640 1 Processor -- start 2023-11-24T08:08:43.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.144+0000 7f6aecd47640 1 -- start start 2023-11-24T08:08:43.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6aecd47640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae80cdef0 0x7f6ae80adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6aecd47640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae813cda0 0x7f6ae8153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6aecd47640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae8156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6aecd47640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80ac8d0 con 0x7f6ae80cdef0 2023-11-24T08:08:43.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6aecd47640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80acb70 con 0x7f6ae813cda0 2023-11-24T08:08:43.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6aecd47640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80ace50 con 0x7f6ae815dfa0 2023-11-24T08:08:43.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6ae77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae80cdef0 0x7f6ae80adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6ae77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae80cdef0 0x7f6ae80adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40738/0 (socket says 172.21.15.97:40738) 2023-11-24T08:08:43.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.145+0000 7f6ae77fe640 1 -- 172.21.15.97:0/105881732 learned_addr learned my addr 172.21.15.97:0/105881732 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:43.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6adffff640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae813cda0 0x7f6ae8153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae77fe640 1 -- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 msgr2=0x7f6ae8156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae7fff640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae8156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae77fe640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae8156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae77fe640 1 -- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae813cda0 msgr2=0x7f6ae8153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae77fe640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae813cda0 0x7f6ae8153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae77fe640 1 -- 172.21.15.97:0/105881732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80094d0 con 0x7f6ae80cdef0 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6adffff640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae813cda0 0x7f6ae8153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:43.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae7fff640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae8156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:43.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.146+0000 7f6ae77fe640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae80cdef0 0x7f6ae80adc10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009990 tx=0x7f6ad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.147+0000 7f6ae4ff9640 1 -- 172.21.15.97:0/105881732 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8039690 con 0x7f6ae80cdef0 2023-11-24T08:08:43.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.147+0000 7f6ae4ff9640 1 -- 172.21.15.97:0/105881732 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad80397f0 con 0x7f6ae80cdef0 2023-11-24T08:08:43.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.147+0000 7f6ae4ff9640 1 -- 172.21.15.97:0/105881732 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8039ba0 con 0x7f6ae80cdef0 2023-11-24T08:08:43.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.147+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae80ad130 con 0x7f6ae80cdef0 2023-11-24T08:08:43.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.147+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae80ad4c0 con 0x7f6ae80cdef0 2023-11-24T08:08:43.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.148+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80ad930 con 0x7f6ae80cdef0 2023-11-24T08:08:43.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.149+0000 7f6ae4ff9640 1 -- 172.21.15.97:0/105881732 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ad8039d00 con 0x7f6ae80cdef0 2023-11-24T08:08:43.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.149+0000 7f6ae4ff9640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6ac806ae90 0x7f6ac806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.150+0000 7f6ae4ff9640 1 -- 172.21.15.97:0/105881732 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ad8034070 con 0x7f6ae80cdef0 2023-11-24T08:08:43.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.150+0000 7f6adffff640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6ac806ae90 0x7f6ac806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.151+0000 7f6adffff640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6ac806ae90 0x7f6ac806d350 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ae815b550 tx=0x7f6ad0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.154+0000 7f6ae4ff9640 1 -- 172.21.15.97:0/105881732 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ae80ad930 con 0x7f6ae80cdef0 2023-11-24T08:08:43.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.346+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ae80affd0 con 0x7f6ac806ae90 2023-11-24T08:08:43.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.347+0000 7f6ae4ff9640 1 -- 172.21.15.97:0/105881732 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ae80affd0 con 0x7f6ac806ae90 2023-11-24T08:08:43.349 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T08:08:43.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6ac806ae90 msgr2=0x7f6ac806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6ac806ae90 0x7f6ac806d350 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ae815b550 tx=0x7f6ad0008040 comp rx=0 tx=0).stop 2023-11-24T08:08:43.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae80cdef0 msgr2=0x7f6ae80adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae80cdef0 0x7f6ae80adc10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009990 tx=0x7f6ad80046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 shutdown_connections 2023-11-24T08:08:43.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f6ac806ae90 0x7f6ac806d350 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae815dfa0 0x7f6ae8156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae813cda0 0x7f6ae8153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 --2- 172.21.15.97:0/105881732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ae80cdef0 0x7f6ae80adc10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.349+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 >> 172.21.15.97:0/105881732 conn(0x7f6ae806a3e0 msgr2=0x7f6ae806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:43.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.350+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 shutdown_connections 2023-11-24T08:08:43.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.350+0000 7f6aecd47640 1 -- 172.21.15.97:0/105881732 wait complete. 2023-11-24T08:08:43.371 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T08:08:43.371 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:08:43.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.586+0000 7fc1d3f8e640 1 Processor -- start 2023-11-24T08:08:43.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.587+0000 7fc1d3f8e640 1 -- start start 2023-11-24T08:08:43.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.588+0000 7fc1d3f8e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc13e360 0x7fc1cc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.588+0000 7fc1d3f8e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc1cc15f9c0 0x7fc1cc0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.588+0000 7fc1d3f8e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc15c5f0 con 0x7fc1cc13df80 2023-11-24T08:08:43.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.588+0000 7fc1d3f8e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1cc06c470 con 0x7fc1cc15f9c0 2023-11-24T08:08:43.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.588+0000 7fc1d3f8e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc06c750 con 0x7fc1cc13e360 2023-11-24T08:08:43.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.589+0000 7fc1d1529640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc13e360 0x7fc1cc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.589+0000 7fc1d1d2a640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc1cc13df80 0x7fc1cc15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:39506/0 (socket says 172.21.15.97:39506) 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.589+0000 7fc1d1529640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc13e360 0x7fc1cc0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:47208/0 (socket says 172.21.15.97:47208) 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.589+0000 7fc1d1d2a640 1 -- 172.21.15.97:0/1999185767 learned_addr learned my addr 172.21.15.97:0/1999185767 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.589+0000 7fc1d252b640 1 --2- 172.21.15.97:0/1999185767 >> v2:172.21.15.183:3300/0 conn(0x7fc1cc15f9c0 0x7fc1cc0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.590+0000 7fc1d0d28640 1 -- 172.21.15.97:0/1999185767 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369077162 0 0) 0x7fc1cc15c5f0 con 0x7fc1cc13df80 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.590+0000 7fc1d0d28640 1 -- 172.21.15.97:0/1999185767 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b8003520 con 0x7fc1cc13df80 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.590+0000 7fc1d1529640 1 -- 172.21.15.97:0/1999185767 >> v2:172.21.15.183:3300/0 conn(0x7fc1cc15f9c0 msgr2=0x7fc1cc0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:43.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.590+0000 7fc1d1529640 1 --2- 172.21.15.97:0/1999185767 >> v2:172.21.15.183:3300/0 conn(0x7fc1cc15f9c0 0x7fc1cc0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.590+0000 7fc1d1529640 1 -- 172.21.15.97:0/1999185767 >> v1:172.21.15.183:6789/0 conn(0x7fc1cc13df80 legacy=0x7fc1cc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.590+0000 7fc1d1529640 1 -- 172.21.15.97:0/1999185767 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc06ca30 con 0x7fc1cc13e360 2023-11-24T08:08:43.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.590+0000 7fc1d252b640 1 --2- 172.21.15.97:0/1999185767 >> v2:172.21.15.183:3300/0 conn(0x7fc1cc15f9c0 0x7fc1cc0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:08:43.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.591+0000 7fc1d1529640 1 --2- 172.21.15.97:0/1999185767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc13e360 0x7fc1cc0cf290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0097a0 tx=0x7fc1bc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1c845603f66e0e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.592+0000 7fc1d0d28640 1 -- 172.21.15.97:0/1999185767 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc02d040 con 0x7fc1cc13e360 2023-11-24T08:08:43.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.592+0000 7fc1d0d28640 1 -- 172.21.15.97:0/1999185767 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc031810 con 0x7fc1cc13e360 2023-11-24T08:08:43.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.592+0000 7fc1d0d28640 1 -- 172.21.15.97:0/1999185767 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc031ba0 con 0x7fc1cc13e360 2023-11-24T08:08:43.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/1999185767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc13e360 msgr2=0x7fc1cc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 --2- 172.21.15.97:0/1999185767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc13e360 0x7fc1cc0cf290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0097a0 tx=0x7fc1bc02b8b0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/1999185767 shutdown_connections 2023-11-24T08:08:43.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 --2- 172.21.15.97:0/1999185767 >> v2:172.21.15.183:3300/0 conn(0x7fc1cc15f9c0 0x7fc1cc0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 --2- 172.21.15.97:0/1999185767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc13e360 0x7fc1cc0cf290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/1999185767 >> 172.21.15.97:0/1999185767 conn(0x7fc1cc06a800 msgr2=0x7fc1cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:43.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/1999185767 shutdown_connections 2023-11-24T08:08:43.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.593+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/1999185767 wait complete. 2023-11-24T08:08:43.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.595+0000 7fc1d3f8e640 1 Processor -- start 2023-11-24T08:08:43.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.595+0000 7fc1d3f8e640 1 -- start start 2023-11-24T08:08:43.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d3f8e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1cc13df80 0x7fc1cc169580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d3f8e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1cc13e360 0x7fc1cc13d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d3f8e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc15f9c0 0x7fc1cc1faac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d3f8e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc13dd80 con 0x7fc1cc13e360 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d3f8e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc169b90 con 0x7fc1cc13df80 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d3f8e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc169e70 con 0x7fc1cc15f9c0 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1cc13e360 0x7fc1cc13d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1cc13e360 0x7fc1cc13d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40740/0 (socket says 172.21.15.97:40740) 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 -- 172.21.15.97:0/574837988 learned_addr learned my addr 172.21.15.97:0/574837988 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1d2a640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1cc13df80 0x7fc1cc169580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d252b640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc15f9c0 0x7fc1cc1faac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 -- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc15f9c0 msgr2=0x7fc1cc1faac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1cc15f9c0 0x7fc1cc1faac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 -- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1cc13df80 msgr2=0x7fc1cc169580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1cc13df80 0x7fc1cc169580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.596+0000 7fc1d1529640 1 -- 172.21.15.97:0/574837988 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c4009a70 con 0x7fc1cc13e360 2023-11-24T08:08:43.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.597+0000 7fc1d1d2a640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1cc13df80 0x7fc1cc169580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:08:43.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.597+0000 7fc1d1529640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1cc13e360 0x7fc1cc13d840 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0098c0 tx=0x7fc1bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.597+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc03ace0 con 0x7fc1cc13e360 2023-11-24T08:08:43.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.597+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc03ae60 con 0x7fc1cc13e360 2023-11-24T08:08:43.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.597+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc009400 con 0x7fc1cc13e360 2023-11-24T08:08:43.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.597+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc044640 con 0x7fc1cc13e360 2023-11-24T08:08:43.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.597+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc156670 con 0x7fc1cc13e360 2023-11-24T08:08:43.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.598+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1cc169d00 con 0x7fc1cc13e360 2023-11-24T08:08:43.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.599+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1bc04d440 con 0x7fc1cc13e360 2023-11-24T08:08:43.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.600+0000 7fc1c27fc640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1b006ae40 0x7fc1b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.601+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc1bc0ab580 con 0x7fc1cc13e360 2023-11-24T08:08:43.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.601+0000 7fc1d1d2a640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1b006ae40 0x7fc1b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.601+0000 7fc1c27fc640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7fc1b0070ca0 0x7fc1b00730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.601+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 --> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1b0073770 con 0x7fc1b0070ca0 2023-11-24T08:08:43.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.601+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1bc0adb00 con 0x7fc1cc13e360 2023-11-24T08:08:43.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.601+0000 7fc1d1d2a640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1b006ae40 0x7fc1b006d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8005880 tx=0x7fc1c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.601+0000 7fc1d252b640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7fc1b0070ca0 0x7fc1b00730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.602+0000 7fc1d252b640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7fc1b0070ca0 0x7fc1b00730c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.606+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== osd.7 v2:172.21.15.183:6808/1489077381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc1b0073770 con 0x7fc1b0070ca0 2023-11-24T08:08:43.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.619+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 --> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc1cc06cff0 con 0x7fc1b0070ca0 2023-11-24T08:08:43.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.620+0000 7fc1c27fc640 1 -- 172.21.15.97:0/574837988 <== osd.7 v2:172.21.15.183:6808/1489077381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc1c4003990 con 0x7fc1b0070ca0 2023-11-24T08:08:43.623 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-11-24T08:08:43.623 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:08:43.623 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-11-24T08:08:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.620+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7fc1b0070ca0 msgr2=0x7fc1b00730c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.620+0000 7fc1d3f8e640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.183:6808/1489077381,v1:172.21.15.183:6809/1489077381] conn(0x7fc1b0070ca0 0x7fc1b00730c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1b006ae40 msgr2=0x7fc1b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fc1b006ae40 0x7fc1b006d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8005880 tx=0x7fc1c8009040 comp rx=0 tx=0).stop 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1cc13e360 msgr2=0x7fc1cc13d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 --2- 172.21.15.97:0/574837988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc1cc13e360 0x7fc1cc13d840 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0098c0 tx=0x7fc1bc0046c0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d252b640 1 -- 172.21.15.97:0/574837988 reap_dead start 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 shutdown_connections 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 >> 172.21.15.97:0/574837988 conn(0x7fc1cc06a800 msgr2=0x7fc1cc0cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 shutdown_connections 2023-11-24T08:08:43.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.621+0000 7fc1d3f8e640 1 -- 172.21.15.97:0/574837988 wait complete. 2023-11-24T08:08:43.641 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T08:08:43.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.849+0000 7ff92874c640 1 Processor -- start 2023-11-24T08:08:43.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.849+0000 7ff92874c640 1 -- start start 2023-11-24T08:08:43.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.851+0000 7ff92874c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff92014b2c0 0x7ff9200cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.851+0000 7ff92874c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff9200cf7d0 0x7ff920070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.851+0000 7ff92874c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9200cfbf0 con 0x7ff920070ea0 2023-11-24T08:08:43.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.851+0000 7ff92874c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92014b6a0 con 0x7ff9200cf7d0 2023-11-24T08:08:43.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.851+0000 7ff92874c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff920071690 con 0x7ff92014b2c0 2023-11-24T08:08:43.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff925ce7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff9200cf7d0 0x7ff920070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff926ce9640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ff920070ea0 0x7ff9200b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.97:39510/0 (socket says 172.21.15.97:39510) 2023-11-24T08:08:43.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff9264e8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff92014b2c0 0x7ff9200cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff926ce9640 1 -- 172.21.15.97:0/358174775 learned_addr learned my addr 172.21.15.97:0/358174775 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:08:43.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff925ce7640 1 -- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff92014b2c0 msgr2=0x7ff9200cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:43.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff925ce7640 1 --2- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff92014b2c0 0x7ff9200cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff925ce7640 1 -- 172.21.15.97:0/358174775 >> v1:172.21.15.183:6789/0 conn(0x7ff920070ea0 legacy=0x7ff9200b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff925ce7640 1 -- 172.21.15.97:0/358174775 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920071970 con 0x7ff9200cf7d0 2023-11-24T08:08:43.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.852+0000 7ff9264e8640 1 --2- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff92014b2c0 0x7ff9200cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:08:43.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.854+0000 7ff925ce7640 1 --2- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9200cf7d0 0x7ff920070960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097a0 tx=0x7ff91002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f968ea82c85d843 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.854+0000 7ff9254e6640 1 -- 172.21.15.97:0/358174775 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91002d040 con 0x7ff9200cf7d0 2023-11-24T08:08:43.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.854+0000 7ff9254e6640 1 -- 172.21.15.97:0/358174775 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff910031810 con 0x7ff9200cf7d0 2023-11-24T08:08:43.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.854+0000 7ff9254e6640 1 -- 172.21.15.97:0/358174775 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910031ba0 con 0x7ff9200cf7d0 2023-11-24T08:08:43.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 -- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9200cf7d0 msgr2=0x7ff920070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 --2- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9200cf7d0 0x7ff920070960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097a0 tx=0x7ff91002b8b0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 -- 172.21.15.97:0/358174775 shutdown_connections 2023-11-24T08:08:43.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 --2- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9200cf7d0 0x7ff920070960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 --2- 172.21.15.97:0/358174775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff92014b2c0 0x7ff9200cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 -- 172.21.15.97:0/358174775 >> 172.21.15.97:0/358174775 conn(0x7ff92006a800 msgr2=0x7ff92006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:43.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 -- 172.21.15.97:0/358174775 shutdown_connections 2023-11-24T08:08:43.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.855+0000 7ff92874c640 1 -- 172.21.15.97:0/358174775 wait complete. 2023-11-24T08:08:43.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.857+0000 7ff92874c640 1 Processor -- start 2023-11-24T08:08:43.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.857+0000 7ff92874c640 1 -- start start 2023-11-24T08:08:43.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff92874c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff920070ea0 0x7ff9201649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff92874c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9200cf7d0 0x7ff920145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff92874c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff92014b2c0 0x7ff9201487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff92874c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920163eb0 con 0x7ff920070ea0 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff92874c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920163330 con 0x7ff92014b2c0 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff92874c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff920163610 con 0x7ff9200cf7d0 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff9264e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff920070ea0 0x7ff9201649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff9264e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff920070ea0 0x7ff9201649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40752/0 (socket says 172.21.15.97:40752) 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.858+0000 7ff9264e8640 1 -- 172.21.15.97:0/3147267503 learned_addr learned my addr 172.21.15.97:0/3147267503 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:43.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff925ce7640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9200cf7d0 0x7ff920145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff9264e8640 1 -- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9200cf7d0 msgr2=0x7ff920145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff926ce9640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff92014b2c0 0x7ff9201487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff9264e8640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9200cf7d0 0x7ff920145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff9264e8640 1 -- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff92014b2c0 msgr2=0x7ff9201487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff9264e8640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff92014b2c0 0x7ff9201487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff9264e8640 1 -- 172.21.15.97:0/3147267503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009400 con 0x7ff920070ea0 2023-11-24T08:08:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff9264e8640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff920070ea0 0x7ff9201649b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00e960 tx=0x7ff91c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff916ffd640 1 -- 172.21.15.97:0/3147267503 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00ca00 con 0x7ff920070ea0 2023-11-24T08:08:43.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff916ffd640 1 -- 172.21.15.97:0/3147267503 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00cb60 con 0x7ff920070ea0 2023-11-24T08:08:43.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff916ffd640 1 -- 172.21.15.97:0/3147267503 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c013470 con 0x7ff920070ea0 2023-11-24T08:08:43.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.859+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff910009400 con 0x7ff920070ea0 2023-11-24T08:08:43.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.860+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff920163bd0 con 0x7ff920070ea0 2023-11-24T08:08:43.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.861+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9200675d0 con 0x7ff920070ea0 2023-11-24T08:08:43.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.861+0000 7ff916ffd640 1 -- 172.21.15.97:0/3147267503 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff91c0135d0 con 0x7ff920070ea0 2023-11-24T08:08:43.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.862+0000 7ff916ffd640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff90406ae70 0x7ff90406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:43.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.863+0000 7ff916ffd640 1 -- 172.21.15.97:0/3147267503 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff91c0895c0 con 0x7ff920070ea0 2023-11-24T08:08:43.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.863+0000 7ff925ce7640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff90406ae70 0x7ff90406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:43.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.863+0000 7ff925ce7640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff90406ae70 0x7ff90406d330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff910036000 tx=0x7ff91003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:43.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:43.867+0000 7ff916ffd640 1 -- 172.21.15.97:0/3147267503 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff91c0548c0 con 0x7ff920070ea0 2023-11-24T08:08:44.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.057+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9200cbc40 con 0x7ff90406ae70 2023-11-24T08:08:44.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.058+0000 7ff916ffd640 1 -- 172.21.15.97:0/3147267503 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff910031b00 con 0x7ff90406ae70 2023-11-24T08:08:44.061 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T08:08:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff90406ae70 msgr2=0x7ff90406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff90406ae70 0x7ff90406d330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff910036000 tx=0x7ff91003c040 comp rx=0 tx=0).stop 2023-11-24T08:08:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff920070ea0 msgr2=0x7ff9201649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff920070ea0 0x7ff9201649b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00e960 tx=0x7ff91c00ee20 comp rx=0 tx=0).stop 2023-11-24T08:08:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 shutdown_connections 2023-11-24T08:08:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7ff90406ae70 0x7ff90406d330 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff92014b2c0 0x7ff9201487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9200cf7d0 0x7ff920145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 --2- 172.21.15.97:0/3147267503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff920070ea0 0x7ff9201649b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 >> 172.21.15.97:0/3147267503 conn(0x7ff92006a800 msgr2=0x7ff9200aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:44.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 shutdown_connections 2023-11-24T08:08:44.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.061+0000 7ff92874c640 1 -- 172.21.15.97:0/3147267503 wait complete. 2023-11-24T08:08:44.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:44.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.283+0000 7f106cd68640 1 Processor -- start 2023-11-24T08:08:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.284+0000 7f106cd68640 1 -- start start 2023-11-24T08:08:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.285+0000 7f106cd68640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106813e360 0x7f10680cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.285+0000 7f106cd68640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f106815f9c0 0x7f10680cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.285+0000 7f106cd68640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106815c5f0 con 0x7f106813df80 2023-11-24T08:08:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.285+0000 7f106cd68640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106806c470 con 0x7f106815f9c0 2023-11-24T08:08:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.285+0000 7f106cd68640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106806c750 con 0x7f106813e360 2023-11-24T08:08:44.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.286+0000 7f105ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106813e360 0x7f10680cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.286+0000 7f105ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106813e360 0x7f10680cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.97:47250/0 (socket says 172.21.15.97:47250) 2023-11-24T08:08:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.286+0000 7f105ffff640 1 -- 172.21.15.97:0/2505987565 learned_addr learned my addr 172.21.15.97:0/2505987565 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.286+0000 7f1066d9d640 1 --2- 172.21.15.97:0/2505987565 >> v2:172.21.15.183:3300/0 conn(0x7f106815f9c0 0x7f10680cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.287+0000 7f105ffff640 1 -- 172.21.15.97:0/2505987565 >> v2:172.21.15.183:3300/0 conn(0x7f106815f9c0 msgr2=0x7f10680cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.287+0000 7f105ffff640 1 --2- 172.21.15.97:0/2505987565 >> v2:172.21.15.183:3300/0 conn(0x7f106815f9c0 0x7f10680cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.287+0000 7f105ffff640 1 -- 172.21.15.97:0/2505987565 >> v1:172.21.15.183:6789/0 conn(0x7f106813df80 legacy=0x7f106815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.287+0000 7f105ffff640 1 -- 172.21.15.97:0/2505987565 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106806ca30 con 0x7f106813e360 2023-11-24T08:08:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.288+0000 7f105ffff640 1 --2- 172.21.15.97:0/2505987565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106813e360 0x7f10680cf290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1050009870 tx=0x7f105002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f0c11480670d9f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f1065d9b640 1 -- 172.21.15.97:0/2505987565 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050030840 con 0x7f106813e360 2023-11-24T08:08:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f1065d9b640 1 -- 172.21.15.97:0/2505987565 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10500309a0 con 0x7f106813e360 2023-11-24T08:08:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f1065d9b640 1 -- 172.21.15.97:0/2505987565 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050030d30 con 0x7f106813e360 2023-11-24T08:08:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f106cd68640 1 -- 172.21.15.97:0/2505987565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106813e360 msgr2=0x7f10680cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f106cd68640 1 --2- 172.21.15.97:0/2505987565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106813e360 0x7f10680cf290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1050009870 tx=0x7f105002b980 comp rx=0 tx=0).stop 2023-11-24T08:08:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f106cd68640 1 -- 172.21.15.97:0/2505987565 shutdown_connections 2023-11-24T08:08:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f106cd68640 1 --2- 172.21.15.97:0/2505987565 >> v2:172.21.15.183:3300/0 conn(0x7f106815f9c0 0x7f10680cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f106cd68640 1 --2- 172.21.15.97:0/2505987565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106813e360 0x7f10680cf290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.289+0000 7f106cd68640 1 -- 172.21.15.97:0/2505987565 >> 172.21.15.97:0/2505987565 conn(0x7f106806a800 msgr2=0x7f106806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.290+0000 7f106cd68640 1 -- 172.21.15.97:0/2505987565 shutdown_connections 2023-11-24T08:08:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.290+0000 7f106cd68640 1 -- 172.21.15.97:0/2505987565 wait complete. 2023-11-24T08:08:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.292+0000 7f106cd68640 1 Processor -- start 2023-11-24T08:08:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.292+0000 7f106cd68640 1 -- start start 2023-11-24T08:08:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106cd68640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f106813df80 0x7f10681526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106cd68640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f106813e360 0x7f1068159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:44.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106cd68640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106815f9c0 0x7f106815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106cd68640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106813a490 con 0x7f106813df80 2023-11-24T08:08:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106cd68640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106813a770 con 0x7f106813e360 2023-11-24T08:08:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106cd68640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106813aa50 con 0x7f106815f9c0 2023-11-24T08:08:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f106813df80 0x7f10681526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f106813df80 0x7f10681526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40768/0 (socket says 172.21.15.97:40768) 2023-11-24T08:08:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.293+0000 7f106659c640 1 -- 172.21.15.97:0/1572303674 learned_addr learned my addr 172.21.15.97:0/1572303674 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:08:44.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f1066d9d640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106815f9c0 0x7f106815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f105ffff640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f106813e360 0x7f1068159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f106659c640 1 -- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106815f9c0 msgr2=0x7f106815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f106659c640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106815f9c0 0x7f106815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f106659c640 1 -- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f106813e360 msgr2=0x7f1068159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f106659c640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f106813e360 0x7f1068159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f106659c640 1 -- 172.21.15.97:0/1572303674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10500094d0 con 0x7f106813df80 2023-11-24T08:08:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f106659c640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f106813df80 0x7f10681526b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f105800c400 tx=0x7f105800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.294+0000 7f105effd640 1 -- 172.21.15.97:0/1572303674 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580052d0 con 0x7f106813df80 2023-11-24T08:08:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.295+0000 7f105effd640 1 -- 172.21.15.97:0/1572303674 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1058005430 con 0x7f106813df80 2023-11-24T08:08:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.295+0000 7f105effd640 1 -- 172.21.15.97:0/1572303674 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058003830 con 0x7f106813df80 2023-11-24T08:08:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.295+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106813ad30 con 0x7f106813df80 2023-11-24T08:08:44.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.295+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1068152bf0 con 0x7f106813df80 2023-11-24T08:08:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.296+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10680675d0 con 0x7f106813df80 2023-11-24T08:08:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.297+0000 7f105effd640 1 -- 172.21.15.97:0/1572303674 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1058003990 con 0x7f106813df80 2023-11-24T08:08:44.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.298+0000 7f105effd640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f104806ae40 0x7f104806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.298+0000 7f105effd640 1 -- 172.21.15.97:0/1572303674 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1058088930 con 0x7f106813df80 2023-11-24T08:08:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.298+0000 7f105ffff640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f104806ae40 0x7f104806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.299+0000 7f105ffff640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f104806ae40 0x7f104806d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1050036000 tx=0x7f1050008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:44.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.303+0000 7f105effd640 1 -- 172.21.15.97:0/1572303674 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1058053c40 con 0x7f106813df80 2023-11-24T08:08:44.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.491+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f106813a8e0 con 0x7f104806ae40 2023-11-24T08:08:44.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.497+0000 7f105effd640 1 -- 172.21.15.97:0/1572303674 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48675 (secure 0 0 0) 0x7f106813a8e0 con 0x7f104806ae40 2023-11-24T08:08:44.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:08:44.501 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:08:44.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.499+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f104806ae40 msgr2=0x7f104806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.499+0000 7f106cd68640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f104806ae40 0x7f104806d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1050036000 tx=0x7f1050008030 comp rx=0 tx=0).stop 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.499+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f106813df80 msgr2=0x7f10681526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.499+0000 7f106cd68640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f106813df80 0x7f10681526b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f105800c400 tx=0x7f105800c8c0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 shutdown_connections 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f104806ae40 0x7f104806d300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f106815f9c0 0x7f106815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f106813e360 0x7f1068159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 --2- 172.21.15.97:0/1572303674 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f106813df80 0x7f10681526b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:44.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 >> 172.21.15.97:0/1572303674 conn(0x7f106806a800 msgr2=0x7f106815dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:44.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 shutdown_connections 2023-11-24T08:08:44.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:08:44.500+0000 7f106cd68640 1 -- 172.21.15.97:0/1572303674 wait complete. 2023-11-24T08:08:44.522 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-11-24T08:08:43.303743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224908,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749812,"statfs":{"total":773094113280,"available":772863807488,"internally_reserved":0,"allocated":4694016,"data_stored":2558328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002786"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-24T08:08:30.345705+0000","last_change":"2023-11-24T08:06:37.357724+0000","last_active":"2023-11-24T08:08:30.345705+0000","last_peered":"2023-11-24T08:08:30.345705+0000","last_clean":"2023-11-24T08:08:30.345705+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:08:30.345705+0000","last_undegraded":"2023-11-24T08:08:30.345705+0000","last_fullsized":"2023-11-24T08:08:30.345705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:06:36.225022+0000","last_clean_scrub_stamp":"2023-11-24T08:06:36.225022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:18.493121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.64000000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.446,"5min":1.466,"15min":1.466},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0049999999999999,"15min":1.0109999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5169999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.2430000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.474,"5min":1.577,"15min":1.577},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1679999999999999,"15min":1.1859999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.502,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.165,"15min":1.169},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.6499999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2230000000000001,"15min":1.226},"min":{"1min":0.83499999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6479999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.111},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.24,"15min":1.2509999999999999},"min":{"1min":0.85799999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6879999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.399}]},{"osd":4,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3200000000000001,"15min":1.3340000000000001},"min":{"1min":0.76200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.6279999999999999,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.159},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.45,"15min":1.4550000000000001},"min":{"1min":0.72899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.736,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3260000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.427,"15min":1.4430000000000001},"min":{"1min":0.65800000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.762,"5min":3.444,"15min":3.444},"last":1.762},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4550000000000001,"15min":1.4730000000000001},"min":{"1min":0.66500000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0339999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.3580000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.4710000000000001,"15min":1.4830000000000001},"min":{"1min":0.68899999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.823,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.21},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.552,"15min":1.5669999999999999},"min":{"1min":0.70099999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9219999999999999,"5min":3.54,"15min":3.54},"last":1.9219999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.119,"15min":1.131},"min":{"1min":0.73499999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.98599999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.70699999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6000000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.097,"15min":1.083},"min":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.625,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.94499999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.82699999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6899999999999999,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.2509999999999999,"15min":1.264},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7210000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2210000000000001,"15min":1.22},"min":{"1min":0.78300000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.645,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.042},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3420000000000001,"15min":1.347},"min":{"1min":0.748,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.8300000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3220000000000001,"15min":1.3169999999999999},"min":{"1min":0.85299999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9470000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4790000000000001,"15min":1.4770000000000001},"min":{"1min":1.004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.0590000000000002,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.2609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3620000000000001,"15min":1.367},"min":{"1min":0.78000000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.052,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.452},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.419,"15min":1.4159999999999999},"min":{"1min":0.80700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.0089999999999999,"5min":2.335,"15min":2.335},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.5029999999999999,"15min":1.504},"min":{"1min":0.68000000000000005,"5min":0.62,"15min":0.62},"max":{"1min":2.153,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.5,"15min":1.502},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.887,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.532}]}]},{"osd":5,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.5600000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.458},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4139999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.224}]},{"osd":6,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.498},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.528}]},{"osd":7,"last update":"Fri Nov 24 08:07:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.349},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.657}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0549999999999999,"15min":1.0720000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.048},"min":{"1min":0.68799999999999994,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.458,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1339999999999999,"15min":1.1499999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.129,"15min":1.129},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5269999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.80500000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.222,"15min":1.2230000000000001},"min":{"1min":0.90800000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.6439999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.181,"15min":1.1950000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5409999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.077}]},{"osd":3,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.4039999999999999,"15min":1.4390000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.597,"5min":3.5099999999999998,"15min":3.5099999999999998},"last":1.23},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3740000000000001,"15min":1.387},"min":{"1min":0.89100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7010000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.3}]},{"osd":5,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.4690000000000001,"15min":1.5049999999999999},"min":{"1min":0.83799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.8129999999999999,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.5},{"interface":"front","average":{"1min":1.46,"5min":1.5429999999999999,"15min":1.5569999999999999},"min":{"1min":0.68000000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.8200000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.403}]},{"osd":6,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.5760000000000001,"15min":1.6000000000000001},"min":{"1min":1.01,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.9059999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.633,"15min":1.661},"min":{"1min":0.78800000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.857,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.579}]},{"osd":7,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.417,"15min":1.4399999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6599999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.204},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.7050000000000001,"15min":1.7330000000000001},"min":{"1min":0.96599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.913,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6859999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88900000000000001,"15min":0.88600000000000001},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5449999999999999,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.80800000000000005},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2310000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.87,"15min":0.85799999999999998},"min":{"1min":0.54200000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4810000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3959999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.036,"15min":1.0369999999999999},"min":{"1min":0.68700000000000006,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5109999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.077,"5min":1.0660000000000001,"15min":1.0640000000000001},"min":{"1min":0.46100000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.615,"5min":2.056,"15min":2.056},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.131,"15min":1.125},"min":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.105},{"interface":"front","average":{"1min":1.242,"5min":1.266,"15min":1.27},"min":{"1min":0.94099999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5449999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3049999999999999,"15min":1.298},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6060000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.325,"15min":1.3200000000000001},"min":{"1min":0.876,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7529999999999999,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.131}]},{"osd":6,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.234,"15min":1.244},"min":{"1min":0.88400000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.641,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.997},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.387,"15min":1.3859999999999999},"min":{"1min":1.1899999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6479999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4019999999999999,"15min":1.407},"min":{"1min":0.97899999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8120000000000001,"5min":2.532,"15min":2.532},"last":1.083},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.26,"15min":1.254},"min":{"1min":0.89000000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.6599999999999999,"5min":1.72,"15min":1.72},"last":1.21}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2430000000000001,"5min":1.486,"15min":1.486},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.94199999999999995,"15min":0.93000000000000005},"min":{"1min":0.66800000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.385,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.026}]},{"osd":3,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.99199999999999999,"15min":0.97799999999999998},"min":{"1min":0.61399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.113},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.0129999999999999,"15min":1.028},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.556,"5min":1.637,"15min":1.637},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2350000000000001,"15min":1.2490000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6399999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.995},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.264,"15min":1.268},"min":{"1min":0.91200000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.673,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.1719999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.268,"15min":1.2709999999999999},"min":{"1min":0.82199999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.593,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.268,"5min":1.3380000000000001,"15min":1.3500000000000001},"min":{"1min":0.76600000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.9379999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3120000000000001,"15min":1.3160000000000001},"min":{"1min":0.95999999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.5760000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.335,"15min":1.345},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.948,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.877}]},{"osd":7,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.357,"15min":1.357},"min":{"1min":0.998,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.9099999999999999,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.46,"15min":1.472},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.036,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":0.80700000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.177,"5min":1.639,"15min":1.639},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.417,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.0049999999999999,"15min":1.0229999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.5189999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.88900000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.99199999999999999,"15min":0.98399999999999999},"min":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5820000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.94699999999999995,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6850000000000001,"5min":1.726,"15min":1.726},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0669999999999999,"15min":1.077},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.4710000000000001,"5min":1.573,"15min":1.573},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.321,"15min":1.341},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.6000000000000001,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.133}]},{"osd":5,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.298,"15min":1.3200000000000001},"min":{"1min":0.84499999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.621,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.2130000000000001,"15min":1.2310000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6519999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.873}]},{"osd":6,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.335,"15min":1.3500000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.714,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.018},{"interface":"front","average":{"1min":1.21,"5min":1.244,"15min":1.25},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.734,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3859999999999999,"15min":1.413},"min":{"1min":0.71699999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.766,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.198},{"interface":"front","average":{"1min":1.284,"5min":1.413,"15min":1.4350000000000001},"min":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8120000000000001,"5min":2.992,"15min":2.992},"last":1.1579999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.135},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.98599999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.262},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.2130000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.353}]},{"osd":7,"last update":"Fri Nov 24 08:07:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.032},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.93799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:44.525 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T08:06:36.225022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=6, tm_sec=36, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=8, tm_sec=37, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T08:08:44.525 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T08:08:57.193 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:57.203 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:09:04.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:09:04.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.749+0000 7fbfd9cd4640 1 Processor -- start 2023-11-24T08:09:04.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.749+0000 7fbfd9cd4640 1 -- start start 2023-11-24T08:09:04.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfd9cd4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd4072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:04.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfd9cd4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfd415d300 0x7fbfd415d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfd9cd4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd415dc80 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfd9cd4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40b3770 con 0x7fbfd415d300 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfd9cd4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4071190 con 0x7fbfd4150760 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfcaffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfd415d300 0x7fbfd415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfd3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbfd40b2bd0 0x7fbfd40b3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51142/0 (socket says 172.21.15.97:51142) 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfcaffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfd415d300 0x7fbfd415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34084/0 (socket says 172.21.15.97:34084) 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.751+0000 7fbfd3fff640 1 -- 172.21.15.97:0/2465946304 learned_addr learned my addr 172.21.15.97:0/2465946304 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:09:04.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.752+0000 7fbfd37fe640 1 --2- 172.21.15.97:0/2465946304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd4072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:04.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.752+0000 7fbfcaffd640 1 -- 172.21.15.97:0/2465946304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 msgr2=0x7fbfd4072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:09:04.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.752+0000 7fbfcaffd640 1 --2- 172.21.15.97:0/2465946304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd4072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.752+0000 7fbfcaffd640 1 -- 172.21.15.97:0/2465946304 >> v1:172.21.15.97:6789/0 conn(0x7fbfd40b2bd0 legacy=0x7fbfd40b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:04.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.752+0000 7fbfcaffd640 1 -- 172.21.15.97:0/2465946304 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4071470 con 0x7fbfd415d300 2023-11-24T08:09:04.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.753+0000 7fbfcaffd640 1 --2- 172.21.15.97:0/2465946304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd415d300 0x7fbfd415d740 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00a940 tx=0x7fbfbc02cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fe92c782b33bc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:09:04.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.753+0000 7fbfd2ffd640 1 -- 172.21.15.97:0/2465946304 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc02db30 con 0x7fbfd415d300 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.753+0000 7fbfd2ffd640 1 -- 172.21.15.97:0/2465946304 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc02dc90 con 0x7fbfd415d300 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.753+0000 7fbfd2ffd640 1 -- 172.21.15.97:0/2465946304 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc035440 con 0x7fbfd415d300 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/2465946304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd415d300 msgr2=0x7fbfd415d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/2465946304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd415d300 0x7fbfd415d740 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00a940 tx=0x7fbfbc02cd80 comp rx=0 tx=0).stop 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/2465946304 shutdown_connections 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/2465946304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd415d300 0x7fbfd415d740 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/2465946304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd4072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/2465946304 >> 172.21.15.97:0/2465946304 conn(0x7fbfd406a800 msgr2=0x7fbfd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:09:04.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/2465946304 shutdown_connections 2023-11-24T08:09:04.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.754+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/2465946304 wait complete. 2023-11-24T08:09:04.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.756+0000 7fbfd9cd4640 1 Processor -- start 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.756+0000 7fbfd9cd4640 1 -- start start 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd9cd4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd40b2bd0 0x7fbfd40cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd9cd4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd41f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd9cd4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd415d300 0x7fbfd41f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd9cd4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40ac8d0 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd9cd4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd414b5f0 con 0x7fbfd415d300 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd9cd4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40ce6d0 con 0x7fbfd4150760 2023-11-24T08:09:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd40b2bd0 0x7fbfd40cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.757+0000 7fbfd37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd40b2bd0 0x7fbfd40cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34096/0 (socket says 172.21.15.97:34096) 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd37fe640 1 -- 172.21.15.97:0/34229655 learned_addr learned my addr 172.21.15.97:0/34229655 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfcaffd640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd41f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd37fe640 1 -- 172.21.15.97:0/34229655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 msgr2=0x7fbfd41f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd37fe640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd41f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd37fe640 1 -- 172.21.15.97:0/34229655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd415d300 msgr2=0x7fbfd41f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd37fe640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd415d300 0x7fbfd41f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd37fe640 1 -- 172.21.15.97:0/34229655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc00a5a0 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd37fe640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd40b2bd0 0x7fbfd40cdc30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400d800 tx=0x7fbfc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:09:04.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd0ff9640 1 -- 172.21.15.97:0/34229655 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400b6c0 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd0ff9640 1 -- 172.21.15.97:0/34229655 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc400b820 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd0ff9640 1 -- 172.21.15.97:0/34229655 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400bbb0 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.758+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd40ce9b0 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.759+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40ace00 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.760+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd40acf90 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.761+0000 7fbfd0ff9640 1 -- 172.21.15.97:0/34229655 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfc400bd10 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.762+0000 7fbfd0ff9640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbfb806ae40 0x7fbfb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.762+0000 7fbfd0ff9640 1 -- 172.21.15.97:0/34229655 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbfc4089950 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.762+0000 7fbfcaffd640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbfb806ae40 0x7fbfb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:04.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.763+0000 7fbfcaffd640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbfb806ae40 0x7fbfb806d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc037000 tx=0x7fbfbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:09:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.767+0000 7fbfd0ff9640 1 -- 172.21.15.97:0/34229655 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfc4054c60 con 0x7fbfd40b2bd0 2023-11-24T08:09:04.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.944+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 --> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfd4071d10 con 0x7fbfb806ae40 2023-11-24T08:09:04.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.947+0000 7fbfd0ff9640 1 -- 172.21.15.97:0/34229655 <== mgr.4101 v2:172.21.15.97:6832/2294833959 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48549 (secure 0 0 0) 0x7fbfbc035540 con 0x7fbfb806ae40 2023-11-24T08:09:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-11-24T08:09:04.950 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-11-24T08:09:04.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbfb806ae40 msgr2=0x7fbfb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:04.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbfb806ae40 0x7fbfb806d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc037000 tx=0x7fbfbc008040 comp rx=0 tx=0).stop 2023-11-24T08:09:04.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd40b2bd0 msgr2=0x7fbfd40cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:04.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd40b2bd0 0x7fbfd40cdc30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400d800 tx=0x7fbfc400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 shutdown_connections 2023-11-24T08:09:04.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7fbfb806ae40 0x7fbfb806d300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd415d300 0x7fbfd41f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4150760 0x7fbfd41f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 --2- 172.21.15.97:0/34229655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd40b2bd0 0x7fbfd40cdc30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:04.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 >> 172.21.15.97:0/34229655 conn(0x7fbfd406a800 msgr2=0x7fbfd414cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:09:04.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 shutdown_connections 2023-11-24T08:09:04.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:04.950+0000 7fbfd9cd4640 1 -- 172.21.15.97:0/34229655 wait complete. 2023-11-24T08:09:04.971 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2023-11-24T08:09:03.309310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224896,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749824,"statfs":{"total":773094113280,"available":772863819776,"internally_reserved":0,"allocated":4694016,"data_stored":2558328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003312"},"pg_stats":[{"pgid":"1.0","version":"38'119","reported_seq":190,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-24T08:08:46.302174+0000","last_change":"2023-11-24T08:08:46.302236+0000","last_active":"2023-11-24T08:08:46.302174+0000","last_peered":"2023-11-24T08:08:46.302174+0000","last_clean":"2023-11-24T08:08:46.302174+0000","last_became_active":"2023-11-24T08:06:37.354546+0000","last_became_peered":"2023-11-24T08:06:37.354546+0000","last_unstale":"2023-11-24T08:08:46.302174+0000","last_undegraded":"2023-11-24T08:08:46.302174+0000","last_fullsized":"2023-11-24T08:08:46.302174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2023-11-24T08:08:46.301980+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2023-11-24T08:08:46.301980+0000","last_clean_scrub_stamp":"2023-11-24T08:08:46.301980+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:58.935550+0000","scrub_duration":0.011930405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.64000000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.446,"5min":1.466,"15min":1.466},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0049999999999999,"15min":1.0109999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5169999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.177}]},{"osd":1,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.474,"5min":1.577,"15min":1.577},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1679999999999999,"15min":1.1859999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.502,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.145}]},{"osd":2,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.165,"15min":1.169},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.238},{"interface":"front","average":{"1min":1.234,"5min":1.24,"15min":1.2410000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.3500000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2230000000000001,"15min":1.226},"min":{"1min":0.83499999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6479999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.24,"15min":1.2509999999999999},"min":{"1min":0.85799999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.6879999999999999,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":1.0900000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3200000000000001,"15min":1.3340000000000001},"min":{"1min":0.76200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.6279999999999999,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.052},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.45,"15min":1.4550000000000001},"min":{"1min":0.72899999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.736,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4079999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.427,"15min":1.4430000000000001},"min":{"1min":0.65800000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.762,"5min":3.444,"15min":3.444},"last":1},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.4550000000000001,"15min":1.4730000000000001},"min":{"1min":0.66500000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0339999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.4710000000000001,"15min":1.4830000000000001},"min":{"1min":0.68899999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.823,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.552,"15min":1.5669999999999999},"min":{"1min":0.70099999999999996,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9219999999999999,"5min":3.54,"15min":3.54},"last":1.4670000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.119,"15min":1.131},"min":{"1min":0.73499999999999999,"5min":0.625,"15min":0.625},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.94699999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0760000000000001,"15min":1.081},"min":{"1min":0.70699999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6000000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.097,"15min":1.083},"min":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.625,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.641}]},{"osd":2,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.82699999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6899999999999999,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.2509999999999999,"15min":1.264},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7210000000000001,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.1220000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2210000000000001,"15min":1.22},"min":{"1min":0.78300000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.645,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3420000000000001,"15min":1.347},"min":{"1min":0.748,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.8300000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.3680000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3220000000000001,"15min":1.3169999999999999},"min":{"1min":0.85299999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9470000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4790000000000001,"15min":1.4770000000000001},"min":{"1min":1.004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.0590000000000002,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.4790000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3620000000000001,"15min":1.367},"min":{"1min":0.78000000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.052,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.419,"15min":1.4159999999999999},"min":{"1min":0.80700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.0089999999999999,"5min":2.335,"15min":2.335},"last":1.5369999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:08:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.5029999999999999,"15min":1.504},"min":{"1min":0.68000000000000005,"5min":0.62,"15min":0.62},"max":{"1min":2.153,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.593},{"interface":"front","average":{"1min":1.492,"5min":1.5,"15min":1.502},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.887,"5min":3.0579999999999998,"15min":3.0579999999999998},"last":1.508}]}]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98899999999999999,"15min":0.98999999999999999},"min":{"1min":0.72299999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5800000000000001,"5min":1.681,"15min":1.681},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.016,"15min":1.0029999999999999},"min":{"1min":0.73499999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.02}]},{"osd":1,"last update":"Fri Nov 24 08:08:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.081,"15min":1.0600000000000001},"min":{"1min":0.69699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.127,"15min":1.141},"min":{"1min":0.70699999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.369,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.28}]},{"osd":2,"last update":"Fri Nov 24 08:08:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1539999999999999,"15min":1.1399999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.2069999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2589999999999999,"15min":1.258},"min":{"1min":0.85799999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.419}]},{"osd":3,"last update":"Fri Nov 24 08:08:42 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.258,"15min":1.2410000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.173,"5min":4.173,"15min":4.173},"last":1.246},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.327,"15min":1.323},"min":{"1min":0.88700000000000001,"5min":0.871,"15min":0.871},"max":{"1min":1.837,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.603}]},{"osd":4,"last update":"Fri Nov 24 08:08:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2669999999999999,"15min":1.2649999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.4019999999999999,"15min":1.403},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":3.5960000000000001,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":1.139}]},{"osd":6,"last update":"Fri Nov 24 08:08:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.181},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.4570000000000001,"15min":1.446},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.93700000000000006}]},{"osd":7,"last update":"Fri Nov 24 08:08:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.476,"15min":1.454},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.649,"5min":1.597,"15min":1.589},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.3209999999999997,"5min":4.3209999999999997,"15min":4.3209999999999997},"last":1.504}]}]},{"osd":4,"up_from":14,"seq":60129542176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0549999999999999,"15min":1.0720000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.048},"min":{"1min":0.68799999999999994,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.458,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.1259999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1339999999999999,"15min":1.1499999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.419},{"interface":"front","average":{"1min":1.131,"5min":1.129,"15min":1.129},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5269999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.3999999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.222,"15min":1.2230000000000001},"min":{"1min":0.90800000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.6439999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.514},{"interface":"front","average":{"1min":1.101,"5min":1.181,"15min":1.1950000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5409999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.4550000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.4039999999999999,"15min":1.4390000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.597,"5min":3.5099999999999998,"15min":3.5099999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3740000000000001,"15min":1.387},"min":{"1min":0.89100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7010000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.4690000000000001,"15min":1.5049999999999999},"min":{"1min":0.83799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.8129999999999999,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.365},{"interface":"front","average":{"1min":1.46,"5min":1.5429999999999999,"15min":1.5569999999999999},"min":{"1min":0.68000000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.8200000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.649}]},{"osd":6,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.5760000000000001,"15min":1.6000000000000001},"min":{"1min":1.01,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.9059999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.633,"15min":1.661},"min":{"1min":0.78800000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.857,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.2350000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:08:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.417,"15min":1.4399999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6599999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.7050000000000001,"15min":1.7330000000000001},"min":{"1min":0.96599999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.913,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.3320000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542175,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88900000000000001,"15min":0.88600000000000001},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5449999999999999,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.80800000000000005},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2310000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.093}]},{"osd":1,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.87,"15min":0.85799999999999998},"min":{"1min":0.54200000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4810000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3959999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1910000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.036,"15min":1.0369999999999999},"min":{"1min":0.68700000000000006,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5109999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.998},{"interface":"front","average":{"1min":1.077,"5min":1.0660000000000001,"15min":1.0640000000000001},"min":{"1min":0.46100000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.615,"5min":2.056,"15min":2.056},"last":1.032}]},{"osd":4,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.131,"15min":1.125},"min":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.276},{"interface":"front","average":{"1min":1.242,"5min":1.266,"15min":1.27},"min":{"1min":0.94099999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5449999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.2310000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3049999999999999,"15min":1.298},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6060000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.325,"15min":1.3200000000000001},"min":{"1min":0.876,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7529999999999999,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.3240000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.234,"15min":1.244},"min":{"1min":0.88400000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.641,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.492},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.387,"15min":1.3859999999999999},"min":{"1min":1.1899999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6479999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.3640000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:08:35 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4019999999999999,"15min":1.407},"min":{"1min":0.97899999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.8120000000000001,"5min":2.532,"15min":2.532},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.26,"15min":1.254},"min":{"1min":0.89000000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.6599999999999999,"5min":1.72,"15min":1.72},"last":1.427}]}]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2430000000000001,"5min":1.486,"15min":1.486},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.5149999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.01,"5min":0.94199999999999995,"15min":0.93000000000000005},"min":{"1min":0.66800000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.385,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.99199999999999999,"15min":0.97799999999999998},"min":{"1min":0.61399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.175},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.0129999999999999,"15min":1.028},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.556,"5min":1.637,"15min":1.637},"last":1.375}]},{"osd":4,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.2350000000000001,"15min":1.2490000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6399999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.306},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.264,"15min":1.268},"min":{"1min":0.91200000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.673,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.274}]},{"osd":5,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.268,"15min":1.2709999999999999},"min":{"1min":0.82199999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.593,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3380000000000001,"15min":1.3500000000000001},"min":{"1min":0.76600000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.9379999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6100000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3120000000000001,"15min":1.3160000000000001},"min":{"1min":0.95999999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.5760000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.728},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.335,"15min":1.345},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.948,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:08:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.357,"15min":1.357},"min":{"1min":0.998,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.9099999999999999,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":1.407},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.46,"15min":1.472},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.036,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":1.6739999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":172199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.84899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.177,"5min":1.639,"15min":1.639},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.417,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.266}]},{"osd":2,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77000000000000002,"15min":0.76300000000000001},"min":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.0049999999999999,"15min":1.0229999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.5189999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.163}]},{"osd":3,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.99199999999999999,"15min":0.98399999999999999},"min":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.5820000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.391},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.94699999999999995,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6850000000000001,"5min":1.726,"15min":1.726},"last":1.444}]},{"osd":4,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0669999999999999,"15min":1.077},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.4710000000000001,"5min":1.573,"15min":1.573},"last":1.115},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.321,"15min":1.341},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.6000000000000001,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.514}]},{"osd":5,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.298,"15min":1.3200000000000001},"min":{"1min":0.84499999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.621,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.554},{"interface":"front","average":{"1min":1.109,"5min":1.2130000000000001,"15min":1.2310000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6519999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.335}]},{"osd":6,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.335,"15min":1.3500000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.714,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.244,"15min":1.25},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.734,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4830000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:08:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3859999999999999,"15min":1.413},"min":{"1min":0.71699999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.766,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.413,"15min":1.4350000000000001},"min":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8120000000000001,"5min":2.992,"15min":2.992},"last":1.631}]}]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1032192,"data_stored":762567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2030000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":1.032},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83799999999999997,"15min":0.84799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2929999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.3149999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.153,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.86199999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.226,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.90600000000000003}]},{"osd":3,"last update":"Fri Nov 24 08:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.45300000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2989999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.996},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.006,"15min":1.016},"min":{"1min":0.61499999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5449999999999999,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.444}]},{"osd":4,"last update":"Fri Nov 24 08:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2989999999999999,"15min":1.327},"min":{"1min":0.78800000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5289999999999999,"5min":2.96,"15min":2.96},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.121,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.554,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.117}]},{"osd":5,"last update":"Fri Nov 24 08:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2589999999999999,"15min":1.2669999999999999},"min":{"1min":0.83099999999999996,"5min":0.747,"15min":0.747},"max":{"1min":1.5049999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.3140000000000001,"15min":1.3300000000000001},"min":{"1min":0.94799999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.589,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.1910000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1759999999999999,"15min":1.1779999999999999},"min":{"1min":0.88500000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.45,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.391},{"interface":"front","average":{"1min":1.23,"5min":1.3120000000000001,"15min":1.3260000000000001},"min":{"1min":0.84999999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.601,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.5249999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:08:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3999999999999999,"15min":1.4239999999999999},"min":{"1min":0.89400000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6479999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2410000000000001,"15min":1.248},"min":{"1min":0.88700000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.544,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.282}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:09:04.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T08:09:05.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.173+0000 7f9def02d640 1 Processor -- start 2023-11-24T08:09:05.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.174+0000 7f9def02d640 1 -- start start 2023-11-24T08:09:05.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.175+0000 7f9def02d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9de809a170 0x7f9de80b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.175+0000 7f9def02d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de806cea0 con 0x7f9de80cd240 2023-11-24T08:09:05.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.175+0000 7f9def02d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de806cbc0 con 0x7f9de806c6b0 2023-11-24T08:09:05.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.175+0000 7f9def02d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de806f350 con 0x7f9de809a170 2023-11-24T08:09:05.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.175+0000 7f9decdc9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9de80cd240 0x7f9de8099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:51158/0 (socket says 172.21.15.97:51158) 2023-11-24T08:09:05.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.175+0000 7f9decdc9640 1 -- 172.21.15.97:0/1008054972 learned_addr learned my addr 172.21.15.97:0/1008054972 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-11-24T08:09:05.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035006479 0 0) 0x7f9de806cea0 con 0x7f9de80cd240 2023-11-24T08:09:05.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd4003520 con 0x7f9de80cd240 2023-11-24T08:09:05.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de7fff640 1 --2- 172.21.15.97:0/1008054972 >> v2:172.21.15.183:3300/0 conn(0x7f9de809a170 0x7f9de80b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874685640 0 0) 0x7f9dd4003520 con 0x7f9de80cd240 2023-11-24T08:09:05.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 >> v2:172.21.15.183:3300/0 conn(0x7f9de809a170 msgr2=0x7f9de80b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:09:05.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 --2- 172.21.15.97:0/1008054972 >> v2:172.21.15.183:3300/0 conn(0x7f9de809a170 0x7f9de80b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 >> v1:172.21.15.183:6789/0 conn(0x7f9de806c6b0 legacy=0x7f9de80cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:05.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de806f630 con 0x7f9de80cd240 2023-11-24T08:09:05.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2163479242 0 0) 0x7f9dd80019f0 con 0x7f9de80cd240 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 >> v1:172.21.15.97:6789/0 conn(0x7f9de80cd240 legacy=0x7f9de8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd4003970 0x7f9dd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dd40047c0 0x7f9dd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4005180 0x7f9dd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de806f350 con 0x7f9dd40047c0 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd400c0d0 con 0x7f9dd4005180 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.176+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd400c290 con 0x7f9dd4003970 2023-11-24T08:09:05.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9de7fff640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dd40047c0 0x7f9dd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9decdc9640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd4003970 0x7f9dd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9ded5ca640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4005180 0x7f9dd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9de7fff640 1 -- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd4003970 msgr2=0x7f9dd4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:09:05.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9de7fff640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd4003970 0x7f9dd4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9de7fff640 1 -- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4005180 msgr2=0x7f9dd400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:09:05.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9de7fff640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4005180 0x7f9dd400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9de7fff640 1 -- 172.21.15.97:0/1008054972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4003520 con 0x7f9dd40047c0 2023-11-24T08:09:05.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.177+0000 7f9ded5ca640 1 -- 172.21.15.97:0/1008054972 reap_dead start 2023-11-24T08:09:05.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.178+0000 7f9de7fff640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dd40047c0 0x7f9dd4004c40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000ba30 tx=0x7f9dd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c523d014cfd7fe21 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:09:05.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0032630 con 0x7f9dd40047c0 2023-11-24T08:09:05.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0032790 con 0x7f9dd40047c0 2023-11-24T08:09:05.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9de77fe640 1 -- 172.21.15.97:0/1008054972 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0032b20 con 0x7f9dd40047c0 2023-11-24T08:09:05.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9def02d640 1 -- 172.21.15.97:0/1008054972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dd40047c0 msgr2=0x7f9dd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:05.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9def02d640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dd40047c0 0x7f9dd4004c40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000ba30 tx=0x7f9dd40057f0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9def02d640 1 -- 172.21.15.97:0/1008054972 shutdown_connections 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9def02d640 1 --2- 172.21.15.97:0/1008054972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dd40047c0 0x7f9dd4004c40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.179+0000 7f9def02d640 1 -- 172.21.15.97:0/1008054972 >> 172.21.15.97:0/1008054972 conn(0x7f9de80b2d00 msgr2=0x7f9de80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.180+0000 7f9def02d640 1 -- 172.21.15.97:0/1008054972 shutdown_connections 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.180+0000 7f9def02d640 1 -- 172.21.15.97:0/1008054972 wait complete. 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.181+0000 7f9def02d640 1 Processor -- start 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.181+0000 7f9def02d640 1 -- start start 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.182+0000 7f9def02d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd40047c0 0x7f9de81f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.182+0000 7f9def02d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9de80c5160 0x7f9de81f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.182+0000 7f9def02d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9de81f2c90 0x7f9de80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.182+0000 7f9def02d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de81f60d0 con 0x7f9de81f2c90 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.182+0000 7f9def02d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de81f3600 con 0x7f9de80c5160 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.182+0000 7f9def02d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de81f38e0 con 0x7f9dd40047c0 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9de81f2c90 0x7f9de80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9de81f2c90 0x7f9de80cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34104/0 (socket says 172.21.15.97:34104) 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 -- 172.21.15.97:0/2379234295 learned_addr learned my addr 172.21.15.97:0/2379234295 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9decdc9640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd40047c0 0x7f9de81f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 -- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd40047c0 msgr2=0x7f9de81f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:05.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd40047c0 0x7f9de81f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 -- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9de80c5160 msgr2=0x7f9de81f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:05.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9de7fff640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9de80c5160 0x7f9de81f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9de80c5160 0x7f9de81f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 -- 172.21.15.97:0/2379234295 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de81f3bc0 con 0x7f9de81f2c90 2023-11-24T08:09:05.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.183+0000 7f9ded5ca640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9de81f2c90 0x7f9de80cf9f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9de80709e0 tx=0x7f9de000e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:09:05.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.184+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0005070 con 0x7f9de81f2c90 2023-11-24T08:09:05.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.184+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00051f0 con 0x7f9de81f2c90 2023-11-24T08:09:05.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.184+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de80c6aa0 con 0x7f9de81f2c90 2023-11-24T08:09:05.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.184+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0007030 con 0x7f9de81f2c90 2023-11-24T08:09:05.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.184+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de81f4390 con 0x7f9de81f2c90 2023-11-24T08:09:05.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.185+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de80c6900 con 0x7f9de81f2c90 2023-11-24T08:09:05.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.186+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9de0007190 con 0x7f9de81f2c90 2023-11-24T08:09:05.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.187+0000 7f9de57fa640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9dc806ae40 0x7f9dc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:09:05.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.187+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9de0088860 con 0x7f9de81f2c90 2023-11-24T08:09:05.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.187+0000 7f9decdc9640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9dc806ae40 0x7f9dc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:09:05.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.187+0000 7f9decdc9640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9dc806ae40 0x7f9dc806d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8002230 tx=0x7f9dd80020e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:09:05.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.191+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9de80c6900 con 0x7f9de81f2c90 2023-11-24T08:09:05.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.367+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9de80c6fc0 con 0x7f9de81f2c90 2023-11-24T08:09:05.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.374+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9de80c6fc0 con 0x7f9de81f2c90 2023-11-24T08:09:05.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.377+0000 7f9de57fa640 1 -- 172.21.15.97:0/2379234295 <== mon.0 v2:172.21.15.97:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9de0053b70 con 0x7f9de81f2c90 2023-11-24T08:09:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.378+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9dc806ae40 msgr2=0x7f9dc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.378+0000 7f9def02d640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9dc806ae40 0x7f9dc806d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8002230 tx=0x7f9dd80020e0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.378+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9de81f2c90 msgr2=0x7f9de80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:09:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.378+0000 7f9def02d640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9de81f2c90 0x7f9de80cf9f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9de80709e0 tx=0x7f9de000e5f0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 shutdown_connections 2023-11-24T08:09:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:6832/2294833959,v1:172.21.15.97:6833/2294833959] conn(0x7f9dc806ae40 0x7f9dc806d300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9de81f2c90 0x7f9de80cf9f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9de80c5160 0x7f9de81f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 --2- 172.21.15.97:0/2379234295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dd40047c0 0x7f9de81f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:09:05.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 >> 172.21.15.97:0/2379234295 conn(0x7f9de80b2d00 msgr2=0x7f9de8099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:09:05.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 shutdown_connections 2023-11-24T08:09:05.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-11-24T08:09:05.379+0000 7f9def02d640 1 -- 172.21.15.97:0/2379234295 wait complete. 2023-11-24T08:09:05.400 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mgr daemons: {'finisher-volumes.complete_latency.avgcount'} 2023-11-24T08:09:05.403 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T08:09:05.403 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:09:05.403 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.417 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:09:05.417 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:09:05.417 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.478 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:09:05.478 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:09:05.478 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.507 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:09:05.507 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:09:05.507 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.568 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:09:05.568 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T08:09:05.569 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T08:09:05.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.623 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T08:09:05.623 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T08:09:05.623 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.684 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T08:09:05.684 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T08:09:05.685 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.732 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T08:09:05.732 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T08:09:05.732 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.786 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T08:09:05.786 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T08:09:05.786 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.828 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T08:09:05.828 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T08:09:05.828 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.877 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T08:09:05.877 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T08:09:05.877 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.929 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T08:09:05.929 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T08:09:05.930 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:05.997 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T08:09:05.997 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T08:09:05.998 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T08:09:05.998 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:06.076 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T08:09:06.076 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T08:09:06.076 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:08.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-11-24T08:09:12.178 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T08:09:12.178 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T08:09:12.179 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T08:09:12.179 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:12.206 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T08:09:12.206 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T08:09:12.207 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:12.242 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T08:09:12.242 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T08:09:12.243 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:09:12.318 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T08:09:12.318 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T08:09:12.319 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T08:09:12.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:09:12.431 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T08:09:12.700 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:09:12.701 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T08:09:12.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:09:12.860 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T08:09:13.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:09:13.009 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T08:09:13.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:09:13.169 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T08:09:13.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:09:13.485 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T08:09:13.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:09:13.664 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T08:09:13.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-11-24T08:09:13.818 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:09:13.819 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T08:09:14.013 INFO:tasks.ceph:Archiving mon data... 2023-11-24T08:09:14.015 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/data/mon.a.tgz 2023-11-24T08:09:14.015 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-11-24T08:09:14.074 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.H09gTmxK5V 2023-11-24T08:09:14.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.H09gTmxK5V 2023-11-24T08:09:14.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.H09gTmxK5V 2023-11-24T08:09:14.399 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.H09gTmxK5V is 293KB 2023-11-24T08:09:14.503 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.H09gTmxK5V 2023-11-24T08:09:14.562 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/data/mon.b.tgz 2023-11-24T08:09:14.562 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-24T08:09:14.622 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.20zZtPpidA 2023-11-24T08:09:14.623 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.20zZtPpidA 2023-11-24T08:09:14.838 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.20zZtPpidA 2023-11-24T08:09:14.992 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.20zZtPpidA is 393KB 2023-11-24T08:09:15.104 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.20zZtPpidA 2023-11-24T08:09:15.162 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/data/mon.c.tgz 2023-11-24T08:09:15.162 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-11-24T08:09:15.214 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.vTEc6s9ri9 2023-11-24T08:09:15.214 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vTEc6s9ri9 2023-11-24T08:09:15.390 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.vTEc6s9ri9 2023-11-24T08:09:15.540 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.vTEc6s9ri9 is 393KB 2023-11-24T08:09:15.652 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.vTEc6s9ri9 2023-11-24T08:09:15.711 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T08:09:15.711 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:09:15.720 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:09:15.817 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T08:09:15.817 DEBUG:teuthology.orchestra.run.smithi097:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:09:15.826 DEBUG:teuthology.orchestra.run.smithi183:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:09:15.923 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:09:15.929 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:09:15.941 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T08:09:15.943 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/remote/smithi097/crash 2023-11-24T08:09:15.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:09:16.022 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/remote/smithi183/crash 2023-11-24T08:09:16.023 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:09:16.118 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T08:09:16.119 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:09:16.128 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:09:16.284 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:09:16.386 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:09:16.486 INFO:tasks.ceph:Compressing logs... 2023-11-24T08:09:16.487 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:09:16.495 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:09:16.584 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99401.log 2023-11-24T08:09:16.586 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95195.log 2023-11-24T08:09:16.587 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T08:09:16.588 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99401.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99401.log.gz 2023-11-24T08:09:16.588 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102312.log 2023-11-24T08:09:16.589 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94054.log 2023-11-24T08:09:16.589 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96086.log 2023-11-24T08:09:16.589 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95195.log.gz 2023-11-24T08:09:16.590 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.102312.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T08:09:16.591 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:09:16.591 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.94054.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T08:09:16.591 INFO:teuthology.orchestra.run.smithi183.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.1.94054.log.gz 2023-11-24T08:09:16.592 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T08:09:16.593 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.0.102312.log.gz 2023-11-24T08:09:16.593 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94557.log 2023-11-24T08:09:16.593 INFO:teuthology.orchestra.run.smithi097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.96086.log.gz 2023-11-24T08:09:16.593 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97480.log 2023-11-24T08:09:16.594 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99075.log 2023-11-24T08:09:16.595 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94557.log.gz 2023-11-24T08:09:16.595 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88354.log 2023-11-24T08:09:16.595 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:09:16.595 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88274.log 2023-11-24T08:09:16.596 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88354.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88354.log.gz 2023-11-24T08:09:16.597 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99681.log 2023-11-24T08:09:16.597 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97480.log.gz 2023-11-24T08:09:16.597 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99075.log.gz 2023-11-24T08:09:16.597 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94234.log 2023-11-24T08:09:16.599 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88314.log 2023-11-24T08:09:16.599 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88274.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88274.log.gz 2023-11-24T08:09:16.599 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T08:09:16.600 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99032.log 2023-11-24T08:09:16.600 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99681.log.gz 2023-11-24T08:09:16.600 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94234.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94234.log.gz 2023-11-24T08:09:16.600 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96764.log 2023-11-24T08:09:16.600 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100221.log 2023-11-24T08:09:16.601 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99032.log.gz 2023-11-24T08:09:16.602 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88314.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T08:09:16.603 INFO:teuthology.orchestra.run.smithi183.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88314.log.gz 2023-11-24T08:09:16.603 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T08:09:16.603 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96764.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96764.log.gz 2023-11-24T08:09:16.604 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93884.log 2023-11-24T08:09:16.604 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88713.log 2023-11-24T08:09:16.604 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100221.log.gz 2023-11-24T08:09:16.604 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93884.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93884.log.gz 2023-11-24T08:09:16.604 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99927.log 2023-11-24T08:09:16.606 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88514.log 2023-11-24T08:09:16.606 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88434.log 2023-11-24T08:09:16.607 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.88713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98947.log 2023-11-24T08:09:16.607 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88713.log.gz 2023-11-24T08:09:16.607 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99927.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99927.log.gz 2023-11-24T08:09:16.607 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100683.log 2023-11-24T08:09:16.608 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88474.log 2023-11-24T08:09:16.608 INFO:teuthology.orchestra.run.smithi183.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88514.log.gz 2023-11-24T08:09:16.609 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98947.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98947.log.gz 2023-11-24T08:09:16.609 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94554.log 2023-11-24T08:09:16.609 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95750.log 2023-11-24T08:09:16.609 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100683.log.gz 2023-11-24T08:09:16.611 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88434.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88434.log.gz 2023-11-24T08:09:16.611 INFO:teuthology.orchestra.run.smithi183.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T08:09:16.611 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T08:09:16.612 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94554.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94554.log.gz 2023-11-24T08:09:16.612 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104448.log 2023-11-24T08:09:16.612 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97286.log 2023-11-24T08:09:16.612 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95750.log.gz 2023-11-24T08:09:16.612 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104448.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104448.log.gz 2023-11-24T08:09:16.613 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88474.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88474.log.gz 2023-11-24T08:09:16.614 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95249.log 2023-11-24T08:09:16.614 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99536.log 2023-11-24T08:09:16.614 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93632.log 2023-11-24T08:09:16.615 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97286.log.gz 2023-11-24T08:09:16.615 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99536.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99536.log.gz 2023-11-24T08:09:16.615 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103565.log 2023-11-24T08:09:16.616 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93674.log 2023-11-24T08:09:16.616 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93632.log.gz 2023-11-24T08:09:16.617 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88394.log 2023-11-24T08:09:16.617 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.95249.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:09:16.617 INFO:teuthology.orchestra.run.smithi183.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.1.95249.log.gz 2023-11-24T08:09:16.617 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88394.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T08:09:16.618 INFO:teuthology.orchestra.run.smithi183.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88394.log.gz 2023-11-24T08:09:16.618 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88554.log 2023-11-24T08:09:16.619 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103565.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103565.log.gz 2023-11-24T08:09:16.619 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94862.log 2023-11-24T08:09:16.620 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99159.log 2023-11-24T08:09:16.620 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.93674.log.gz 2023-11-24T08:09:16.620 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94862.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94862.log.gz 2023-11-24T08:09:16.620 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103271.log 2023-11-24T08:09:16.622 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T08:09:16.622 INFO:teuthology.orchestra.run.smithi183.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T08:09:16.622 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.88554.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88554.log.gz 2023-11-24T08:09:16.623 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102535.log 2023-11-24T08:09:16.623 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99159.log.gz 2023-11-24T08:09:16.623 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103271.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103271.log.gz 2023-11-24T08:09:16.623 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95960.log 2023-11-24T08:09:16.624 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98827.log 2023-11-24T08:09:16.624 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102535.log.gz 2023-11-24T08:09:16.624 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95960.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95960.log.gz 2023-11-24T08:09:16.624 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97522.log 2023-11-24T08:09:16.625 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.d.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T08:09:16.626 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94508.log 2023-11-24T08:09:16.626 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T08:09:16.626 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100179.log 2023-11-24T08:09:16.627 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98827.log.gz 2023-11-24T08:09:16.627 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104826.log 2023-11-24T08:09:16.627 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97522.log.gz 2023-11-24T08:09:16.627 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94906.log 2023-11-24T08:09:16.627 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100179.log.gz 2023-11-24T08:09:16.628 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.3.94508.log: 91.3% -- replaced with /var/log/ceph/ceph-client.3.94508.log.gz 2023-11-24T08:09:16.629 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104826.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104826.log.gz 2023-11-24T08:09:16.629 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97732.log 2023-11-24T08:09:16.629 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94906.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94906.log.gz 2023-11-24T08:09:16.629 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104742.log 2023-11-24T08:09:16.630 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101453.log 2023-11-24T08:09:16.630 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97732.log.gz 2023-11-24T08:09:16.631 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104742.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104742.log.gz 2023-11-24T08:09:16.631 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93546.log 2023-11-24T08:09:16.632 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101453.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101453.log.gz 2023-11-24T08:09:16.633 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102782.log 2023-11-24T08:09:16.634 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103028.log 2023-11-24T08:09:16.634 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93546.log.gz 2023-11-24T08:09:16.635 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102782.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102782.log.gz 2023-11-24T08:09:16.635 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104406.log 2023-11-24T08:09:16.636 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100889.log 2023-11-24T08:09:16.636 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103028.log.gz 2023-11-24T08:09:16.637 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104406.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104406.log.gz 2023-11-24T08:09:16.637 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100641.log 2023-11-24T08:09:16.639 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102698.log 2023-11-24T08:09:16.639 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100889.log.gz 2023-11-24T08:09:16.640 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97984.log 2023-11-24T08:09:16.640 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100641.log.gz 2023-11-24T08:09:16.641 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102698.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102698.log.gz 2023-11-24T08:09:16.641 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104700.log 2023-11-24T08:09:16.643 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98068.log 2023-11-24T08:09:16.643 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97984.log.gz 2023-11-24T08:09:16.643 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104700.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104700.log.gz 2023-11-24T08:09:16.643 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94562.log 2023-11-24T08:09:16.644 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98068.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98068.log.gz 2023-11-24T08:09:16.645 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.97182.log 2023-11-24T08:09:16.646 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101927.log 2023-11-24T08:09:16.647 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94562.log.gz 2023-11-24T08:09:16.647 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.2.97182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101717.log 2023-11-24T08:09:16.648 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101927.log: 91.6% -- replaced with /var/log/ceph/ceph-client.2.97182.log.gz 2023-11-24T08:09:16.649 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101927.log.gz 2023-11-24T08:09:16.649 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104238.log 2023-11-24T08:09:16.650 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98659.log 2023-11-24T08:09:16.650 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101717.log.gz 2023-11-24T08:09:16.651 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98110.log 2023-11-24T08:09:16.651 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104238.log.gz 2023-11-24T08:09:16.652 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93157.log 2023-11-24T08:09:16.652 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98659.log.gz 2023-11-24T08:09:16.653 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98110.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98110.log.gz 2023-11-24T08:09:16.653 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99285.log 2023-11-24T08:09:16.654 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104490.log 2023-11-24T08:09:16.655 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93157.log.gz 2023-11-24T08:09:16.655 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93402.log 2023-11-24T08:09:16.656 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99285.log.gz 2023-11-24T08:09:16.656 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100557.log 2023-11-24T08:09:16.657 INFO:teuthology.orchestra.run.smithi097.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104490.log.gz 2023-11-24T08:09:16.658 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93402.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93402.log.gz 2023-11-24T08:09:16.658 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103187.log 2023-11-24T08:09:16.659 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100557.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100557.log.gz 2023-11-24T08:09:16.659 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97438.log 2023-11-24T08:09:16.660 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93494.log 2023-11-24T08:09:16.660 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103187.log.gz 2023-11-24T08:09:16.661 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103812.log 2023-11-24T08:09:16.661 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97438.log.gz 2023-11-24T08:09:16.662 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93494.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93494.log.gz 2023-11-24T08:09:16.662 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98152.log 2023-11-24T08:09:16.664 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95564.log 2023-11-24T08:09:16.664 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103812.log.gz 2023-11-24T08:09:16.664 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103229.log 2023-11-24T08:09:16.665 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98152.log.gz 2023-11-24T08:09:16.666 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99489.log 2023-11-24T08:09:16.666 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95564.log.gz 2023-11-24T08:09:16.667 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103229.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103229.log.gz -5 2023-11-24T08:09:16.667 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94570.log 2023-11-24T08:09:16.668 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99489.log.gz 2023-11-24T08:09:16.668 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96002.log 2023-11-24T08:09:16.669 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103625.log 2023-11-24T08:09:16.669 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94570.log.gz 2023-11-24T08:09:16.670 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96002.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:09:16.670 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96002.log.gz 2023-11-24T08:09:16.671 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103625.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103625.log.gz 2023-11-24T08:09:16.672 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101759.log 2023-11-24T08:09:16.672 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93238.log 2023-11-24T08:09:16.674 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101759.log: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:09:16.674 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101759.log.gz 2023-11-24T08:09:16.674 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103313.log 2023-11-24T08:09:16.675 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95230.log 2023-11-24T08:09:16.676 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93238.log.gz 2023-11-24T08:09:16.677 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103313.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103313.log.gz 2023-11-24T08:09:16.677 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98701.log 2023-11-24T08:09:16.678 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95230.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95230.log.gz 2023-11-24T08:09:16.678 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101367.log 2023-11-24T08:09:16.679 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103355.log 2023-11-24T08:09:16.679 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98701.log.gz 2023-11-24T08:09:16.680 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101367.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101367.log.gz 2023-11-24T08:09:16.680 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93758.log 2023-11-24T08:09:16.681 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98194.log 2023-11-24T08:09:16.681 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103355.log.gz 2023-11-24T08:09:16.682 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93758.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93758.log.gz 2023-11-24T08:09:16.682 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104364.log 2023-11-24T08:09:16.683 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101801.log 2023-11-24T08:09:16.683 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98194.log.gz 2023-11-24T08:09:16.684 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104364.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.102944.log -- replaced with /var/log/ceph/ceph-client.admin.104364.log.gz 2023-11-24T08:09:16.684 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-11-24T08:09:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94560.log 2023-11-24T08:09:16.686 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101801.log.gz 2023-11-24T08:09:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102944.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102944.log.gz 2023-11-24T08:09:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95263.log 2023-11-24T08:09:16.688 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94560.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94560.log.gz 2023-11-24T08:09:16.688 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98743.log 2023-11-24T08:09:16.689 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99969.log 2023-11-24T08:09:16.689 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95263.log.gz 2023-11-24T08:09:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98743.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98743.log.gz 2023-11-24T08:09:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102656.log 2023-11-24T08:09:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99723.log 2023-11-24T08:09:16.692 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99969.log.gz 2023-11-24T08:09:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102656.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102656.log.gz 2023-11-24T08:09:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100969.log 2023-11-24T08:09:16.694 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99723.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99723.log.gz 2023-11-24T08:09:16.694 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95708.log 2023-11-24T08:09:16.695 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100599.log 2023-11-24T08:09:16.695 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100969.log.gz 2023-11-24T08:09:16.696 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101547.log 2023-11-24T08:09:16.696 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95708.log.gz 2023-11-24T08:09:16.697 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.c.log: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T08:09:16.698 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101675.log 2023-11-24T08:09:16.698 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100599.log.gz 2023-11-24T08:09:16.698 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101547.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101547.log.gz 2023-11-24T08:09:16.699 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104196.log 2023-11-24T08:09:16.700 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98785.log 2023-11-24T08:09:16.700 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101675.log.gz 2023-11-24T08:09:16.701 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104196.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104196.log.gz 2023-11-24T08:09:16.701 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94218.log 2023-11-24T08:09:16.703 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100011.log 2023-11-24T08:09:16.703 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98785.log.gz 2023-11-24T08:09:16.704 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94218.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94218.log.gz 2023-11-24T08:09:16.704 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101283.log 2023-11-24T08:09:16.705 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93716.log 2023-11-24T08:09:16.706 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100011.log.gz 2023-11-24T08:09:16.706 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101283.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101283.log.gz 2023-11-24T08:09:16.706 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101157.log 2023-11-24T08:09:16.707 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93716.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T08:09:16.708 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93716.log.gz 2023-11-24T08:09:16.708 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101157.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101157.log.gz 2023-11-24T08:09:16.709 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100053.log 2023-11-24T08:09:16.711 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94905.log 2023-11-24T08:09:16.712 INFO:teuthology.orchestra.run.smithi183.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T08:09:16.712 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100053.log: gzip -5 --verbose -- 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100053.log.gz /var/log/ceph/ceph-client.admin.99201.log 2023-11-24T08:09:16.712 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-11-24T08:09:16.713 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98559.log 2023-11-24T08:09:16.713 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94905.log.gz 2023-11-24T08:09:16.713 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99201.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99201.log.gz 2023-11-24T08:09:16.714 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98236.log 2023-11-24T08:09:16.715 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98559.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98559.log.gz 2023-11-24T08:09:16.715 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99243.log 2023-11-24T08:09:16.716 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98236.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98236.log.gz 2023-11-24T08:09:16.717 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104658.log 2023-11-24T08:09:16.717 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99243.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99243.log.gz 2023-11-24T08:09:16.718 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103728.log 2023-11-24T08:09:16.719 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104658.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104658.log.gz 2023-11-24T08:09:16.719 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98026.log 2023-11-24T08:09:16.720 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103728.log.gz 2023-11-24T08:09:16.720 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97858.log 2023-11-24T08:09:16.721 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98026.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98026.log.gz 2023-11-24T08:09:16.722 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94221.log 2023-11-24T08:09:16.722 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97858.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97858.log.gz 2023-11-24T08:09:16.723 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104910.log 2023-11-24T08:09:16.724 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94221.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94221.log.gz 2023-11-24T08:09:16.724 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101241.log 2023-11-24T08:09:16.725 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104910.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104910.log.gz 2023-11-24T08:09:16.726 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99639.log 2023-11-24T08:09:16.726 INFO:teuthology.orchestra.run.smithi183.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T08:09:16.727 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101241.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101241.log.gz 2023-11-24T08:09:16.727 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98278.log 2023-11-24T08:09:16.728 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99639.log.gz 2023-11-24T08:09:16.728 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94225.log 2023-11-24T08:09:16.729 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98278.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98278.log.gz 2023-11-24T08:09:16.729 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94052.log 2023-11-24T08:09:16.730 INFO:teuthology.orchestra.run.smithi183.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T08:09:16.730 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94225.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94225.log.gz 2023-11-24T08:09:16.731 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97328.log 2023-11-24T08:09:16.732 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94052.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94052.log.gz 2023-11-24T08:09:16.732 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98517.log 2023-11-24T08:09:16.732 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97328.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97328.log.gz 2023-11-24T08:09:16.733 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97774.log 2023-11-24T08:09:16.734 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98517.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98517.log.gz 2023-11-24T08:09:16.734 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100347.log 2023-11-24T08:09:16.735 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97774.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97774.log.gz 2023-11-24T08:09:16.735 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104616.log 2023-11-24T08:09:16.736 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100347.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100347.log.gz 2023-11-24T08:09:16.737 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94900.log 2023-11-24T08:09:16.738 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104616.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104616.log.gz 2023-11-24T08:09:16.738 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94569.log 2023-11-24T08:09:16.739 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94900.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94900.log.gz 2023-11-24T08:09:16.739 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101199.log 2023-11-24T08:09:16.740 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94569.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94569.log.gz 2023-11-24T08:09:16.740 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95522.log 2023-11-24T08:09:16.741 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101199.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101199.log.gz 2023-11-24T08:09:16.741 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99765.log 2023-11-24T08:09:16.742 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95522.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95522.log.gz 2023-11-24T08:09:16.743 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105052.log 2023-11-24T08:09:16.744 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99765.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99765.log.gz 2023-11-24T08:09:16.744 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102451.log 2023-11-24T08:09:16.745 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.105052.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105052.log.gz 2023-11-24T08:09:16.745 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T08:09:16.746 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102451.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102451.log.gz 2023-11-24T08:09:16.746 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82240.log 2023-11-24T08:09:16.747 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100389.log 2023-11-24T08:09:16.749 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.tmp-client.admin.82240.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82240.log.gz 2023-11-24T08:09:16.749 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94232.log 2023-11-24T08:09:16.750 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100389.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100389.log.gz 2023-11-24T08:09:16.750 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104322.log 2023-11-24T08:09:16.751 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94232.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94232.log.gz 2023-11-24T08:09:16.752 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102986.log 2023-11-24T08:09:16.753 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103439.log 2023-11-24T08:09:16.753 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104322.log.gz 2023-11-24T08:09:16.754 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102986.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102986.log.gz 2023-11-24T08:09:16.754 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103481.log 2023-11-24T08:09:16.755 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103439.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103439.log.gz 2023-11-24T08:09:16.756 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100473.log 2023-11-24T08:09:16.757 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95606.log 2023-11-24T08:09:16.757 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103481.log.gz 2023-11-24T08:09:16.758 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100473.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100473.log.gz 2023-11-24T08:09:16.758 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95238.log 2023-11-24T08:09:16.759 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95606.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95606.log.gz 2023-11-24T08:09:16.760 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101497.log 2023-11-24T08:09:16.761 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104952.log 2023-11-24T08:09:16.761 INFO:teuthology.orchestra.run.smithi097.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95238.log.gz 2023-11-24T08:09:16.762 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101497.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101497.log.gz 2023-11-24T08:09:16.763 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T08:09:16.763 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101589.log 2023-11-24T08:09:16.764 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104952.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104952.log.gz 2023-11-24T08:09:16.764 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102035.log 2023-11-24T08:09:16.765 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94851.log 2023-11-24T08:09:16.766 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101589.log.gz 2023-11-24T08:09:16.766 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102035.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102035.log.gz 2023-11-24T08:09:16.767 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103770.log 2023-11-24T08:09:16.768 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94851.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94851.log.gz 2023-11-24T08:09:16.768 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102493.log 2023-11-24T08:09:16.770 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103770.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103770.log.gz 2023-11-24T08:09:16.770 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97648.log 2023-11-24T08:09:16.771 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102493.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102493.log.gz 2023-11-24T08:09:16.772 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95876.log 2023-11-24T08:09:16.772 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97648.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97648.log.gz 2023-11-24T08:09:16.773 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94903.log 2023-11-24T08:09:16.774 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100137.log 2023-11-24T08:09:16.774 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95876.log.gz 2023-11-24T08:09:16.775 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94903.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94903.log.gz 2023-11-24T08:09:16.776 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101097.log 2023-11-24T08:09:16.776 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100137.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100137.log.gz 2023-11-24T08:09:16.777 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104532.log 2023-11-24T08:09:16.778 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101325.log 2023-11-24T08:09:16.779 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101097.log.gz 2023-11-24T08:09:16.779 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104532.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104532.log.gz 2023-11-24T08:09:16.780 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100515.log 2023-11-24T08:09:16.781 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102740.log 2023-11-24T08:09:16.781 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101325.log.gz 2023-11-24T08:09:16.782 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100515.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100515.log.gz 2023-11-24T08:09:16.783 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101843.log 2023-11-24T08:09:16.784 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93347.log 2023-11-24T08:09:16.784 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102740.log.gz 2023-11-24T08:09:16.785 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101843.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101843.log.gz 2023-11-24T08:09:16.785 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93842.log 2023-11-24T08:09:16.786 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93347.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.93347.log.gz 2023-11-24T08:09:16.787 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93284.log 2023-11-24T08:09:16.788 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98475.log 2023-11-24T08:09:16.788 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93842.log.gz 2023-11-24T08:09:16.789 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93284.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93284.log.gz 2023-11-24T08:09:16.789 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93926.log 2023-11-24T08:09:16.790 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98475.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98475.log.gz 2023-11-24T08:09:16.791 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T08:09:16.792 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98320.log 2023-11-24T08:09:16.792 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93926.log.gz 2023-11-24T08:09:16.793 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100431.log 2023-11-24T08:09:16.795 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88568.log 2023-11-24T08:09:16.795 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98320.log.gz 2023-11-24T08:09:16.796 INFO:teuthology.orchestra.run.smithi183.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T08:09:16.796 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99885.log 2023-11-24T08:09:16.797 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100431.log.gz 2023-11-24T08:09:16.798 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.88568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99444.log 2023-11-24T08:09:16.798 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88568.log.gz 2023-11-24T08:09:16.800 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99596.log 2023-11-24T08:09:16.800 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99885.log.gz 2023-11-24T08:09:16.801 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95133.log 2023-11-24T08:09:16.801 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99444.log.gz 2023-11-24T08:09:16.802 INFO:teuthology.orchestra.run.smithi183.stderr: 2023-11-24T08:09:16.802 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m0.254s 2023-11-24T08:09:16.802 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m0.785s 2023-11-24T08:09:16.803 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.193s 2023-11-24T08:09:16.803 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100263.log 2023-11-24T08:09:16.804 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99596.log.gz 2023-11-24T08:09:16.804 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102902.log 2023-11-24T08:09:16.804 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95133.log.gz 2023-11-24T08:09:16.805 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94010.log 2023-11-24T08:09:16.806 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100263.log.gz 2023-11-24T08:09:16.807 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103686.log 2023-11-24T08:09:16.807 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102902.log.gz 2023-11-24T08:09:16.808 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93452.log 88.8% 2023-11-24T08:09:16.808 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94010.log.gz 2023-11-24T08:09:16.810 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97564.log 2023-11-24T08:09:16.810 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103686.log.gz 2023-11-24T08:09:16.811 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97690.log 89.3% 2023-11-24T08:09:16.812 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93452.log.gz 2023-11-24T08:09:16.813 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104154.log 2023-11-24T08:09:16.813 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97564.log.gz 2023-11-24T08:09:16.814 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95235.log 2023-11-24T08:09:16.815 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97690.log.gz 2023-11-24T08:09:16.815 INFO:teuthology.orchestra.run.smithi097.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T08:09:16.816 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93061.log 2023-11-24T08:09:16.816 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104154.log.gz 2023-11-24T08:09:16.818 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95235.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T08:09:16.818 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95235.log.gz 2023-11-24T08:09:16.819 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93061.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93061.log.gz 2023-11-24T08:09:16.819 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95183.log 2023-11-24T08:09:16.820 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99843.log 2023-11-24T08:09:16.821 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95183.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95183.log.gz 2023-11-24T08:09:16.821 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104112.log 2023-11-24T08:09:16.822 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99843.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99843.log.gz 2023-11-24T08:09:16.822 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101409.log 2023-11-24T08:09:16.824 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94564.log 2023-11-24T08:09:16.824 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104112.log.gz 2023-11-24T08:09:16.825 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101409.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101409.log.gz -5 2023-11-24T08:09:16.825 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101631.log 2023-11-24T08:09:16.826 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94564.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94564.log.gz 2023-11-24T08:09:16.827 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98989.log 2023-11-24T08:09:16.828 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95480.log 2023-11-24T08:09:16.828 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101631.log.gz 2023-11-24T08:09:16.830 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98989.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98989.log.gz 2023-11-24T08:09:16.830 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97816.log 2023-11-24T08:09:16.831 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99359.log 2023-11-24T08:09:16.831 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95480.log.gz 2023-11-24T08:09:16.832 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97816.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97816.log.gz 2023-11-24T08:09:16.833 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98905.log 2023-11-24T08:09:16.834 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99359.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T08:09:16.834 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99359.log.gz 2023-11-24T08:09:16.835 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98905.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.98905.log.gz 2023-11-24T08:09:16.835 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101011.log 2023-11-24T08:09:16.837 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105012.log 2023-11-24T08:09:16.837 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101011.log: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:09:16.838 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101011.log.gz 2023-11-24T08:09:16.838 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96044.log 2023-11-24T08:09:16.839 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.105012.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105012.log.gz 2023-11-24T08:09:16.840 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94897.log 2023-11-24T08:09:16.841 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96044.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96044.log.gz 2023-11-24T08:09:16.841 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98601.log 2023-11-24T08:09:16.843 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94897.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94897.log.gz 2023-11-24T08:09:16.843 INFO:teuthology.orchestra.run.smithi097.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T08:09:16.843 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T08:09:16.843 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98601.log: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T08:09:16.844 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98601.log.gz 2023-11-24T08:09:16.844 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95834.log 2023-11-24T08:09:16.846 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T08:09:16.847 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95834.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95834.log.gz 2023-11-24T08:09:16.847 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95918.log 2023-11-24T08:09:16.848 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94226.log 2023-11-24T08:09:16.850 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95918.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95918.log.gz 2023-11-24T08:09:16.850 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101055.log 2023-11-24T08:09:16.852 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103145.log 2023-11-24T08:09:16.852 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94226.log.gz 2023-11-24T08:09:16.853 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101055.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101055.log.gz 2023-11-24T08:09:16.853 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104784.log 2023-11-24T08:09:16.854 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100305.log 2023-11-24T08:09:16.855 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103145.log.gz 2023-11-24T08:09:16.856 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104784.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104784.log.gz 2023-11-24T08:09:16.856 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94216.log 2023-11-24T08:09:16.857 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94233.log 2023-11-24T08:09:16.858 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100305.log.gz 2023-11-24T08:09:16.858 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94216.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.94216.log.gz -5 2023-11-24T08:09:16.858 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97942.log 2023-11-24T08:09:16.860 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94233.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94233.log.gz 2023-11-24T08:09:16.860 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103896.log 2023-11-24T08:09:16.861 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88311.log 2023-11-24T08:09:16.861 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97942.log.gz 2023-11-24T08:09:16.862 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103896.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103896.log.gz 2023-11-24T08:09:16.863 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95792.log 2023-11-24T08:09:16.864 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.88311.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.88311.log.gz 2023-11-24T08:09:16.865 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99117.log 2023-11-24T08:09:16.865 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95792.log: 89.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T08:09:16.865 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103854.log 2023-11-24T08:09:16.865 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95792.log.gz 2023-11-24T08:09:16.868 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99117.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99117.log.gz 2023-11-24T08:09:16.868 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102824.log 2023-11-24T08:09:16.869 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97900.log 2023-11-24T08:09:16.869 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103854.log.gz 2023-11-24T08:09:16.869 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102824.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102824.log.gz 2023-11-24T08:09:16.869 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93590.log 2023-11-24T08:09:16.872 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96188.log 2023-11-24T08:09:16.872 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97900.log.gz 2023-11-24T08:09:16.872 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93590.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93590.log.gz 2023-11-24T08:09:16.873 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98433.log 2023-11-24T08:09:16.873 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93968.log 2023-11-24T08:09:16.873 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96188.log.gz 2023-11-24T08:09:16.876 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98433.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98433.log.gz 2023-11-24T08:09:16.876 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94567.log 2023-11-24T08:09:16.877 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93968.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93968.log.gz 2023-11-24T08:09:16.877 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96622.log 2023-11-24T08:09:16.877 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102577.log 2023-11-24T08:09:16.877 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94567.log.gz 2023-11-24T08:09:16.879 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.96622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104574.log 2023-11-24T08:09:16.879 INFO:teuthology.orchestra.run.smithi097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.96622.log.gz 2023-11-24T08:09:16.880 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102577.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102577.log.gz 2023-11-24T08:09:16.880 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97606.log 2023-11-24T08:09:16.881 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103523.log 2023-11-24T08:09:16.882 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104574.log.gz 2023-11-24T08:09:16.882 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97606.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97606.log.gz 2023-11-24T08:09:16.882 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95438.log 2023-11-24T08:09:16.884 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103523.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103523.log.gz 2023-11-24T08:09:16.884 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103397.log 2023-11-24T08:09:16.884 INFO:teuthology.orchestra.run.smithi097.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T08:09:16.885 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101885.log 2023-11-24T08:09:16.885 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95438.log.gz 2023-11-24T08:09:16.886 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103397.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103397.log.gz 2023-11-24T08:09:16.887 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94894.log 2023-11-24T08:09:16.887 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103070.log 2023-11-24T08:09:16.887 INFO:teuthology.orchestra.run.smithi097.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101885.log.gz 2023-11-24T08:09:16.888 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94894.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94894.log.gzgzip 2023-11-24T08:09:16.888 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100095.log 2023-11-24T08:09:16.889 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104868.log 2023-11-24T08:09:16.889 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103070.log.gz 2023-11-24T08:09:16.890 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100725.log 2023-11-24T08:09:16.890 INFO:teuthology.orchestra.run.smithi097.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100095.log.gz 2023-11-24T08:09:16.891 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104280.log 2023-11-24T08:09:16.892 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104868.log.gz 2023-11-24T08:09:16.892 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100725.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100725.log.gz 2023-11-24T08:09:16.893 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95239.log 2023-11-24T08:09:16.894 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104280.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T08:09:16.894 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104280.log.gz 2023-11-24T08:09:16.895 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95239.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.95239.log.gz --verbose 2023-11-24T08:09:16.895 INFO:teuthology.orchestra.run.smithi097.stderr: -- /var/log/ceph/ceph-client.admin.100809.log 2023-11-24T08:09:16.896 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103938.log 2023-11-24T08:09:16.897 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100809.log: 90.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T08:09:16.897 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100809.log.gz 2023-11-24T08:09:16.898 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101969.log 2023-11-24T08:09:16.899 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95648.log 2023-11-24T08:09:16.899 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103938.log.gz 2023-11-24T08:09:16.900 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.101969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100767.log 2023-11-24T08:09:16.900 INFO:teuthology.orchestra.run.smithi097.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.101969.log.gz 2023-11-24T08:09:16.901 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93800.log 2023-11-24T08:09:16.901 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95648.log.gz 2023-11-24T08:09:16.902 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100767.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100767.log.gz 2023-11-24T08:09:16.903 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93800.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93800.log.gz 2023-11-24T08:09:16.934 INFO:teuthology.orchestra.run.smithi097.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T08:09:16.938 INFO:teuthology.orchestra.run.smithi097.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T08:09:16.941 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-11-24T08:09:16.942 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m0.399s 2023-11-24T08:09:16.942 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m0.832s 2023-11-24T08:09:16.942 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m0.731s 2023-11-24T08:09:16.943 INFO:tasks.ceph:Archiving logs... 2023-11-24T08:09:16.943 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/remote/smithi097/log 2023-11-24T08:09:16.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:09:17.305 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/remote/smithi183/log 2023-11-24T08:09:17.305 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:09:17.513 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T08:09:17.533 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mgr daemons: {'finisher-volumes.complete_latency.avgcount'} 2023-11-24T08:09:17.535 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T08:09:17.535 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:09:17.544 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:09:17.699 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T08:09:17.709 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T08:09:17.709 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:09:17.718 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:09:17.766 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2023-11-24T08:09:17.775 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-11-24T08:09:17.777 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:09:17.778 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2023-11-24T08:09:17.778 INFO:teuthology.orchestra.run.smithi097.stdout:^* hv01.front.sepia.ceph.com 2 6 377 13 +2470us[+2476us] +/- 79ms 2023-11-24T08:09:17.778 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -798us[ -798us] +/- 57ms 2023-11-24T08:09:17.778 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -1256us[-1250us] +/- 68ms 2023-11-24T08:09:17.778 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:09:17.785 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:09:17.785 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-11-24T08:09:17.785 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv01.front.sepia.ceph.com 2 6 377 14 +2509us[+2456us] +/- 79ms 2023-11-24T08:09:17.785 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -788us[ -788us] +/- 57ms 2023-11-24T08:09:17.786 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -1247us[-1247us] +/- 69ms 2023-11-24T08:09:17.786 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:09:17.787 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T08:09:17.796 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T08:09:17.797 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T08:09:17.805 DEBUG:teuthology.orchestra.run.smithi097:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T08:09:18.066 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T08:09:18.321 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T08:09:18.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:09:18.432 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T08:09:18.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:09:18.538 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T08:09:18.548 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T08:09:18.570 INFO:teuthology.task.internal:Duration was 952.612359 seconds 2023-11-24T08:09:18.570 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T08:09:18.581 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T08:09:18.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:09:18.591 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:09:18.757 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T08:09:18.759 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T08:09:19.210 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T08:09:19.210 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2023-11-24T08:09:19.211 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:09:19.279 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2023-11-24T08:09:19.279 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:09:19.358 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T08:09:19.359 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:09:19.367 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:09:19.461 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T08:09:19.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:09:19.467 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:09:19.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T08:09:19.655 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T08:09:19.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:09:19.754 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:09:19.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T08:09:19.864 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:09:19.873 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:09:19.978 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2023-11-24T08:09:19.986 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2023-11-24T08:09:20.038 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:09:20.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:09:20.086 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:09:20.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:09:20.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T08:09:20.155 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T08:09:20.157 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/remote/smithi097 2023-11-24T08:09:20.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:09:20.269 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583/remote/smithi183 2023-11-24T08:09:20.269 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:09:20.380 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T08:09:20.380 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:09:20.390 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:09:20.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T08:09:20.460 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T08:09:20.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T08:09:20.471 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T08:09:20.471 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:09:20.481 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:09:20.532 INFO:teuthology.orchestra.run.smithi097.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:09 /home/ubuntu/cephtest 2023-11-24T08:09:20.542 INFO:teuthology.orchestra.run.smithi183.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:09 /home/ubuntu/cephtest 2023-11-24T08:09:20.545 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T08:09:20.556 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T08:09:20.568 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: The following counters failed to be set on mgr daemons: {'finisher-volumes.complete_latency.avgcount'} 2023-11-24T08:09:20.568 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T08:09:20.596 DEBUG:teuthology.nuke:shortname: smithi097 2023-11-24T08:09:20.596 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:09:20.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:44:08.032284', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNj/Q+XzPTzQh4YeOrpq7cp5fQgcIqmxw09S5DRAXHWKDHAJeGN2B62rS/F+NlvAjXihUPMgzxruiDaYYDBUu6s='} 2023-11-24T08:09:20.623 DEBUG:teuthology.nuke:shortname: smithi183 2023-11-24T08:09:20.623 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:09:20.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:44:08.033762', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2jbnTgFWWyS3hgRkhI4wivbPVBPcBaeh1trxn73JT6JR2bGccc0/+77lrdqIoyBiIEbah/aUxaZR5TMFK6IMg='} 2023-11-24T08:09:20.678 INFO:teuthology.orchestra.console.smithi097:Power off 2023-11-24T08:09:20.678 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:09:20.694 INFO:teuthology.orchestra.console.smithi183:Power off 2023-11-24T08:09:20.694 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:09:20.703 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-11-24T08:09:20.704 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:09:20.717 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-11-24T08:09:20.718 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:09:20.728 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-24T08:09:20.741 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-11-24T08:09:24.730 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:09:24.742 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:09:24.841 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-11-24T08:09:24.853 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-11-24T08:09:28.842 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:09:28.854 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:09:28.955 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-11-24T08:09:28.964 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-11-24T08:09:29.056 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-11-24T08:09:32.966 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:09:33.077 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-11-24T08:09:33.177 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-11-24T08:09:33.283 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} duration: 952.612359046936 failure_reason: 'Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread)' flavor: default mon.a-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 mon.b-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=651f5ce5f9284a4d96d2b513c0e76e25 status: fail success: false 2023-11-24T08:09:33.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T08:09:33.362 INFO:teuthology.run:FAIL